May 27 20:08:49.154163 ip-10-0-135-103 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 27 20:08:49.154173 ip-10-0-135-103 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 27 20:08:49.154180 ip-10-0-135-103 systemd[1]: kubelet.service: Failed with result 'resources'. May 27 20:08:49.154421 ip-10-0-135-103 systemd[1]: Failed to start Kubernetes Kubelet. May 27 20:08:59.213815 ip-10-0-135-103 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 27 20:08:59.213833 ip-10-0-135-103 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e2d741eb4d074d9da44e4e161431fb7b -- May 27 20:11:30.355968 ip-10-0-135-103 systemd[1]: Starting Kubernetes Kubelet... May 27 20:11:30.798918 ip-10-0-135-103 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 20:11:30.798918 ip-10-0-135-103 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 27 20:11:30.798918 ip-10-0-135-103 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 20:11:30.798918 ip-10-0-135-103 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 27 20:11:30.798918 ip-10-0-135-103 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 20:11:30.800890 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.800807 2554 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 27 20:11:30.803447 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803432 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 20:11:30.803447 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803447 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 20:11:30.803518 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803451 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 20:11:30.803518 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803455 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 20:11:30.803518 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803458 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 20:11:30.803518 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803462 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 20:11:30.803518 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803464 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 20:11:30.803518 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803467 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 20:11:30.803518 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803470 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 20:11:30.803518 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803473 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 20:11:30.803518 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803475 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 20:11:30.803518 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803478 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 20:11:30.803518 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803480 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 20:11:30.803518 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803483 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 20:11:30.803518 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803486 2554 feature_gate.go:328] unrecognized feature gate: Example2 May 27 20:11:30.803518 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803489 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 20:11:30.803518 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803491 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 20:11:30.803518 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803494 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 20:11:30.803518 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803496 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 20:11:30.803518 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803499 2554 feature_gate.go:328] unrecognized feature gate: Example May 27 20:11:30.803518 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803501 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 20:11:30.803994 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803504 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 20:11:30.803994 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803507 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 20:11:30.803994 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803509 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 20:11:30.803994 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803512 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 20:11:30.803994 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803514 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 20:11:30.803994 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803522 2554 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 20:11:30.803994 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803524 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 20:11:30.803994 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803527 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 20:11:30.803994 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803530 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 20:11:30.803994 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803533 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 20:11:30.803994 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803535 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 20:11:30.803994 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803538 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 20:11:30.803994 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803541 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 20:11:30.803994 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803543 2554 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 20:11:30.803994 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803546 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 20:11:30.803994 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803550 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 20:11:30.803994 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803555 2554 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 20:11:30.803994 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803558 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 20:11:30.803994 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803561 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 20:11:30.803994 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803564 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 20:11:30.804500 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803566 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 20:11:30.804500 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803568 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 20:11:30.804500 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803571 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 20:11:30.804500 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803573 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 20:11:30.804500 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803576 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 20:11:30.804500 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803578 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 20:11:30.804500 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803581 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 20:11:30.804500 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803583 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 20:11:30.804500 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803585 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 20:11:30.804500 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803588 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 20:11:30.804500 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803591 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 20:11:30.804500 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803593 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 20:11:30.804500 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803596 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 20:11:30.804500 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803599 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 20:11:30.804500 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803602 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 20:11:30.804500 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803605 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 20:11:30.804500 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803607 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 20:11:30.804500 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803610 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 20:11:30.804500 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803612 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 20:11:30.804500 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803615 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 20:11:30.805057 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803630 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 20:11:30.805057 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803633 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 20:11:30.805057 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803636 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 20:11:30.805057 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803640 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 20:11:30.805057 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803644 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 20:11:30.805057 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803647 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 20:11:30.805057 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803650 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 20:11:30.805057 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803652 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 20:11:30.805057 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803655 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 20:11:30.805057 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803657 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 20:11:30.805057 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803660 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 20:11:30.805057 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803662 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 20:11:30.805057 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803665 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 20:11:30.805057 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803668 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 20:11:30.805057 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803671 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 20:11:30.805057 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803673 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 20:11:30.805057 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803677 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 20:11:30.805057 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803680 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 20:11:30.805057 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803682 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 20:11:30.805511 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803685 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 20:11:30.805511 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803688 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 20:11:30.805511 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803690 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 20:11:30.805511 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803693 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 20:11:30.805511 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803695 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 20:11:30.805511 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.803698 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 20:11:30.805511 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804052 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 20:11:30.805511 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804056 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 20:11:30.805511 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804060 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 20:11:30.805511 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804063 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 20:11:30.805511 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804065 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 20:11:30.805511 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804069 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 20:11:30.805511 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804073 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 20:11:30.805511 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804076 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 20:11:30.805511 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804078 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 20:11:30.805511 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804081 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 20:11:30.805511 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804083 2554 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 20:11:30.805511 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804087 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 20:11:30.805511 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804091 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 20:11:30.805995 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804093 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 20:11:30.805995 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804096 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 20:11:30.805995 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804099 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 20:11:30.805995 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804101 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 20:11:30.805995 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804104 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 20:11:30.805995 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804106 2554 feature_gate.go:328] unrecognized feature gate: Example2 May 27 20:11:30.805995 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804108 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 20:11:30.805995 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804111 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 20:11:30.805995 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804114 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 20:11:30.805995 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804117 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 20:11:30.805995 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804119 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 20:11:30.805995 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804122 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 20:11:30.805995 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804124 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 20:11:30.805995 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804128 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 20:11:30.805995 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804130 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 20:11:30.805995 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804133 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 20:11:30.805995 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804135 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 20:11:30.805995 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804138 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 20:11:30.805995 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804141 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 20:11:30.805995 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804143 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 20:11:30.806482 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804146 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 20:11:30.806482 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804148 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 20:11:30.806482 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804151 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 20:11:30.806482 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804153 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 20:11:30.806482 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804156 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 20:11:30.806482 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804158 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 20:11:30.806482 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804161 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 20:11:30.806482 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804163 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 20:11:30.806482 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804165 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 20:11:30.806482 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804168 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 20:11:30.806482 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804171 2554 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 20:11:30.806482 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804174 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 20:11:30.806482 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804176 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 20:11:30.806482 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804179 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 20:11:30.806482 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804181 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 20:11:30.806482 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804184 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 20:11:30.806482 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804186 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 20:11:30.806482 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804189 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 20:11:30.806482 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804191 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 20:11:30.806960 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804194 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 20:11:30.806960 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804197 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 20:11:30.806960 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804199 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 20:11:30.806960 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804202 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 20:11:30.806960 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804204 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 20:11:30.806960 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804207 2554 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 20:11:30.806960 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804209 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 20:11:30.806960 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804212 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 20:11:30.806960 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804214 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 20:11:30.806960 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804217 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 20:11:30.806960 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804219 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 20:11:30.806960 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804222 2554 feature_gate.go:328] unrecognized feature gate: Example May 27 20:11:30.806960 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804225 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 20:11:30.806960 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804227 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 20:11:30.806960 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804230 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 20:11:30.806960 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804233 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 20:11:30.806960 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804235 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 20:11:30.806960 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804238 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 20:11:30.806960 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804240 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 20:11:30.806960 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804243 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 20:11:30.807486 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804246 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 20:11:30.807486 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804249 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 20:11:30.807486 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804252 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 20:11:30.807486 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804255 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 20:11:30.807486 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804258 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 20:11:30.807486 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804260 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 20:11:30.807486 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804263 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 20:11:30.807486 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804265 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 20:11:30.807486 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804268 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 20:11:30.807486 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804270 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 20:11:30.807486 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804273 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 20:11:30.807486 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804275 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 20:11:30.807486 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804278 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 20:11:30.807486 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.804280 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 20:11:30.807486 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804350 2554 flags.go:64] FLAG: --address="0.0.0.0" May 27 20:11:30.807486 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804357 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 27 20:11:30.807486 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804362 2554 flags.go:64] FLAG: --anonymous-auth="true" May 27 20:11:30.807486 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804367 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" May 27 20:11:30.807486 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804371 2554 flags.go:64] FLAG: --authentication-token-webhook="false" May 27 20:11:30.807486 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804377 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 27 20:11:30.807486 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804383 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 27 20:11:30.808028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804389 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 27 20:11:30.808028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804394 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 27 20:11:30.808028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804400 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 27 20:11:30.808028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804403 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 27 20:11:30.808028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804407 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 27 20:11:30.808028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804410 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 27 20:11:30.808028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804413 2554 flags.go:64] FLAG: --cgroup-root="" May 27 20:11:30.808028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804416 2554 flags.go:64] FLAG: --cgroups-per-qos="true" May 27 20:11:30.808028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804419 2554 flags.go:64] FLAG: --client-ca-file="" May 27 20:11:30.808028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804421 2554 flags.go:64] FLAG: --cloud-config="" May 27 20:11:30.808028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804424 2554 flags.go:64] FLAG: --cloud-provider="external" May 27 20:11:30.808028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804427 2554 flags.go:64] FLAG: --cluster-dns="[]" May 27 20:11:30.808028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804432 2554 flags.go:64] FLAG: --cluster-domain="" May 27 20:11:30.808028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804434 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 27 20:11:30.808028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804438 2554 flags.go:64] FLAG: --config-dir="" May 27 20:11:30.808028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804441 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 27 20:11:30.808028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804444 2554 flags.go:64] FLAG: --container-log-max-files="5" May 27 20:11:30.808028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804448 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" May 27 20:11:30.808028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804452 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 27 20:11:30.808028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804456 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 27 20:11:30.808028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804459 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 27 20:11:30.808028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804463 2554 flags.go:64] FLAG: --contention-profiling="false" May 27 20:11:30.808028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804466 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" May 27 20:11:30.808028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804469 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804472 2554 flags.go:64] FLAG: --cpu-manager-policy="none" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804475 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804480 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804483 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804486 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804489 2554 flags.go:64] FLAG: --enable-load-reader="false" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804491 2554 flags.go:64] FLAG: --enable-server="true" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804495 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804498 2554 flags.go:64] FLAG: --event-burst="100" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804502 2554 flags.go:64] FLAG: --event-qps="50" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804505 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804508 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804512 2554 flags.go:64] FLAG: --eviction-hard="" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804515 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804518 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804522 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804526 2554 flags.go:64] FLAG: --eviction-soft="" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804529 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804531 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804534 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804537 2554 flags.go:64] FLAG: --experimental-mounter-path="" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804540 2554 flags.go:64] FLAG: --fail-cgroupv1="false" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804545 2554 flags.go:64] FLAG: --fail-swap-on="true" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804548 2554 flags.go:64] FLAG: --feature-gates="" May 27 20:11:30.808607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804552 2554 flags.go:64] FLAG: --file-check-frequency="20s" May 27 20:11:30.809224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804555 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 27 20:11:30.809224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804558 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 27 20:11:30.809224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804562 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 27 20:11:30.809224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804565 2554 flags.go:64] FLAG: --healthz-port="10248" May 27 20:11:30.809224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804568 2554 flags.go:64] FLAG: --help="false" May 27 20:11:30.809224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804571 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-135-103.ec2.internal" May 27 20:11:30.809224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804575 2554 flags.go:64] FLAG: --housekeeping-interval="10s" May 27 20:11:30.809224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804578 2554 flags.go:64] FLAG: --http-check-frequency="20s" May 27 20:11:30.809224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804581 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 27 20:11:30.809224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804584 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 27 20:11:30.809224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804588 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" May 27 20:11:30.809224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804591 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" May 27 20:11:30.809224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804594 2554 flags.go:64] FLAG: --image-service-endpoint="" May 27 20:11:30.809224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804597 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" May 27 20:11:30.809224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804600 2554 flags.go:64] FLAG: --kube-api-burst="100" May 27 20:11:30.809224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804602 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 27 20:11:30.809224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804606 2554 flags.go:64] FLAG: --kube-api-qps="50" May 27 20:11:30.809224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804612 2554 flags.go:64] FLAG: --kube-reserved="" May 27 20:11:30.809224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804615 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" May 27 20:11:30.809224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804617 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 27 20:11:30.809224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804633 2554 flags.go:64] FLAG: --kubelet-cgroups="" May 27 20:11:30.809224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804636 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 27 20:11:30.809224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804639 2554 flags.go:64] FLAG: --lock-file="" May 27 20:11:30.809224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804641 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" May 27 20:11:30.809855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804654 2554 flags.go:64] FLAG: --log-flush-frequency="5s" May 27 20:11:30.809855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804658 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 27 20:11:30.809855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804668 2554 flags.go:64] FLAG: --log-json-split-stream="false" May 27 20:11:30.809855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804671 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 27 20:11:30.809855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804674 2554 flags.go:64] FLAG: --log-text-split-stream="false" May 27 20:11:30.809855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804679 2554 flags.go:64] FLAG: --logging-format="text" May 27 20:11:30.809855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804682 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 27 20:11:30.809855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804685 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" May 27 20:11:30.809855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804688 2554 flags.go:64] FLAG: --manifest-url="" May 27 20:11:30.809855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804691 2554 flags.go:64] FLAG: --manifest-url-header="" May 27 20:11:30.809855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804696 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 27 20:11:30.809855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804699 2554 flags.go:64] FLAG: --max-open-files="1000000" May 27 20:11:30.809855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804703 2554 flags.go:64] FLAG: --max-pods="110" May 27 20:11:30.809855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804706 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" May 27 20:11:30.809855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804709 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 27 20:11:30.809855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804712 2554 flags.go:64] FLAG: --memory-manager-policy="None" May 27 20:11:30.809855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804715 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 27 20:11:30.809855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804718 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 27 20:11:30.809855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804721 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" May 27 20:11:30.809855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.804725 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 27 20:11:30.809855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805560 2554 flags.go:64] FLAG: --node-status-max-images="50" May 27 20:11:30.809855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805565 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" May 27 20:11:30.809855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805569 2554 flags.go:64] FLAG: --oom-score-adj="-999" May 27 20:11:30.809855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805573 2554 flags.go:64] FLAG: --pod-cidr="" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805576 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805582 2554 flags.go:64] FLAG: --pod-manifest-path="" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805587 2554 flags.go:64] FLAG: --pod-max-pids="-1" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805590 2554 flags.go:64] FLAG: --pods-per-core="0" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805593 2554 flags.go:64] FLAG: --port="10250" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805596 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805599 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fc7063a1d99d61c1" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805603 2554 flags.go:64] FLAG: --qos-reserved="" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805606 2554 flags.go:64] FLAG: --read-only-port="10255" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805609 2554 flags.go:64] FLAG: --register-node="true" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805611 2554 flags.go:64] FLAG: --register-schedulable="true" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805614 2554 flags.go:64] FLAG: --register-with-taints="" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805628 2554 flags.go:64] FLAG: --registry-burst="10" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805633 2554 flags.go:64] FLAG: --registry-qps="5" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805636 2554 flags.go:64] FLAG: --reserved-cpus="" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805639 2554 flags.go:64] FLAG: --reserved-memory="" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805643 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805646 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805649 2554 flags.go:64] FLAG: --rotate-certificates="false" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805652 2554 flags.go:64] FLAG: --rotate-server-certificates="false" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805655 2554 flags.go:64] FLAG: --runonce="false" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805658 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805661 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805664 2554 flags.go:64] FLAG: --seccomp-default="false" May 27 20:11:30.810431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805667 2554 flags.go:64] FLAG: --serialize-image-pulls="true" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805670 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805673 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805676 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805680 2554 flags.go:64] FLAG: --storage-driver-password="root" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805683 2554 flags.go:64] FLAG: --storage-driver-secure="false" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805686 2554 flags.go:64] FLAG: --storage-driver-table="stats" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805689 2554 flags.go:64] FLAG: --storage-driver-user="root" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805691 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805694 2554 flags.go:64] FLAG: --sync-frequency="1m0s" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805699 2554 flags.go:64] FLAG: --system-cgroups="" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805702 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805707 2554 flags.go:64] FLAG: --system-reserved-cgroup="" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805710 2554 flags.go:64] FLAG: --tls-cert-file="" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805713 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805718 2554 flags.go:64] FLAG: --tls-min-version="" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805720 2554 flags.go:64] FLAG: --tls-private-key-file="" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805723 2554 flags.go:64] FLAG: --topology-manager-policy="none" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805726 2554 flags.go:64] FLAG: --topology-manager-policy-options="" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805729 2554 flags.go:64] FLAG: --topology-manager-scope="container" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805732 2554 flags.go:64] FLAG: --v="2" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805738 2554 flags.go:64] FLAG: --version="false" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805742 2554 flags.go:64] FLAG: --vmodule="" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805747 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.805750 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 27 20:11:30.811092 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805848 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 20:11:30.811711 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805852 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 20:11:30.811711 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805855 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 20:11:30.811711 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805859 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 20:11:30.811711 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805861 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 20:11:30.811711 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805865 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 20:11:30.811711 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805869 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 20:11:30.811711 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805873 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 20:11:30.811711 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805876 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 20:11:30.811711 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805878 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 20:11:30.811711 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805882 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 20:11:30.811711 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805886 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 20:11:30.811711 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805889 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 20:11:30.811711 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805892 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 20:11:30.811711 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805895 2554 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 20:11:30.811711 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805897 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 20:11:30.811711 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805900 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 20:11:30.811711 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805904 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 20:11:30.811711 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805907 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 20:11:30.811711 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805910 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 20:11:30.812160 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805912 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 20:11:30.812160 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805915 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 20:11:30.812160 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805917 2554 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 20:11:30.812160 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805920 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 20:11:30.812160 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805922 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 20:11:30.812160 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805925 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 20:11:30.812160 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805927 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 20:11:30.812160 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805930 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 20:11:30.812160 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805936 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 20:11:30.812160 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805938 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 20:11:30.812160 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805941 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 20:11:30.812160 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805943 2554 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 20:11:30.812160 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805946 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 20:11:30.812160 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805949 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 20:11:30.812160 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805952 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 20:11:30.812160 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805954 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 20:11:30.812160 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805957 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 20:11:30.812160 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805959 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 20:11:30.812160 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805962 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 20:11:30.812160 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805965 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 20:11:30.812707 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805967 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 20:11:30.812707 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805970 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 20:11:30.812707 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805972 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 20:11:30.812707 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805975 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 20:11:30.812707 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805977 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 20:11:30.812707 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805980 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 20:11:30.812707 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805983 2554 feature_gate.go:328] unrecognized feature gate: Example May 27 20:11:30.812707 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805985 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 20:11:30.812707 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805988 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 20:11:30.812707 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805992 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 20:11:30.812707 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805995 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 20:11:30.812707 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.805998 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 20:11:30.812707 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806000 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 20:11:30.812707 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806003 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 20:11:30.812707 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806005 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 20:11:30.812707 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806008 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 20:11:30.812707 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806011 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 20:11:30.812707 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806014 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 20:11:30.812707 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806016 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 20:11:30.813163 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806019 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 20:11:30.813163 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806022 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 20:11:30.813163 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806025 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 20:11:30.813163 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806027 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 20:11:30.813163 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806030 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 20:11:30.813163 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806032 2554 feature_gate.go:328] unrecognized feature gate: Example2 May 27 20:11:30.813163 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806035 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 20:11:30.813163 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806038 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 20:11:30.813163 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806041 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 20:11:30.813163 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806043 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 20:11:30.813163 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806045 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 20:11:30.813163 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806048 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 20:11:30.813163 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806051 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 20:11:30.813163 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806053 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 20:11:30.813163 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806056 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 20:11:30.813163 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806059 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 20:11:30.813163 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806061 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 20:11:30.813163 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806064 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 20:11:30.813163 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806066 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 20:11:30.813163 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806075 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 20:11:30.813665 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806078 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 20:11:30.813665 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806080 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 20:11:30.813665 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806084 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 20:11:30.813665 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806086 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 20:11:30.813665 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806089 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 20:11:30.813665 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806091 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 20:11:30.813665 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.806093 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 20:11:30.813665 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.807037 2554 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 20:11:30.813889 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.813870 2554 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 27 20:11:30.813921 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.813889 2554 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 27 20:11:30.813953 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.813950 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 20:11:30.813985 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.813955 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 20:11:30.813985 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.813958 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 20:11:30.813985 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.813961 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 20:11:30.813985 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.813964 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 20:11:30.813985 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.813967 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 20:11:30.813985 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.813970 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 20:11:30.813985 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.813973 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 20:11:30.813985 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.813975 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 20:11:30.813985 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.813978 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 20:11:30.813985 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.813980 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 20:11:30.813985 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.813983 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 20:11:30.813985 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.813986 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 20:11:30.813985 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.813989 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 20:11:30.814294 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.813992 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 20:11:30.814294 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.813996 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 20:11:30.814294 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814000 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 20:11:30.814294 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814003 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 20:11:30.814294 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814006 2554 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 20:11:30.814294 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814008 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 20:11:30.814294 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814011 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 20:11:30.814294 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814015 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 20:11:30.814294 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814017 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 20:11:30.814294 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814020 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 20:11:30.814294 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814023 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 20:11:30.814294 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814026 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 20:11:30.814294 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814028 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 20:11:30.814294 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814031 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 20:11:30.814294 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814033 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 20:11:30.814294 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814036 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 20:11:30.814294 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814038 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 20:11:30.814294 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814041 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 20:11:30.814294 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814044 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 20:11:30.814808 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814046 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 20:11:30.814808 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814049 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 20:11:30.814808 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814051 2554 feature_gate.go:328] unrecognized feature gate: Example2 May 27 20:11:30.814808 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814054 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 20:11:30.814808 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814056 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 20:11:30.814808 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814059 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 20:11:30.814808 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814061 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 20:11:30.814808 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814064 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 20:11:30.814808 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814066 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 20:11:30.814808 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814069 2554 feature_gate.go:328] unrecognized feature gate: Example May 27 20:11:30.814808 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814072 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 20:11:30.814808 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814074 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 20:11:30.814808 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814078 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 20:11:30.814808 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814082 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 20:11:30.814808 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814086 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 20:11:30.814808 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814089 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 20:11:30.814808 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814092 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 20:11:30.814808 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814095 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 20:11:30.814808 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814098 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 20:11:30.814808 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814100 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 20:11:30.815290 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814103 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 20:11:30.815290 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814107 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 20:11:30.815290 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814109 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 20:11:30.815290 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814112 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 20:11:30.815290 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814115 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 20:11:30.815290 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814117 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 20:11:30.815290 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814120 2554 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 20:11:30.815290 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814122 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 20:11:30.815290 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814125 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 20:11:30.815290 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814127 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 20:11:30.815290 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814130 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 20:11:30.815290 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814133 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 20:11:30.815290 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814136 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 20:11:30.815290 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814138 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 20:11:30.815290 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814141 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 20:11:30.815290 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814143 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 20:11:30.815290 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814146 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 20:11:30.815290 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814148 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 20:11:30.815290 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814151 2554 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 20:11:30.815290 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814154 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 20:11:30.815799 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814156 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 20:11:30.815799 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814159 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 20:11:30.815799 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814161 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 20:11:30.815799 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814164 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 20:11:30.815799 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814167 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 20:11:30.815799 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814169 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 20:11:30.815799 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814173 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 20:11:30.815799 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814175 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 20:11:30.815799 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814178 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 20:11:30.815799 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814180 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 20:11:30.815799 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814183 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 20:11:30.815799 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814186 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 20:11:30.815799 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814188 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 20:11:30.815799 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.814193 2554 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 20:11:30.815799 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814298 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 20:11:30.816183 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814304 2554 feature_gate.go:328] unrecognized feature gate: Example2 May 27 20:11:30.816183 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814307 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 20:11:30.816183 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814311 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 20:11:30.816183 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814314 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 20:11:30.816183 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814316 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 20:11:30.816183 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814319 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 20:11:30.816183 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814321 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 20:11:30.816183 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814324 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 20:11:30.816183 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814326 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 20:11:30.816183 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814329 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 20:11:30.816183 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814331 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 20:11:30.816183 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814334 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 20:11:30.816183 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814336 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 20:11:30.816183 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814339 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 20:11:30.816183 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814341 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 20:11:30.816183 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814344 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 20:11:30.816183 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814346 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 20:11:30.816183 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814349 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 20:11:30.816183 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814351 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 20:11:30.816183 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814354 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 20:11:30.816789 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814357 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 20:11:30.816789 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814360 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 20:11:30.816789 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814362 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 20:11:30.816789 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814365 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 20:11:30.816789 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814368 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 20:11:30.816789 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814370 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 20:11:30.816789 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814373 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 20:11:30.816789 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814375 2554 feature_gate.go:328] unrecognized feature gate: Example May 27 20:11:30.816789 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814378 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 20:11:30.816789 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814380 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 20:11:30.816789 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814382 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 20:11:30.816789 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814385 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 20:11:30.816789 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814388 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 20:11:30.816789 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814392 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 20:11:30.816789 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814395 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 20:11:30.816789 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814398 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 20:11:30.816789 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814400 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 20:11:30.816789 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814403 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 20:11:30.816789 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814405 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 20:11:30.816789 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814407 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 20:11:30.817269 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814410 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 20:11:30.817269 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814414 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 20:11:30.817269 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814418 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 20:11:30.817269 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814421 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 20:11:30.817269 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814423 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 20:11:30.817269 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814426 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 20:11:30.817269 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814429 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 20:11:30.817269 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814431 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 20:11:30.817269 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814434 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 20:11:30.817269 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814436 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 20:11:30.817269 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814439 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 20:11:30.817269 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814442 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 20:11:30.817269 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814445 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 20:11:30.817269 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814448 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 20:11:30.817269 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814450 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 20:11:30.817269 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814453 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 20:11:30.817269 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814455 2554 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 20:11:30.817269 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814458 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 20:11:30.817269 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814460 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 20:11:30.817269 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814463 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 20:11:30.817763 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814465 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 20:11:30.817763 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814467 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 20:11:30.817763 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814470 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 20:11:30.817763 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814472 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 20:11:30.817763 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814475 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 20:11:30.817763 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814478 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 20:11:30.817763 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814480 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 20:11:30.817763 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814483 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 20:11:30.817763 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814485 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 20:11:30.817763 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814487 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 20:11:30.817763 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814490 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 20:11:30.817763 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814492 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 20:11:30.817763 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814495 2554 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 20:11:30.817763 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814497 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 20:11:30.817763 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814500 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 20:11:30.817763 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814502 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 20:11:30.817763 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814505 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 20:11:30.817763 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814507 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 20:11:30.817763 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814510 2554 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 20:11:30.817763 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814512 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 20:11:30.818231 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814515 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 20:11:30.818231 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814517 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 20:11:30.818231 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814520 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 20:11:30.818231 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814522 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 20:11:30.818231 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:30.814525 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 20:11:30.818231 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.814530 2554 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 20:11:30.818231 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.815289 2554 server.go:962] "Client rotation is on, will bootstrap in background" May 27 20:11:30.820793 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.820779 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 27 20:11:30.822089 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.822077 2554 server.go:1019] "Starting client certificate rotation" May 27 20:11:30.822198 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.822181 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 20:11:30.822226 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.822213 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 20:11:30.851155 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.851134 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 20:11:30.852875 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.852860 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 20:11:30.870175 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.870149 2554 log.go:25] "Validated CRI v1 runtime API" May 27 20:11:30.875880 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.875863 2554 log.go:25] "Validated CRI v1 image API" May 27 20:11:30.877140 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.877124 2554 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 27 20:11:30.882043 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.882022 2554 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 876aa098-6c11-49af-8cae-c39cc9141c45:/dev/nvme0n1p4 ec1b2a15-6055-46e1-aef7-93369948e837:/dev/nvme0n1p3] May 27 20:11:30.882103 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.882041 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 27 20:11:30.882364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.882349 2554 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 20:11:30.886681 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.886553 2554 manager.go:217] Machine: {Timestamp:2026-05-27 20:11:30.886052309 +0000 UTC m=+0.414120946 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099788 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec251b3d270f4c29cbd812f4ad9edc32 SystemUUID:ec251b3d-270f-4c29-cbd8-12f4ad9edc32 BootID:e2d741eb-4d07-4d9d-a44e-4e161431fb7b Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1b:7d:eb:14:79 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1b:7d:eb:14:79 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:91:22:1f:94:23 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 27 20:11:30.887856 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.887845 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 27 20:11:30.887965 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.887953 2554 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 27 20:11:30.889836 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.889813 2554 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 27 20:11:30.889997 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.889839 2554 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-103.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 27 20:11:30.890082 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.890012 2554 topology_manager.go:138] "Creating topology manager with none policy" May 27 20:11:30.890082 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.890023 2554 container_manager_linux.go:306] "Creating device plugin manager" May 27 20:11:30.890082 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.890033 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 20:11:30.890882 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.890870 2554 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 20:11:30.892883 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.892869 2554 state_mem.go:36] "Initialized new in-memory state store" May 27 20:11:30.893209 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.893195 2554 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 27 20:11:30.895715 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.895703 2554 kubelet.go:491] "Attempting to sync node with API server" May 27 20:11:30.895791 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.895722 2554 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 27 20:11:30.895791 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.895738 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 27 20:11:30.895791 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.895750 2554 kubelet.go:397] "Adding apiserver pod source" May 27 20:11:30.895791 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.895763 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 27 20:11:30.896855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.896841 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 20:11:30.896929 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.896864 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 20:11:30.899871 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.899852 2554 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 27 20:11:30.901901 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.901887 2554 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 27 20:11:30.903067 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.903055 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 27 20:11:30.903126 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.903071 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 27 20:11:30.903126 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.903077 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 27 20:11:30.903126 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.903083 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 27 20:11:30.903126 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.903091 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 27 20:11:30.903126 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.903096 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 27 20:11:30.903126 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.903102 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 27 20:11:30.903126 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.903109 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 27 20:11:30.903126 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.903115 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 27 20:11:30.903126 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.903121 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 27 20:11:30.903126 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.903130 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 27 20:11:30.903393 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.903385 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 27 20:11:30.903905 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.903888 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s25ff" May 27 20:11:30.904414 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.904404 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 27 20:11:30.904447 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.904415 2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 27 20:11:30.907795 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.907778 2554 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 27 20:11:30.907897 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.907812 2554 server.go:1295] "Started kubelet" May 27 20:11:30.909191 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.909162 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 27 20:11:30.909191 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:30.909174 2554 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-103.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 27 20:11:30.909354 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.909312 2554 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 27 20:11:30.909394 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.909384 2554 server_v1.go:47] "podresources" method="list" useActivePods=true May 27 20:11:30.909596 ip-10-0-135-103 systemd[1]: Started Kubernetes Kubelet. May 27 20:11:30.910784 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.910767 2554 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-103.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 27 20:11:30.910871 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:30.909243 2554 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 27 20:11:30.911086 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.911053 2554 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 27 20:11:30.912009 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.911988 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s25ff" May 27 20:11:30.916916 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.916054 2554 server.go:317] "Adding debug handlers to kubelet server" May 27 20:11:30.918432 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.918413 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 27 20:11:30.918515 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.918432 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 27 20:11:30.918515 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.918473 2554 volume_manager.go:295] "The desired_state_of_world populator starts" May 27 20:11:30.918515 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.918486 2554 volume_manager.go:297] "Starting Kubelet Volume Manager" May 27 20:11:30.918663 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:30.917785 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-103.ec2.internal.18b3852978c4ba89 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-103.ec2.internal,UID:ip-10-0-135-103.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-103.ec2.internal,},FirstTimestamp:2026-05-27 20:11:30.907789961 +0000 UTC m=+0.435858593,LastTimestamp:2026-05-27 20:11:30.907789961 +0000 UTC m=+0.435858593,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-103.ec2.internal,}" May 27 20:11:30.918663 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.918606 2554 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 27 20:11:30.918881 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.918677 2554 reconstruct.go:97] "Volume reconstruction finished" May 27 20:11:30.918881 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.918688 2554 reconciler.go:26] "Reconciler: start to sync state" May 27 20:11:30.919769 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.919752 2554 factory.go:153] Registering CRI-O factory May 27 20:11:30.919769 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.919769 2554 factory.go:223] Registration of the crio container factory successfully May 27 20:11:30.919895 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.919816 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 27 20:11:30.919895 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.919825 2554 factory.go:55] Registering systemd factory May 27 20:11:30.919895 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.919832 2554 factory.go:223] Registration of the systemd container factory successfully May 27 20:11:30.919895 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.919848 2554 factory.go:103] Registering Raw factory May 27 20:11:30.919895 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.919861 2554 manager.go:1196] Started watching for new ooms in manager May 27 20:11:30.920257 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.920244 2554 manager.go:319] Starting recovery of all containers May 27 20:11:30.921445 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:30.921413 2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found" May 27 20:11:30.922571 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:30.922549 2554 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 27 20:11:30.925650 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.925457 2554 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 20:11:30.927481 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:30.927464 2554 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-103.ec2.internal\" not found" node="ip-10-0-135-103.ec2.internal" May 27 20:11:30.930041 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.930026 2554 manager.go:324] Recovery completed May 27 20:11:30.934230 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.934219 2554 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 20:11:30.936104 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.936089 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientMemory" May 27 20:11:30.936174 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.936115 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasNoDiskPressure" May 27 20:11:30.936174 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.936128 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientPID" May 27 20:11:30.936535 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.936521 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" May 27 20:11:30.936535 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.936533 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 27 20:11:30.936644 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.936551 2554 state_mem.go:36] "Initialized new in-memory state store" May 27 20:11:30.939905 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.939887 2554 policy_none.go:49] "None policy: Start" May 27 20:11:30.939905 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.939903 2554 memory_manager.go:186] "Starting memorymanager" policy="None" May 27 20:11:30.939982 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.939914 2554 state_mem.go:35] "Initializing new in-memory state store" May 27 20:11:30.990317 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.986148 2554 manager.go:341] "Starting Device Plugin manager" May 27 20:11:30.990317 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:30.986182 2554 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 27 20:11:30.990317 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.986191 2554 server.go:85] "Starting device plugin registration server" May 27 20:11:30.990317 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.986405 2554 eviction_manager.go:189] "Eviction manager: starting control loop" May 27 20:11:30.990317 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.986415 2554 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 27 20:11:30.990317 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.986511 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 27 20:11:30.990317 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.986577 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 27 20:11:30.990317 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:30.986585 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 27 20:11:30.990317 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:30.987101 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 27 20:11:30.990317 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:30.987153 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-103.ec2.internal\" not found" May 27 20:11:31.048577 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.048547 2554 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 27 20:11:31.049710 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.049672 2554 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 27 20:11:31.049710 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.049699 2554 status_manager.go:230] "Starting to sync pod status with apiserver" May 27 20:11:31.049802 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.049722 2554 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 27 20:11:31.049802 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.049733 2554 kubelet.go:2451] "Starting kubelet main sync loop" May 27 20:11:31.049802 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:31.049778 2554 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 27 20:11:31.053563 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.053543 2554 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 20:11:31.087339 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.087313 2554 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 20:11:31.088217 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.088203 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientMemory" May 27 20:11:31.088294 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.088230 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasNoDiskPressure" May 27 20:11:31.088294 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.088241 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientPID" May 27 20:11:31.088294 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.088269 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-103.ec2.internal" May 27 20:11:31.096297 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.096283 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-103.ec2.internal" May 27 20:11:31.096342 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:31.096304 2554 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-103.ec2.internal\": node \"ip-10-0-135-103.ec2.internal\" not found" May 27 20:11:31.110972 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:31.110950 2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found" May 27 20:11:31.150713 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.150684 2554 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-103.ec2.internal"] May 27 20:11:31.150809 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.150755 2554 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 20:11:31.152385 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.152371 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientMemory" May 27 20:11:31.152454 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.152407 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasNoDiskPressure" May 27 20:11:31.152454 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.152419 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientPID" May 27 20:11:31.154511 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.154498 2554 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 20:11:31.154681 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.154667 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal" May 27 20:11:31.154765 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.154700 2554 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 20:11:31.155239 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.155221 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientMemory" May 27 20:11:31.155322 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.155238 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientMemory" May 27 20:11:31.155322 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.155249 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasNoDiskPressure" May 27 20:11:31.155322 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.155258 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientPID" May 27 20:11:31.155322 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.155262 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasNoDiskPressure" May 27 20:11:31.155322 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.155277 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientPID" May 27 20:11:31.156555 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.156540 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-103.ec2.internal" May 27 20:11:31.156648 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.156570 2554 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 20:11:31.157218 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.157199 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientMemory" May 27 20:11:31.157318 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.157229 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasNoDiskPressure" May 27 20:11:31.157318 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.157242 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientPID" May 27 20:11:31.177259 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:31.177239 2554 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-103.ec2.internal\" not found" node="ip-10-0-135-103.ec2.internal" May 27 20:11:31.181659 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:31.181642 2554 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-103.ec2.internal\" not found" node="ip-10-0-135-103.ec2.internal" May 27 20:11:31.211588 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:31.211568 2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found" May 27 20:11:31.220940 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.220922 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d8b0c93f69930a962fcb9912400f9315-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal\" (UID: \"d8b0c93f69930a962fcb9912400f9315\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal" May 27 20:11:31.220992 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.220947 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8b0c93f69930a962fcb9912400f9315-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal\" (UID: \"d8b0c93f69930a962fcb9912400f9315\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal" May 27 20:11:31.220992 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.220964 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/06181dfa378829b92cc5ea772451a452-config\") pod \"kube-apiserver-proxy-ip-10-0-135-103.ec2.internal\" (UID: \"06181dfa378829b92cc5ea772451a452\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-103.ec2.internal" May 27 20:11:31.311870 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:31.311818 2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found" May 27 20:11:31.321099 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.321078 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d8b0c93f69930a962fcb9912400f9315-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal\" (UID: \"d8b0c93f69930a962fcb9912400f9315\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal" May 27 20:11:31.321154 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.321106 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8b0c93f69930a962fcb9912400f9315-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal\" (UID: \"d8b0c93f69930a962fcb9912400f9315\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal" May 27 20:11:31.321154 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.321122 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/06181dfa378829b92cc5ea772451a452-config\") pod \"kube-apiserver-proxy-ip-10-0-135-103.ec2.internal\" (UID: \"06181dfa378829b92cc5ea772451a452\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-103.ec2.internal" May 27 20:11:31.321226 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.321158 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/06181dfa378829b92cc5ea772451a452-config\") pod \"kube-apiserver-proxy-ip-10-0-135-103.ec2.internal\" (UID: \"06181dfa378829b92cc5ea772451a452\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-103.ec2.internal" May 27 20:11:31.321226 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.321187 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d8b0c93f69930a962fcb9912400f9315-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal\" (UID: \"d8b0c93f69930a962fcb9912400f9315\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal" May 27 20:11:31.321226 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.321187 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8b0c93f69930a962fcb9912400f9315-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal\" (UID: \"d8b0c93f69930a962fcb9912400f9315\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal" May 27 20:11:31.412457 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:31.412421 2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found" May 27 20:11:31.480911 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.480885 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal" May 27 20:11:31.484668 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.484653 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-103.ec2.internal" May 27 20:11:31.512668 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:31.512643 2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found" May 27 20:11:31.613211 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:31.613132 2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found" May 27 20:11:31.713636 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:31.713593 2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found" May 27 20:11:31.814091 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:31.814058 2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found" May 27 20:11:31.822344 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.822322 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 27 20:11:31.822477 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.822463 2554 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 20:11:31.822520 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.822488 2554 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 20:11:31.914455 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:31.914429 2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found" May 27 20:11:31.916825 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.916802 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-26 20:06:30 +0000 UTC" deadline="2028-02-21 12:48:11.207911306 +0000 UTC" May 27 20:11:31.916896 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.916824 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15232h36m39.291089509s" May 27 20:11:31.919303 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.919286 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 27 20:11:31.932595 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.932562 2554 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 20:11:31.958106 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.958078 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xn9hv" May 27 20:11:31.965588 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:31.965572 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xn9hv" May 27 20:11:32.000895 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:32.000858 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b0c93f69930a962fcb9912400f9315.slice/crio-54b115143fe8f30023a4268cdddf8dfb9319770d8b07c0d5da87625e9a680120 WatchSource:0}: Error finding container 54b115143fe8f30023a4268cdddf8dfb9319770d8b07c0d5da87625e9a680120: Status 404 returned error can't find the container with id 54b115143fe8f30023a4268cdddf8dfb9319770d8b07c0d5da87625e9a680120 May 27 20:11:32.001112 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:32.001092 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06181dfa378829b92cc5ea772451a452.slice/crio-09aa86382b94ff743f849f96432ad12c7dcb68fb0a92090565899eef29e75b77 WatchSource:0}: Error finding container 09aa86382b94ff743f849f96432ad12c7dcb68fb0a92090565899eef29e75b77: Status 404 returned error can't find the container with id 09aa86382b94ff743f849f96432ad12c7dcb68fb0a92090565899eef29e75b77 May 27 20:11:32.005122 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.005069 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 20:11:32.014495 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:32.014477 2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found" May 27 20:11:32.052916 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.052877 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-103.ec2.internal" event={"ID":"06181dfa378829b92cc5ea772451a452","Type":"ContainerStarted","Data":"09aa86382b94ff743f849f96432ad12c7dcb68fb0a92090565899eef29e75b77"} May 27 20:11:32.053812 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.053794 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal" event={"ID":"d8b0c93f69930a962fcb9912400f9315","Type":"ContainerStarted","Data":"54b115143fe8f30023a4268cdddf8dfb9319770d8b07c0d5da87625e9a680120"} May 27 20:11:32.115000 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:32.114976 2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found" May 27 20:11:32.215448 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:32.215376 2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found" May 27 20:11:32.315884 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:32.315852 2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found" May 27 20:11:32.387568 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.387534 2554 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 27 20:11:32.418698 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.418668 2554 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal" May 27 20:11:32.431574 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.431551 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 20:11:32.433607 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.433581 2554 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-103.ec2.internal" May 27 20:11:32.441648 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.441613 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 20:11:32.465435 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.465409 2554 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 27 20:11:32.728342 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.728312 2554 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 20:11:32.787838 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.787806 2554 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 20:11:32.896905 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.896873 2554 apiserver.go:52] "Watching apiserver" May 27 20:11:32.902264 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.902242 2554 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 27 20:11:32.905580 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.905550 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-103.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j","openshift-cluster-node-tuning-operator/tuned-whz8c","openshift-dns/node-resolver-57cz2","openshift-image-registry/node-ca-w86br","openshift-multus/network-metrics-daemon-5jv8k","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal","openshift-multus/multus-additional-cni-plugins-69bpk","openshift-multus/multus-mgcm2","openshift-network-diagnostics/network-check-target-hm2h8","openshift-network-operator/iptables-alerter-fdssp","openshift-ovn-kubernetes/ovnkube-node-sbcv5","kube-system/konnectivity-agent-l7zcw"] May 27 20:11:32.907568 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.907551 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:11:32.907678 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:32.907654 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm2h8" podUID="d572187c-753d-447a-8232-d89446920689" May 27 20:11:32.909203 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.909177 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" May 27 20:11:32.910553 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.910534 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:32.911369 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.911309 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 27 20:11:32.911369 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.911322 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 27 20:11:32.911523 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.911476 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 27 20:11:32.911523 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.911493 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8rlzw\"" May 27 20:11:32.911993 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.911972 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-57cz2" May 27 20:11:32.912749 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.912611 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 27 20:11:32.912749 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.912669 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 27 20:11:32.912896 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.912774 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jt48q\"" May 27 20:11:32.913678 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.913617 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w86br" May 27 20:11:32.913871 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.913852 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 27 20:11:32.914090 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.914054 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 27 20:11:32.914176 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.914096 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mxmgh\"" May 27 20:11:32.915054 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.915035 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:32.915135 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:32.915118 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jv8k" podUID="a51bfffe-2896-4ffe-84b0-23a5b5127cdd" May 27 20:11:32.915462 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.915441 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 27 20:11:32.915548 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.915484 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 27 20:11:32.916036 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.915956 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 27 20:11:32.916036 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.915973 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zrv2b\"" May 27 20:11:32.916300 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.916286 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:32.917375 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.917355 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mgcm2" May 27 20:11:32.918398 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.918379 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 27 20:11:32.918689 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.918668 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fdssp" May 27 20:11:32.918689 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.918686 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 27 20:11:32.919129 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.919113 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4nm2p\"" May 27 20:11:32.919193 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.919155 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 27 20:11:32.919491 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.919388 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 27 20:11:32.919491 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.919407 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 27 20:11:32.919755 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.919714 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jzs29\"" May 27 20:11:32.919835 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.919738 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 27 20:11:32.920495 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.920472 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 27 20:11:32.920774 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.920734 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:32.920862 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.920839 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 27 20:11:32.921200 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.921098 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kmqbn\"" May 27 20:11:32.921791 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.921774 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 27 20:11:32.921902 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.921882 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l7zcw" May 27 20:11:32.922882 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.922614 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 27 20:11:32.923001 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.922885 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 27 20:11:32.923001 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.922985 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 27 20:11:32.923779 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.923465 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 27 20:11:32.923779 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.923527 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-86w4z\"" May 27 20:11:32.923779 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.923760 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 27 20:11:32.923962 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.923857 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 27 20:11:32.924126 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.924104 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 27 20:11:32.924260 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.924244 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p949f\"" May 27 20:11:32.924398 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.924383 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 27 20:11:32.929167 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929143 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-run-systemd\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:32.929272 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929184 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thhfw\" (UniqueName: \"kubernetes.io/projected/0e6cae6b-bb5a-44a0-b929-68b455a68a96-kube-api-access-thhfw\") pod \"node-ca-w86br\" (UID: \"0e6cae6b-bb5a-44a0-b929-68b455a68a96\") " pod="openshift-image-registry/node-ca-w86br" May 27 20:11:32.929272 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929214 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-system-cni-dir\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:32.929272 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929239 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-host-kubelet\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:32.929272 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929265 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd676956-4f28-460e-bbf5-3d1502663715-ovn-node-metrics-cert\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:32.929466 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929287 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-etc-sysctl-conf\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:32.929466 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929308 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-host-run-multus-certs\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:32.929466 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929330 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-node-log\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:32.929466 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929372 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-etc-sysconfig\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:32.929466 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929413 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5z4x\" (UniqueName: \"kubernetes.io/projected/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-kube-api-access-t5z4x\") pod \"network-metrics-daemon-5jv8k\" (UID: \"a51bfffe-2896-4ffe-84b0-23a5b5127cdd\") " pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:32.929466 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929442 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/99458291-9c93-4139-9ac4-008f6d1edfb7-cni-binary-copy\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:32.929759 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929492 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-run-openvswitch\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:32.929759 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929527 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-host-cni-bin\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:32.929759 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929578 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cd676956-4f28-460e-bbf5-3d1502663715-env-overrides\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:32.929759 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929611 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6b3d222a-0650-477d-82ac-95564e317e69-socket-dir\") pod \"aws-ebs-csi-driver-node-g9b2j\" (UID: \"6b3d222a-0650-477d-82ac-95564e317e69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" May 27 20:11:32.929759 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929652 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-etc-sysctl-d\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:32.929759 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929678 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-var-lib-kubelet\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:32.929759 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929700 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-host-run-netns\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:32.929759 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929724 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-host-var-lib-cni-multus\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:32.929759 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929750 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c22jn\" (UniqueName: \"kubernetes.io/projected/d4d137f7-70a2-4bbb-bf8a-4ec43c9a3ebd-kube-api-access-c22jn\") pod \"iptables-alerter-fdssp\" (UID: \"d4d137f7-70a2-4bbb-bf8a-4ec43c9a3ebd\") " pod="openshift-network-operator/iptables-alerter-fdssp" May 27 20:11:32.930103 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929774 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqdft\" (UniqueName: \"kubernetes.io/projected/d572187c-753d-447a-8232-d89446920689-kube-api-access-mqdft\") pod \"network-check-target-hm2h8\" (UID: \"d572187c-753d-447a-8232-d89446920689\") " pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:11:32.930103 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929796 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-run\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:32.930103 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929819 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-sys\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:32.930103 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929856 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-multus-conf-dir\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:32.930103 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929891 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4d137f7-70a2-4bbb-bf8a-4ec43c9a3ebd-iptables-alerter-script\") pod \"iptables-alerter-fdssp\" (UID: \"d4d137f7-70a2-4bbb-bf8a-4ec43c9a3ebd\") " pod="openshift-network-operator/iptables-alerter-fdssp" May 27 20:11:32.930103 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929916 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4d137f7-70a2-4bbb-bf8a-4ec43c9a3ebd-host-slash\") pod \"iptables-alerter-fdssp\" (UID: \"d4d137f7-70a2-4bbb-bf8a-4ec43c9a3ebd\") " pod="openshift-network-operator/iptables-alerter-fdssp" May 27 20:11:32.930103 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929934 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/19db3f5a-b350-4f80-960d-073d72ca4e4b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-69bpk\" (UID: \"19db3f5a-b350-4f80-960d-073d72ca4e4b\") " pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:32.930103 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929952 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-etc-modprobe-d\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:32.930103 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929975 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/99458291-9c93-4139-9ac4-008f6d1edfb7-multus-daemon-config\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:32.930103 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.929992 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtst4\" (UniqueName: \"kubernetes.io/projected/19db3f5a-b350-4f80-960d-073d72ca4e4b-kube-api-access-xtst4\") pod \"multus-additional-cni-plugins-69bpk\" (UID: \"19db3f5a-b350-4f80-960d-073d72ca4e4b\") " pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:32.930103 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930009 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zblwn\" (UniqueName: \"kubernetes.io/projected/cd676956-4f28-460e-bbf5-3d1502663715-kube-api-access-zblwn\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:32.930103 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930041 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6b3d222a-0650-477d-82ac-95564e317e69-etc-selinux\") pod \"aws-ebs-csi-driver-node-g9b2j\" (UID: \"6b3d222a-0650-477d-82ac-95564e317e69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" May 27 20:11:32.930103 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930063 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4def15c9-ddcd-4d42-a061-ef4f279c7f63-hosts-file\") pod \"node-resolver-57cz2\" (UID: \"4def15c9-ddcd-4d42-a061-ef4f279c7f63\") " pod="openshift-dns/node-resolver-57cz2" May 27 20:11:32.930103 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930087 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e6cae6b-bb5a-44a0-b929-68b455a68a96-serviceca\") pod \"node-ca-w86br\" (UID: \"0e6cae6b-bb5a-44a0-b929-68b455a68a96\") " pod="openshift-image-registry/node-ca-w86br" May 27 20:11:32.930103 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930103 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19db3f5a-b350-4f80-960d-073d72ca4e4b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-69bpk\" (UID: \"19db3f5a-b350-4f80-960d-073d72ca4e4b\") " pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:32.930727 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930125 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-etc-systemd\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:32.930727 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930145 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqgf4\" (UniqueName: \"kubernetes.io/projected/4def15c9-ddcd-4d42-a061-ef4f279c7f63-kube-api-access-wqgf4\") pod \"node-resolver-57cz2\" (UID: \"4def15c9-ddcd-4d42-a061-ef4f279c7f63\") " pod="openshift-dns/node-resolver-57cz2" May 27 20:11:32.930727 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930164 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-host-slash\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:32.930727 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930179 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-log-socket\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:32.930727 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930208 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:32.930727 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930234 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/19db3f5a-b350-4f80-960d-073d72ca4e4b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-69bpk\" (UID: \"19db3f5a-b350-4f80-960d-073d72ca4e4b\") " pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:32.930727 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930270 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6b3d222a-0650-477d-82ac-95564e317e69-device-dir\") pod \"aws-ebs-csi-driver-node-g9b2j\" (UID: \"6b3d222a-0650-477d-82ac-95564e317e69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" May 27 20:11:32.930727 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930302 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6b3d222a-0650-477d-82ac-95564e317e69-sys-fs\") pod \"aws-ebs-csi-driver-node-g9b2j\" (UID: \"6b3d222a-0650-477d-82ac-95564e317e69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" May 27 20:11:32.930727 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930325 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grpdv\" (UniqueName: \"kubernetes.io/projected/6b3d222a-0650-477d-82ac-95564e317e69-kube-api-access-grpdv\") pod \"aws-ebs-csi-driver-node-g9b2j\" (UID: \"6b3d222a-0650-477d-82ac-95564e317e69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" May 27 20:11:32.930727 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930339 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-lib-modules\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:32.930727 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930353 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-metrics-certs\") pod \"network-metrics-daemon-5jv8k\" (UID: \"a51bfffe-2896-4ffe-84b0-23a5b5127cdd\") " pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:32.930727 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930369 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19db3f5a-b350-4f80-960d-073d72ca4e4b-system-cni-dir\") pod \"multus-additional-cni-plugins-69bpk\" (UID: \"19db3f5a-b350-4f80-960d-073d72ca4e4b\") " pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:32.930727 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930383 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-systemd-units\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:32.930727 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930405 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-host-cni-netd\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:32.930727 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930428 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6b3d222a-0650-477d-82ac-95564e317e69-registration-dir\") pod \"aws-ebs-csi-driver-node-g9b2j\" (UID: \"6b3d222a-0650-477d-82ac-95564e317e69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" May 27 20:11:32.930727 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930452 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-etc-kubernetes\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:32.931430 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930470 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/278e5fd7-5304-49ae-a572-0d64b2a7f995-etc-tuned\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:32.931430 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930578 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-etc-kubernetes\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:32.931430 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930642 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgstb\" (UniqueName: \"kubernetes.io/projected/99458291-9c93-4139-9ac4-008f6d1edfb7-kube-api-access-xgstb\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:32.931430 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930687 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-run-ovn\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:32.931430 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930727 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e6cae6b-bb5a-44a0-b929-68b455a68a96-host\") pod \"node-ca-w86br\" (UID: \"0e6cae6b-bb5a-44a0-b929-68b455a68a96\") " pod="openshift-image-registry/node-ca-w86br" May 27 20:11:32.931430 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930752 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-host-run-k8s-cni-cncf-io\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:32.931430 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930778 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-host-var-lib-kubelet\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:32.931430 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930814 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19db3f5a-b350-4f80-960d-073d72ca4e4b-cnibin\") pod \"multus-additional-cni-plugins-69bpk\" (UID: \"19db3f5a-b350-4f80-960d-073d72ca4e4b\") " pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:32.931430 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930854 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19db3f5a-b350-4f80-960d-073d72ca4e4b-cni-binary-copy\") pod \"multus-additional-cni-plugins-69bpk\" (UID: \"19db3f5a-b350-4f80-960d-073d72ca4e4b\") " pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:32.931430 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930881 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-multus-cni-dir\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:32.931430 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930924 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-hostroot\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:32.931430 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930965 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-host-run-netns\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:32.931430 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.930986 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-etc-openvswitch\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:32.931430 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.931006 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cd676956-4f28-460e-bbf5-3d1502663715-ovnkube-config\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:32.931430 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.931021 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/278e5fd7-5304-49ae-a572-0d64b2a7f995-tmp\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:32.931430 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.931042 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lx6n\" (UniqueName: \"kubernetes.io/projected/278e5fd7-5304-49ae-a572-0d64b2a7f995-kube-api-access-7lx6n\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:32.931430 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.931082 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-cnibin\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:32.931967 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.931124 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19db3f5a-b350-4f80-960d-073d72ca4e4b-os-release\") pod \"multus-additional-cni-plugins-69bpk\" (UID: \"19db3f5a-b350-4f80-960d-073d72ca4e4b\") " pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:32.931967 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.931152 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cd676956-4f28-460e-bbf5-3d1502663715-ovnkube-script-lib\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:32.931967 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.931178 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4def15c9-ddcd-4d42-a061-ef4f279c7f63-tmp-dir\") pod \"node-resolver-57cz2\" (UID: \"4def15c9-ddcd-4d42-a061-ef4f279c7f63\") " pod="openshift-dns/node-resolver-57cz2" May 27 20:11:32.931967 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.931204 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-multus-socket-dir-parent\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:32.931967 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.931228 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-host-var-lib-cni-bin\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:32.931967 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.931252 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-var-lib-openvswitch\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:32.931967 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.931293 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-host-run-ovn-kubernetes\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:32.931967 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.931317 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6b3d222a-0650-477d-82ac-95564e317e69-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g9b2j\" (UID: \"6b3d222a-0650-477d-82ac-95564e317e69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" May 27 20:11:32.931967 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.931341 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-host\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:32.931967 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.931365 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-os-release\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:32.966163 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.966137 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 20:06:31 +0000 UTC" deadline="2028-01-29 00:05:50.842010075 +0000 UTC" May 27 20:11:32.966233 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:32.966166 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14667h54m17.875848037s" May 27 20:11:33.020359 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.020294 2554 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 27 20:11:33.032260 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032235 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/99458291-9c93-4139-9ac4-008f6d1edfb7-multus-daemon-config\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.032404 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032271 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xtst4\" (UniqueName: \"kubernetes.io/projected/19db3f5a-b350-4f80-960d-073d72ca4e4b-kube-api-access-xtst4\") pod \"multus-additional-cni-plugins-69bpk\" (UID: \"19db3f5a-b350-4f80-960d-073d72ca4e4b\") " pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:33.032404 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032298 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zblwn\" (UniqueName: \"kubernetes.io/projected/cd676956-4f28-460e-bbf5-3d1502663715-kube-api-access-zblwn\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.032404 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032321 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6b3d222a-0650-477d-82ac-95564e317e69-etc-selinux\") pod \"aws-ebs-csi-driver-node-g9b2j\" (UID: \"6b3d222a-0650-477d-82ac-95564e317e69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" May 27 20:11:33.032404 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032345 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4def15c9-ddcd-4d42-a061-ef4f279c7f63-hosts-file\") pod \"node-resolver-57cz2\" (UID: \"4def15c9-ddcd-4d42-a061-ef4f279c7f63\") " pod="openshift-dns/node-resolver-57cz2" May 27 20:11:33.032404 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032369 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e6cae6b-bb5a-44a0-b929-68b455a68a96-serviceca\") pod \"node-ca-w86br\" (UID: \"0e6cae6b-bb5a-44a0-b929-68b455a68a96\") " pod="openshift-image-registry/node-ca-w86br" May 27 20:11:33.032404 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032395 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19db3f5a-b350-4f80-960d-073d72ca4e4b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-69bpk\" (UID: \"19db3f5a-b350-4f80-960d-073d72ca4e4b\") " pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:33.032604 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032448 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-etc-systemd\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.032604 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032492 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wqgf4\" (UniqueName: \"kubernetes.io/projected/4def15c9-ddcd-4d42-a061-ef4f279c7f63-kube-api-access-wqgf4\") pod \"node-resolver-57cz2\" (UID: \"4def15c9-ddcd-4d42-a061-ef4f279c7f63\") " pod="openshift-dns/node-resolver-57cz2" May 27 20:11:33.032604 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032520 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-host-slash\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.032604 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032544 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-log-socket\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.032604 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032549 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19db3f5a-b350-4f80-960d-073d72ca4e4b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-69bpk\" (UID: \"19db3f5a-b350-4f80-960d-073d72ca4e4b\") " pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:33.032604 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032569 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.032803 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032609 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87ac1929-612e-48ec-94ff-0e13017fea11-agent-certs\") pod \"konnectivity-agent-l7zcw\" (UID: \"87ac1929-612e-48ec-94ff-0e13017fea11\") " pod="kube-system/konnectivity-agent-l7zcw" May 27 20:11:33.032803 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032611 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6b3d222a-0650-477d-82ac-95564e317e69-etc-selinux\") pod \"aws-ebs-csi-driver-node-g9b2j\" (UID: \"6b3d222a-0650-477d-82ac-95564e317e69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" May 27 20:11:33.032803 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032637 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4def15c9-ddcd-4d42-a061-ef4f279c7f63-hosts-file\") pod \"node-resolver-57cz2\" (UID: \"4def15c9-ddcd-4d42-a061-ef4f279c7f63\") " pod="openshift-dns/node-resolver-57cz2" May 27 20:11:33.032803 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032669 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/19db3f5a-b350-4f80-960d-073d72ca4e4b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-69bpk\" (UID: \"19db3f5a-b350-4f80-960d-073d72ca4e4b\") " pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:33.032803 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032690 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-host-slash\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.032803 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032700 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6b3d222a-0650-477d-82ac-95564e317e69-device-dir\") pod \"aws-ebs-csi-driver-node-g9b2j\" (UID: \"6b3d222a-0650-477d-82ac-95564e317e69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" May 27 20:11:33.032803 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032698 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.032803 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032735 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-etc-systemd\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.032803 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032765 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6b3d222a-0650-477d-82ac-95564e317e69-device-dir\") pod \"aws-ebs-csi-driver-node-g9b2j\" (UID: \"6b3d222a-0650-477d-82ac-95564e317e69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" May 27 20:11:33.032803 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032770 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-log-socket\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.032803 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032794 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6b3d222a-0650-477d-82ac-95564e317e69-sys-fs\") pod \"aws-ebs-csi-driver-node-g9b2j\" (UID: \"6b3d222a-0650-477d-82ac-95564e317e69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" May 27 20:11:33.033244 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032820 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-grpdv\" (UniqueName: \"kubernetes.io/projected/6b3d222a-0650-477d-82ac-95564e317e69-kube-api-access-grpdv\") pod \"aws-ebs-csi-driver-node-g9b2j\" (UID: \"6b3d222a-0650-477d-82ac-95564e317e69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" May 27 20:11:33.033244 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032850 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-lib-modules\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.033244 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032875 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-metrics-certs\") pod \"network-metrics-daemon-5jv8k\" (UID: \"a51bfffe-2896-4ffe-84b0-23a5b5127cdd\") " pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:33.033244 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032890 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6b3d222a-0650-477d-82ac-95564e317e69-sys-fs\") pod \"aws-ebs-csi-driver-node-g9b2j\" (UID: \"6b3d222a-0650-477d-82ac-95564e317e69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" May 27 20:11:33.033244 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032900 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19db3f5a-b350-4f80-960d-073d72ca4e4b-system-cni-dir\") pod \"multus-additional-cni-plugins-69bpk\" (UID: \"19db3f5a-b350-4f80-960d-073d72ca4e4b\") " pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:33.033244 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032895 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e6cae6b-bb5a-44a0-b929-68b455a68a96-serviceca\") pod \"node-ca-w86br\" (UID: \"0e6cae6b-bb5a-44a0-b929-68b455a68a96\") " pod="openshift-image-registry/node-ca-w86br" May 27 20:11:33.033244 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032937 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-systemd-units\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.033244 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032950 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19db3f5a-b350-4f80-960d-073d72ca4e4b-system-cni-dir\") pod \"multus-additional-cni-plugins-69bpk\" (UID: \"19db3f5a-b350-4f80-960d-073d72ca4e4b\") " pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:33.033244 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032960 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/99458291-9c93-4139-9ac4-008f6d1edfb7-multus-daemon-config\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.033244 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.032973 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-host-cni-netd\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.033244 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.033000 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6b3d222a-0650-477d-82ac-95564e317e69-registration-dir\") pod \"aws-ebs-csi-driver-node-g9b2j\" (UID: \"6b3d222a-0650-477d-82ac-95564e317e69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" May 27 20:11:33.033244 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.033004 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-systemd-units\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.033244 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.033026 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-etc-kubernetes\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.033244 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.033054 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/278e5fd7-5304-49ae-a572-0d64b2a7f995-etc-tuned\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.033244 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.033056 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6b3d222a-0650-477d-82ac-95564e317e69-registration-dir\") pod \"aws-ebs-csi-driver-node-g9b2j\" (UID: \"6b3d222a-0650-477d-82ac-95564e317e69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" May 27 20:11:33.033244 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:33.033057 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 20:11:33.033244 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.033071 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-lib-modules\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.033244 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.033080 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-etc-kubernetes\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.034105 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.033072 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-etc-kubernetes\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.034105 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.033027 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-host-cni-netd\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.034105 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.033105 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xgstb\" (UniqueName: \"kubernetes.io/projected/99458291-9c93-4139-9ac4-008f6d1edfb7-kube-api-access-xgstb\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.034105 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:33.033143 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-metrics-certs podName:a51bfffe-2896-4ffe-84b0-23a5b5127cdd nodeName:}" failed. No retries permitted until 2026-05-27 20:11:33.533105207 +0000 UTC m=+3.061173846 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-metrics-certs") pod "network-metrics-daemon-5jv8k" (UID: "a51bfffe-2896-4ffe-84b0-23a5b5127cdd") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 20:11:33.034105 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.033165 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/19db3f5a-b350-4f80-960d-073d72ca4e4b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-69bpk\" (UID: \"19db3f5a-b350-4f80-960d-073d72ca4e4b\") " pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:33.034105 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.033140 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-etc-kubernetes\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.034105 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.033355 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 27 20:11:33.034105 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.033819 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87ac1929-612e-48ec-94ff-0e13017fea11-konnectivity-ca\") pod \"konnectivity-agent-l7zcw\" (UID: \"87ac1929-612e-48ec-94ff-0e13017fea11\") " pod="kube-system/konnectivity-agent-l7zcw" May 27 20:11:33.034105 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.033873 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-run-ovn\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.034105 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.033930 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-run-ovn\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.034105 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.033954 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e6cae6b-bb5a-44a0-b929-68b455a68a96-host\") pod \"node-ca-w86br\" (UID: \"0e6cae6b-bb5a-44a0-b929-68b455a68a96\") " pod="openshift-image-registry/node-ca-w86br" May 27 20:11:33.034105 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.033987 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-host-run-k8s-cni-cncf-io\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.034105 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034013 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-host-var-lib-kubelet\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.034105 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034040 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19db3f5a-b350-4f80-960d-073d72ca4e4b-cnibin\") pod \"multus-additional-cni-plugins-69bpk\" (UID: \"19db3f5a-b350-4f80-960d-073d72ca4e4b\") " pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:33.034105 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034041 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-host-run-k8s-cni-cncf-io\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.034105 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034068 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19db3f5a-b350-4f80-960d-073d72ca4e4b-cni-binary-copy\") pod \"multus-additional-cni-plugins-69bpk\" (UID: \"19db3f5a-b350-4f80-960d-073d72ca4e4b\") " pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:33.034105 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034093 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-multus-cni-dir\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.034906 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034094 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-host-var-lib-kubelet\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.034906 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.033989 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e6cae6b-bb5a-44a0-b929-68b455a68a96-host\") pod \"node-ca-w86br\" (UID: \"0e6cae6b-bb5a-44a0-b929-68b455a68a96\") " pod="openshift-image-registry/node-ca-w86br" May 27 20:11:33.034906 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034113 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-hostroot\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.034906 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034137 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-host-run-netns\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.034906 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034157 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-etc-openvswitch\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.034906 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034177 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cd676956-4f28-460e-bbf5-3d1502663715-ovnkube-config\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.034906 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034200 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/278e5fd7-5304-49ae-a572-0d64b2a7f995-tmp\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.034906 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034223 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7lx6n\" (UniqueName: \"kubernetes.io/projected/278e5fd7-5304-49ae-a572-0d64b2a7f995-kube-api-access-7lx6n\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.034906 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034237 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-cnibin\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.034906 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034256 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19db3f5a-b350-4f80-960d-073d72ca4e4b-os-release\") pod \"multus-additional-cni-plugins-69bpk\" (UID: \"19db3f5a-b350-4f80-960d-073d72ca4e4b\") " pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:33.034906 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034274 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cd676956-4f28-460e-bbf5-3d1502663715-ovnkube-script-lib\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.034906 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034290 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4def15c9-ddcd-4d42-a061-ef4f279c7f63-tmp-dir\") pod \"node-resolver-57cz2\" (UID: \"4def15c9-ddcd-4d42-a061-ef4f279c7f63\") " pod="openshift-dns/node-resolver-57cz2" May 27 20:11:33.034906 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034309 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-multus-socket-dir-parent\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.034906 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034335 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-host-var-lib-cni-bin\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.034906 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034362 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-var-lib-openvswitch\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.034906 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034387 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-host-run-ovn-kubernetes\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.034906 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034412 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6b3d222a-0650-477d-82ac-95564e317e69-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g9b2j\" (UID: \"6b3d222a-0650-477d-82ac-95564e317e69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" May 27 20:11:33.034906 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034435 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-host\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.035734 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034479 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-os-release\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.035734 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034486 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-cnibin\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.035734 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034505 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-run-systemd\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.035734 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034527 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19db3f5a-b350-4f80-960d-073d72ca4e4b-cni-binary-copy\") pod \"multus-additional-cni-plugins-69bpk\" (UID: \"19db3f5a-b350-4f80-960d-073d72ca4e4b\") " pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:33.035734 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034545 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thhfw\" (UniqueName: \"kubernetes.io/projected/0e6cae6b-bb5a-44a0-b929-68b455a68a96-kube-api-access-thhfw\") pod \"node-ca-w86br\" (UID: \"0e6cae6b-bb5a-44a0-b929-68b455a68a96\") " pod="openshift-image-registry/node-ca-w86br" May 27 20:11:33.035734 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034551 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-multus-cni-dir\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.035734 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034603 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-var-lib-openvswitch\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.035734 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034603 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-host-var-lib-cni-bin\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.035734 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034612 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-system-cni-dir\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.035734 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034648 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19db3f5a-b350-4f80-960d-073d72ca4e4b-os-release\") pod \"multus-additional-cni-plugins-69bpk\" (UID: \"19db3f5a-b350-4f80-960d-073d72ca4e4b\") " pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:33.035734 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034670 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-system-cni-dir\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.035734 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034681 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-os-release\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.035734 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034655 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-host\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.035734 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034670 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-host-kubelet\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.035734 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034715 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-run-systemd\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.035734 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034716 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-multus-socket-dir-parent\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.035734 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034731 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd676956-4f28-460e-bbf5-3d1502663715-ovn-node-metrics-cert\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.035734 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034762 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-etc-sysctl-conf\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.036557 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034798 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-host-run-multus-certs\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.036557 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034806 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-host-run-netns\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.036557 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034824 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-node-log\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.036557 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034826 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-host-run-ovn-kubernetes\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.036557 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034858 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-etc-sysconfig\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.036557 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034860 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6b3d222a-0650-477d-82ac-95564e317e69-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g9b2j\" (UID: \"6b3d222a-0650-477d-82ac-95564e317e69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" May 27 20:11:33.036557 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034870 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-host-kubelet\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.036557 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034886 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t5z4x\" (UniqueName: \"kubernetes.io/projected/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-kube-api-access-t5z4x\") pod \"network-metrics-daemon-5jv8k\" (UID: \"a51bfffe-2896-4ffe-84b0-23a5b5127cdd\") " pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:33.036557 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034900 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-etc-openvswitch\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.036557 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034912 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/99458291-9c93-4139-9ac4-008f6d1edfb7-cni-binary-copy\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.036557 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034922 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-node-log\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.036557 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034936 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-run-openvswitch\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.036557 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034943 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-host-run-multus-certs\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.036557 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034961 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-host-cni-bin\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.036557 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034967 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-etc-sysconfig\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.036557 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034902 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19db3f5a-b350-4f80-960d-073d72ca4e4b-cnibin\") pod \"multus-additional-cni-plugins-69bpk\" (UID: \"19db3f5a-b350-4f80-960d-073d72ca4e4b\") " pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:33.036557 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034985 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cd676956-4f28-460e-bbf5-3d1502663715-env-overrides\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.037364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035017 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6b3d222a-0650-477d-82ac-95564e317e69-socket-dir\") pod \"aws-ebs-csi-driver-node-g9b2j\" (UID: \"6b3d222a-0650-477d-82ac-95564e317e69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" May 27 20:11:33.037364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035029 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-etc-sysctl-conf\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.037364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035042 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-etc-sysctl-d\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.037364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035071 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-var-lib-kubelet\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.037364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035087 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-run-openvswitch\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.037364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035094 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-host-run-netns\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.037364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035129 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-host-run-netns\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.037364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035129 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-host-var-lib-cni-multus\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.037364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035142 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4def15c9-ddcd-4d42-a061-ef4f279c7f63-tmp-dir\") pod \"node-resolver-57cz2\" (UID: \"4def15c9-ddcd-4d42-a061-ef4f279c7f63\") " pod="openshift-dns/node-resolver-57cz2" May 27 20:11:33.037364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035164 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-host-var-lib-cni-multus\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.037364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035170 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c22jn\" (UniqueName: \"kubernetes.io/projected/d4d137f7-70a2-4bbb-bf8a-4ec43c9a3ebd-kube-api-access-c22jn\") pod \"iptables-alerter-fdssp\" (UID: \"d4d137f7-70a2-4bbb-bf8a-4ec43c9a3ebd\") " pod="openshift-network-operator/iptables-alerter-fdssp" May 27 20:11:33.037364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035195 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqdft\" (UniqueName: \"kubernetes.io/projected/d572187c-753d-447a-8232-d89446920689-kube-api-access-mqdft\") pod \"network-check-target-hm2h8\" (UID: \"d572187c-753d-447a-8232-d89446920689\") " pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:11:33.037364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035212 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-var-lib-kubelet\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.037364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035216 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cd676956-4f28-460e-bbf5-3d1502663715-ovnkube-script-lib\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.037364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035257 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd676956-4f28-460e-bbf5-3d1502663715-host-cni-bin\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.037364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035258 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-etc-sysctl-d\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.037364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.034983 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-hostroot\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.037364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035261 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-run\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.038191 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035299 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-run\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.038191 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035307 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-sys\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.038191 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035335 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-multus-conf-dir\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.038191 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035360 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4d137f7-70a2-4bbb-bf8a-4ec43c9a3ebd-iptables-alerter-script\") pod \"iptables-alerter-fdssp\" (UID: \"d4d137f7-70a2-4bbb-bf8a-4ec43c9a3ebd\") " pod="openshift-network-operator/iptables-alerter-fdssp" May 27 20:11:33.038191 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035384 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4d137f7-70a2-4bbb-bf8a-4ec43c9a3ebd-host-slash\") pod \"iptables-alerter-fdssp\" (UID: \"d4d137f7-70a2-4bbb-bf8a-4ec43c9a3ebd\") " pod="openshift-network-operator/iptables-alerter-fdssp" May 27 20:11:33.038191 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035385 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-sys\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.038191 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035406 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6b3d222a-0650-477d-82ac-95564e317e69-socket-dir\") pod \"aws-ebs-csi-driver-node-g9b2j\" (UID: \"6b3d222a-0650-477d-82ac-95564e317e69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" May 27 20:11:33.038191 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035426 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/99458291-9c93-4139-9ac4-008f6d1edfb7-multus-conf-dir\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.038191 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035429 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4d137f7-70a2-4bbb-bf8a-4ec43c9a3ebd-host-slash\") pod \"iptables-alerter-fdssp\" (UID: \"d4d137f7-70a2-4bbb-bf8a-4ec43c9a3ebd\") " pod="openshift-network-operator/iptables-alerter-fdssp" May 27 20:11:33.038191 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035452 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/19db3f5a-b350-4f80-960d-073d72ca4e4b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-69bpk\" (UID: \"19db3f5a-b350-4f80-960d-073d72ca4e4b\") " pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:33.038191 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035479 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-etc-modprobe-d\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.038191 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035831 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/99458291-9c93-4139-9ac4-008f6d1edfb7-cni-binary-copy\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.038191 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035901 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/278e5fd7-5304-49ae-a572-0d64b2a7f995-etc-modprobe-d\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.038191 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.035973 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4d137f7-70a2-4bbb-bf8a-4ec43c9a3ebd-iptables-alerter-script\") pod \"iptables-alerter-fdssp\" (UID: \"d4d137f7-70a2-4bbb-bf8a-4ec43c9a3ebd\") " pod="openshift-network-operator/iptables-alerter-fdssp" May 27 20:11:33.038191 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.036031 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cd676956-4f28-460e-bbf5-3d1502663715-ovnkube-config\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.038191 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.036171 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/19db3f5a-b350-4f80-960d-073d72ca4e4b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-69bpk\" (UID: \"19db3f5a-b350-4f80-960d-073d72ca4e4b\") " pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:33.038191 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.036188 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cd676956-4f28-460e-bbf5-3d1502663715-env-overrides\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.038191 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.038076 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/278e5fd7-5304-49ae-a572-0d64b2a7f995-etc-tuned\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.038883 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.038118 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/278e5fd7-5304-49ae-a572-0d64b2a7f995-tmp\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.038883 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.038132 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd676956-4f28-460e-bbf5-3d1502663715-ovn-node-metrics-cert\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.040678 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.040657 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtst4\" (UniqueName: \"kubernetes.io/projected/19db3f5a-b350-4f80-960d-073d72ca4e4b-kube-api-access-xtst4\") pod \"multus-additional-cni-plugins-69bpk\" (UID: \"19db3f5a-b350-4f80-960d-073d72ca4e4b\") " pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:33.043559 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:33.043531 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 20:11:33.043559 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:33.043554 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 20:11:33.043801 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:33.043566 2554 projected.go:194] Error preparing data for projected volume kube-api-access-mqdft for pod openshift-network-diagnostics/network-check-target-hm2h8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 20:11:33.043801 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:33.043653 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d572187c-753d-447a-8232-d89446920689-kube-api-access-mqdft podName:d572187c-753d-447a-8232-d89446920689 nodeName:}" failed. No retries permitted until 2026-05-27 20:11:33.543635299 +0000 UTC m=+3.071703934 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mqdft" (UniqueName: "kubernetes.io/projected/d572187c-753d-447a-8232-d89446920689-kube-api-access-mqdft") pod "network-check-target-hm2h8" (UID: "d572187c-753d-447a-8232-d89446920689") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 20:11:33.044107 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.044058 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grpdv\" (UniqueName: \"kubernetes.io/projected/6b3d222a-0650-477d-82ac-95564e317e69-kube-api-access-grpdv\") pod \"aws-ebs-csi-driver-node-g9b2j\" (UID: \"6b3d222a-0650-477d-82ac-95564e317e69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" May 27 20:11:33.044876 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.044716 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqgf4\" (UniqueName: \"kubernetes.io/projected/4def15c9-ddcd-4d42-a061-ef4f279c7f63-kube-api-access-wqgf4\") pod \"node-resolver-57cz2\" (UID: \"4def15c9-ddcd-4d42-a061-ef4f279c7f63\") " pod="openshift-dns/node-resolver-57cz2" May 27 20:11:33.046007 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.045985 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgstb\" (UniqueName: \"kubernetes.io/projected/99458291-9c93-4139-9ac4-008f6d1edfb7-kube-api-access-xgstb\") pod \"multus-mgcm2\" (UID: \"99458291-9c93-4139-9ac4-008f6d1edfb7\") " pod="openshift-multus/multus-mgcm2" May 27 20:11:33.046487 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.046445 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thhfw\" (UniqueName: \"kubernetes.io/projected/0e6cae6b-bb5a-44a0-b929-68b455a68a96-kube-api-access-thhfw\") pod \"node-ca-w86br\" (UID: \"0e6cae6b-bb5a-44a0-b929-68b455a68a96\") " pod="openshift-image-registry/node-ca-w86br" May 27 20:11:33.046487 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.046451 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zblwn\" (UniqueName: \"kubernetes.io/projected/cd676956-4f28-460e-bbf5-3d1502663715-kube-api-access-zblwn\") pod \"ovnkube-node-sbcv5\" (UID: \"cd676956-4f28-460e-bbf5-3d1502663715\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.047804 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.047778 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lx6n\" (UniqueName: \"kubernetes.io/projected/278e5fd7-5304-49ae-a572-0d64b2a7f995-kube-api-access-7lx6n\") pod \"tuned-whz8c\" (UID: \"278e5fd7-5304-49ae-a572-0d64b2a7f995\") " pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.047994 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.047973 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c22jn\" (UniqueName: \"kubernetes.io/projected/d4d137f7-70a2-4bbb-bf8a-4ec43c9a3ebd-kube-api-access-c22jn\") pod \"iptables-alerter-fdssp\" (UID: \"d4d137f7-70a2-4bbb-bf8a-4ec43c9a3ebd\") " pod="openshift-network-operator/iptables-alerter-fdssp" May 27 20:11:33.048276 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.048258 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5z4x\" (UniqueName: \"kubernetes.io/projected/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-kube-api-access-t5z4x\") pod \"network-metrics-daemon-5jv8k\" (UID: \"a51bfffe-2896-4ffe-84b0-23a5b5127cdd\") " pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:33.136412 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.136376 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87ac1929-612e-48ec-94ff-0e13017fea11-agent-certs\") pod \"konnectivity-agent-l7zcw\" (UID: \"87ac1929-612e-48ec-94ff-0e13017fea11\") " pod="kube-system/konnectivity-agent-l7zcw" May 27 20:11:33.136570 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.136435 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87ac1929-612e-48ec-94ff-0e13017fea11-konnectivity-ca\") pod \"konnectivity-agent-l7zcw\" (UID: \"87ac1929-612e-48ec-94ff-0e13017fea11\") " pod="kube-system/konnectivity-agent-l7zcw" May 27 20:11:33.136963 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.136939 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87ac1929-612e-48ec-94ff-0e13017fea11-konnectivity-ca\") pod \"konnectivity-agent-l7zcw\" (UID: \"87ac1929-612e-48ec-94ff-0e13017fea11\") " pod="kube-system/konnectivity-agent-l7zcw" May 27 20:11:33.138926 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.138904 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87ac1929-612e-48ec-94ff-0e13017fea11-agent-certs\") pod \"konnectivity-agent-l7zcw\" (UID: \"87ac1929-612e-48ec-94ff-0e13017fea11\") " pod="kube-system/konnectivity-agent-l7zcw" May 27 20:11:33.223986 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.223955 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" May 27 20:11:33.229817 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.229796 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-whz8c" May 27 20:11:33.238823 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.238804 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-57cz2" May 27 20:11:33.243310 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.243290 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w86br" May 27 20:11:33.248843 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.248818 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-69bpk" May 27 20:11:33.255406 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.255390 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mgcm2" May 27 20:11:33.262944 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.262925 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fdssp" May 27 20:11:33.269532 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.269515 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:33.276159 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.276090 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l7zcw" May 27 20:11:33.535029 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:33.534996 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19db3f5a_b350_4f80_960d_073d72ca4e4b.slice/crio-43ee1266efa0b0d083683cf197adbed45dfaaf9a12a104d963878b8451d482ec WatchSource:0}: Error finding container 43ee1266efa0b0d083683cf197adbed45dfaaf9a12a104d963878b8451d482ec: Status 404 returned error can't find the container with id 43ee1266efa0b0d083683cf197adbed45dfaaf9a12a104d963878b8451d482ec May 27 20:11:33.539163 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.539072 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-metrics-certs\") pod \"network-metrics-daemon-5jv8k\" (UID: \"a51bfffe-2896-4ffe-84b0-23a5b5127cdd\") " pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:33.539241 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:33.539224 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 20:11:33.539299 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:33.539291 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-metrics-certs podName:a51bfffe-2896-4ffe-84b0-23a5b5127cdd nodeName:}" failed. No retries permitted until 2026-05-27 20:11:34.539271589 +0000 UTC m=+4.067340209 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-metrics-certs") pod "network-metrics-daemon-5jv8k" (UID: "a51bfffe-2896-4ffe-84b0-23a5b5127cdd") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 20:11:33.541196 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:33.541169 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ac1929_612e_48ec_94ff_0e13017fea11.slice/crio-50ace2c63e1d4eb2ac0a24a6b96cb4f8c6b973842c641bee757b9721e1b85962 WatchSource:0}: Error finding container 50ace2c63e1d4eb2ac0a24a6b96cb4f8c6b973842c641bee757b9721e1b85962: Status 404 returned error can't find the container with id 50ace2c63e1d4eb2ac0a24a6b96cb4f8c6b973842c641bee757b9721e1b85962 May 27 20:11:33.541394 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:33.541375 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd676956_4f28_460e_bbf5_3d1502663715.slice/crio-9955e0451a7c8a8447c62453666334d0803cc09afa32ef30bee6609f89391207 WatchSource:0}: Error finding container 9955e0451a7c8a8447c62453666334d0803cc09afa32ef30bee6609f89391207: Status 404 returned error can't find the container with id 9955e0451a7c8a8447c62453666334d0803cc09afa32ef30bee6609f89391207 May 27 20:11:33.542305 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:33.542276 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4d137f7_70a2_4bbb_bf8a_4ec43c9a3ebd.slice/crio-c91d126ad77875e6d96511312350b7b11dacda036ad4108b1058711c69e7e3c5 WatchSource:0}: Error finding container c91d126ad77875e6d96511312350b7b11dacda036ad4108b1058711c69e7e3c5: Status 404 returned error can't find the container with id c91d126ad77875e6d96511312350b7b11dacda036ad4108b1058711c69e7e3c5 May 27 20:11:33.543511 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:33.543486 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4def15c9_ddcd_4d42_a061_ef4f279c7f63.slice/crio-0455952dc56e68d58b5e44a62830862e3a61251b4c0f5924209667cde5d38d12 WatchSource:0}: Error finding container 0455952dc56e68d58b5e44a62830862e3a61251b4c0f5924209667cde5d38d12: Status 404 returned error can't find the container with id 0455952dc56e68d58b5e44a62830862e3a61251b4c0f5924209667cde5d38d12 May 27 20:11:33.544615 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:33.544431 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e6cae6b_bb5a_44a0_b929_68b455a68a96.slice/crio-876129de69073d92359626c4db9b4441633fce278758cb3dd827bb12e5cc1597 WatchSource:0}: Error finding container 876129de69073d92359626c4db9b4441633fce278758cb3dd827bb12e5cc1597: Status 404 returned error can't find the container with id 876129de69073d92359626c4db9b4441633fce278758cb3dd827bb12e5cc1597 May 27 20:11:33.545877 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:11:33.545693 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99458291_9c93_4139_9ac4_008f6d1edfb7.slice/crio-c9797a8f5c0c026f15ae9d68f3743fa658f7d4fcef56949a90c1e581d4d5ddaa WatchSource:0}: Error finding container c9797a8f5c0c026f15ae9d68f3743fa658f7d4fcef56949a90c1e581d4d5ddaa: Status 404 returned error can't find the container with id c9797a8f5c0c026f15ae9d68f3743fa658f7d4fcef56949a90c1e581d4d5ddaa May 27 20:11:33.640231 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.640092 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqdft\" (UniqueName: \"kubernetes.io/projected/d572187c-753d-447a-8232-d89446920689-kube-api-access-mqdft\") pod \"network-check-target-hm2h8\" (UID: \"d572187c-753d-447a-8232-d89446920689\") " pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:11:33.640339 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:33.640241 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 20:11:33.640339 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:33.640258 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 20:11:33.640339 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:33.640266 2554 projected.go:194] Error preparing data for projected volume kube-api-access-mqdft for pod openshift-network-diagnostics/network-check-target-hm2h8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 20:11:33.640339 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:33.640308 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d572187c-753d-447a-8232-d89446920689-kube-api-access-mqdft podName:d572187c-753d-447a-8232-d89446920689 nodeName:}" failed. No retries permitted until 2026-05-27 20:11:34.640294006 +0000 UTC m=+4.168362631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mqdft" (UniqueName: "kubernetes.io/projected/d572187c-753d-447a-8232-d89446920689-kube-api-access-mqdft") pod "network-check-target-hm2h8" (UID: "d572187c-753d-447a-8232-d89446920689") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 20:11:33.966986 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.966926 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 20:06:31 +0000 UTC" deadline="2027-12-13 05:37:36.473020079 +0000 UTC" May 27 20:11:33.966986 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:33.966967 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13545h26m2.506056508s" May 27 20:11:34.058793 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:34.058713 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mgcm2" event={"ID":"99458291-9c93-4139-9ac4-008f6d1edfb7","Type":"ContainerStarted","Data":"c9797a8f5c0c026f15ae9d68f3743fa658f7d4fcef56949a90c1e581d4d5ddaa"} May 27 20:11:34.067520 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:34.067489 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-57cz2" event={"ID":"4def15c9-ddcd-4d42-a061-ef4f279c7f63","Type":"ContainerStarted","Data":"0455952dc56e68d58b5e44a62830862e3a61251b4c0f5924209667cde5d38d12"} May 27 20:11:34.075406 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:34.075331 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fdssp" event={"ID":"d4d137f7-70a2-4bbb-bf8a-4ec43c9a3ebd","Type":"ContainerStarted","Data":"c91d126ad77875e6d96511312350b7b11dacda036ad4108b1058711c69e7e3c5"} May 27 20:11:34.081992 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:34.081966 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" event={"ID":"cd676956-4f28-460e-bbf5-3d1502663715","Type":"ContainerStarted","Data":"9955e0451a7c8a8447c62453666334d0803cc09afa32ef30bee6609f89391207"} May 27 20:11:34.086841 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:34.086813 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" event={"ID":"6b3d222a-0650-477d-82ac-95564e317e69","Type":"ContainerStarted","Data":"09907e241380e9201e2ac02df7c9a2f4986a15833c84ff1c9155936bc1e1e010"} May 27 20:11:34.097035 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:34.097007 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-103.ec2.internal" event={"ID":"06181dfa378829b92cc5ea772451a452","Type":"ContainerStarted","Data":"c16e8770c90cf0132cec40c82af3117578ad780f5c0f19e24e8ce2d9001a3866"} May 27 20:11:34.102752 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:34.102716 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w86br" event={"ID":"0e6cae6b-bb5a-44a0-b929-68b455a68a96","Type":"ContainerStarted","Data":"876129de69073d92359626c4db9b4441633fce278758cb3dd827bb12e5cc1597"} May 27 20:11:34.111422 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:34.111376 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l7zcw" event={"ID":"87ac1929-612e-48ec-94ff-0e13017fea11","Type":"ContainerStarted","Data":"50ace2c63e1d4eb2ac0a24a6b96cb4f8c6b973842c641bee757b9721e1b85962"} May 27 20:11:34.126716 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:34.126649 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-whz8c" event={"ID":"278e5fd7-5304-49ae-a572-0d64b2a7f995","Type":"ContainerStarted","Data":"82d50e76958a5055f7b3a3d79a6a947c56406454f5e749a9b9f34fecea17eed3"} May 27 20:11:34.133935 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:34.133868 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69bpk" event={"ID":"19db3f5a-b350-4f80-960d-073d72ca4e4b","Type":"ContainerStarted","Data":"43ee1266efa0b0d083683cf197adbed45dfaaf9a12a104d963878b8451d482ec"} May 27 20:11:34.145348 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:34.144656 2554 generic.go:358] "Generic (PLEG): container finished" podID="d8b0c93f69930a962fcb9912400f9315" containerID="665ad4d721afb953ddad4133fe4cbab0f51cd75f92306dfa2aead52d7c3d8942" exitCode=0 May 27 20:11:34.145348 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:34.144692 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal" event={"ID":"d8b0c93f69930a962fcb9912400f9315","Type":"ContainerDied","Data":"665ad4d721afb953ddad4133fe4cbab0f51cd75f92306dfa2aead52d7c3d8942"} May 27 20:11:34.163606 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:34.162847 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-103.ec2.internal" podStartSLOduration=2.16279985 podStartE2EDuration="2.16279985s" podCreationTimestamp="2026-05-27 20:11:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:11:34.113208269 +0000 UTC m=+3.641276913" watchObservedRunningTime="2026-05-27 20:11:34.16279985 +0000 UTC m=+3.690868493" May 27 20:11:34.547948 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:34.547352 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-metrics-certs\") pod \"network-metrics-daemon-5jv8k\" (UID: \"a51bfffe-2896-4ffe-84b0-23a5b5127cdd\") " pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:34.547948 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:34.547507 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 20:11:34.547948 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:34.547572 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-metrics-certs podName:a51bfffe-2896-4ffe-84b0-23a5b5127cdd nodeName:}" failed. No retries permitted until 2026-05-27 20:11:36.547551615 +0000 UTC m=+6.075620239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-metrics-certs") pod "network-metrics-daemon-5jv8k" (UID: "a51bfffe-2896-4ffe-84b0-23a5b5127cdd") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 20:11:34.648859 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:34.648768 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqdft\" (UniqueName: \"kubernetes.io/projected/d572187c-753d-447a-8232-d89446920689-kube-api-access-mqdft\") pod \"network-check-target-hm2h8\" (UID: \"d572187c-753d-447a-8232-d89446920689\") " pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:11:34.649021 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:34.648955 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 20:11:34.649021 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:34.648974 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 20:11:34.649021 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:34.648986 2554 projected.go:194] Error preparing data for projected volume kube-api-access-mqdft for pod openshift-network-diagnostics/network-check-target-hm2h8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 20:11:34.649172 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:34.649043 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d572187c-753d-447a-8232-d89446920689-kube-api-access-mqdft podName:d572187c-753d-447a-8232-d89446920689 nodeName:}" failed. No retries permitted until 2026-05-27 20:11:36.649023662 +0000 UTC m=+6.177092302 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mqdft" (UniqueName: "kubernetes.io/projected/d572187c-753d-447a-8232-d89446920689-kube-api-access-mqdft") pod "network-check-target-hm2h8" (UID: "d572187c-753d-447a-8232-d89446920689") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 20:11:35.051231 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:35.050783 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:35.051231 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:35.050789 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:11:35.051231 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:35.050905 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jv8k" podUID="a51bfffe-2896-4ffe-84b0-23a5b5127cdd" May 27 20:11:35.051231 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:35.050953 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm2h8" podUID="d572187c-753d-447a-8232-d89446920689" May 27 20:11:35.163316 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:35.163281 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal" event={"ID":"d8b0c93f69930a962fcb9912400f9315","Type":"ContainerStarted","Data":"5d7cf3f6a4db5a6e639aed7a9e3f28cedc8b95fd6905242a556e80f3698af7ea"} May 27 20:11:35.184763 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:35.184709 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal" podStartSLOduration=3.184692885 podStartE2EDuration="3.184692885s" podCreationTimestamp="2026-05-27 20:11:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:11:35.183994408 +0000 UTC m=+4.712063053" watchObservedRunningTime="2026-05-27 20:11:35.184692885 +0000 UTC m=+4.712761528" May 27 20:11:36.567160 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:36.567122 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-metrics-certs\") pod \"network-metrics-daemon-5jv8k\" (UID: \"a51bfffe-2896-4ffe-84b0-23a5b5127cdd\") " pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:36.567595 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:36.567291 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 20:11:36.567595 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:36.567364 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-metrics-certs podName:a51bfffe-2896-4ffe-84b0-23a5b5127cdd nodeName:}" failed. No retries permitted until 2026-05-27 20:11:40.567343511 +0000 UTC m=+10.095412145 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-metrics-certs") pod "network-metrics-daemon-5jv8k" (UID: "a51bfffe-2896-4ffe-84b0-23a5b5127cdd") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 20:11:36.668357 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:36.667730 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqdft\" (UniqueName: \"kubernetes.io/projected/d572187c-753d-447a-8232-d89446920689-kube-api-access-mqdft\") pod \"network-check-target-hm2h8\" (UID: \"d572187c-753d-447a-8232-d89446920689\") " pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:11:36.668357 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:36.667918 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 20:11:36.668357 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:36.667940 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 20:11:36.668357 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:36.667954 2554 projected.go:194] Error preparing data for projected volume kube-api-access-mqdft for pod openshift-network-diagnostics/network-check-target-hm2h8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 20:11:36.668357 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:36.668019 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d572187c-753d-447a-8232-d89446920689-kube-api-access-mqdft podName:d572187c-753d-447a-8232-d89446920689 nodeName:}" failed. No retries permitted until 2026-05-27 20:11:40.668000053 +0000 UTC m=+10.196068687 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mqdft" (UniqueName: "kubernetes.io/projected/d572187c-753d-447a-8232-d89446920689-kube-api-access-mqdft") pod "network-check-target-hm2h8" (UID: "d572187c-753d-447a-8232-d89446920689") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 20:11:37.052130 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:37.051247 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:11:37.052130 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:37.051381 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm2h8" podUID="d572187c-753d-447a-8232-d89446920689" May 27 20:11:37.052130 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:37.051795 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:37.052130 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:37.051902 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jv8k" podUID="a51bfffe-2896-4ffe-84b0-23a5b5127cdd" May 27 20:11:39.050071 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:39.049977 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:39.050071 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:39.050015 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:11:39.050593 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:39.050149 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jv8k" podUID="a51bfffe-2896-4ffe-84b0-23a5b5127cdd" May 27 20:11:39.050593 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:39.050561 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm2h8" podUID="d572187c-753d-447a-8232-d89446920689" May 27 20:11:40.601198 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:40.601107 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-metrics-certs\") pod \"network-metrics-daemon-5jv8k\" (UID: \"a51bfffe-2896-4ffe-84b0-23a5b5127cdd\") " pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:40.601699 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:40.601271 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 20:11:40.601699 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:40.601346 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-metrics-certs podName:a51bfffe-2896-4ffe-84b0-23a5b5127cdd nodeName:}" failed. No retries permitted until 2026-05-27 20:11:48.601323751 +0000 UTC m=+18.129392385 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-metrics-certs") pod "network-metrics-daemon-5jv8k" (UID: "a51bfffe-2896-4ffe-84b0-23a5b5127cdd") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 20:11:40.702527 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:40.702356 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqdft\" (UniqueName: \"kubernetes.io/projected/d572187c-753d-447a-8232-d89446920689-kube-api-access-mqdft\") pod \"network-check-target-hm2h8\" (UID: \"d572187c-753d-447a-8232-d89446920689\") " pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:11:40.702527 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:40.702508 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 20:11:40.702527 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:40.702529 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 20:11:40.702527 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:40.702541 2554 projected.go:194] Error preparing data for projected volume kube-api-access-mqdft for pod openshift-network-diagnostics/network-check-target-hm2h8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 20:11:40.702929 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:40.702598 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d572187c-753d-447a-8232-d89446920689-kube-api-access-mqdft podName:d572187c-753d-447a-8232-d89446920689 nodeName:}" failed. No retries permitted until 2026-05-27 20:11:48.702580744 +0000 UTC m=+18.230649378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mqdft" (UniqueName: "kubernetes.io/projected/d572187c-753d-447a-8232-d89446920689-kube-api-access-mqdft") pod "network-check-target-hm2h8" (UID: "d572187c-753d-447a-8232-d89446920689") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 20:11:41.051445 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:41.050813 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:11:41.051445 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:41.050917 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm2h8" podUID="d572187c-753d-447a-8232-d89446920689" May 27 20:11:41.051445 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:41.051253 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:41.051445 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:41.051352 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jv8k" podUID="a51bfffe-2896-4ffe-84b0-23a5b5127cdd" May 27 20:11:43.050948 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:43.050914 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:43.051450 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:43.050915 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:11:43.051450 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:43.051048 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jv8k" podUID="a51bfffe-2896-4ffe-84b0-23a5b5127cdd" May 27 20:11:43.051450 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:43.051116 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm2h8" podUID="d572187c-753d-447a-8232-d89446920689" May 27 20:11:45.050316 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:45.050282 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:45.050850 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:45.050422 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jv8k" podUID="a51bfffe-2896-4ffe-84b0-23a5b5127cdd" May 27 20:11:45.050850 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:45.050464 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:11:45.050850 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:45.050542 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm2h8" podUID="d572187c-753d-447a-8232-d89446920689" May 27 20:11:47.051087 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:47.050996 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:11:47.051087 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:47.051062 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:47.051675 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:47.051178 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm2h8" podUID="d572187c-753d-447a-8232-d89446920689" May 27 20:11:47.051675 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:47.051312 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jv8k" podUID="a51bfffe-2896-4ffe-84b0-23a5b5127cdd" May 27 20:11:48.661616 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:48.661572 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-metrics-certs\") pod \"network-metrics-daemon-5jv8k\" (UID: \"a51bfffe-2896-4ffe-84b0-23a5b5127cdd\") " pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:48.662101 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:48.661750 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 20:11:48.662101 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:48.661833 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-metrics-certs podName:a51bfffe-2896-4ffe-84b0-23a5b5127cdd nodeName:}" failed. No retries permitted until 2026-05-27 20:12:04.661810591 +0000 UTC m=+34.189879227 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-metrics-certs") pod "network-metrics-daemon-5jv8k" (UID: "a51bfffe-2896-4ffe-84b0-23a5b5127cdd") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 20:11:48.762818 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:48.762775 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqdft\" (UniqueName: \"kubernetes.io/projected/d572187c-753d-447a-8232-d89446920689-kube-api-access-mqdft\") pod \"network-check-target-hm2h8\" (UID: \"d572187c-753d-447a-8232-d89446920689\") " pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:11:48.762999 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:48.762966 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 20:11:48.762999 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:48.762991 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 20:11:48.763107 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:48.763006 2554 projected.go:194] Error preparing data for projected volume kube-api-access-mqdft for pod openshift-network-diagnostics/network-check-target-hm2h8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 20:11:48.763107 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:48.763073 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d572187c-753d-447a-8232-d89446920689-kube-api-access-mqdft podName:d572187c-753d-447a-8232-d89446920689 nodeName:}" failed. No retries permitted until 2026-05-27 20:12:04.763053542 +0000 UTC m=+34.291122169 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mqdft" (UniqueName: "kubernetes.io/projected/d572187c-753d-447a-8232-d89446920689-kube-api-access-mqdft") pod "network-check-target-hm2h8" (UID: "d572187c-753d-447a-8232-d89446920689") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 20:11:49.050766 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:49.050730 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:11:49.050766 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:49.050759 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:49.051013 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:49.050848 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm2h8" podUID="d572187c-753d-447a-8232-d89446920689" May 27 20:11:49.051013 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:49.050973 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jv8k" podUID="a51bfffe-2896-4ffe-84b0-23a5b5127cdd" May 27 20:11:51.050743 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:51.050719 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:51.051110 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:51.050837 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jv8k" podUID="a51bfffe-2896-4ffe-84b0-23a5b5127cdd" May 27 20:11:51.051110 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:51.050907 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:11:51.051110 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:51.050991 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm2h8" podUID="d572187c-753d-447a-8232-d89446920689" May 27 20:11:51.196902 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:51.196730 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" event={"ID":"6b3d222a-0650-477d-82ac-95564e317e69","Type":"ContainerStarted","Data":"2a1e420f3b7b163b76c57d3f61de066b8900074efff94e3e85070aa2c78ca2e7"} May 27 20:11:51.197912 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:51.197890 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l7zcw" event={"ID":"87ac1929-612e-48ec-94ff-0e13017fea11","Type":"ContainerStarted","Data":"d918d1bc4298462aab1156fac414d352381ab3584e90d002324204e59ea527cd"} May 27 20:11:51.212595 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:51.212539 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l7zcw" podStartSLOduration=2.785155105 podStartE2EDuration="20.212523812s" podCreationTimestamp="2026-05-27 20:11:31 +0000 UTC" firstStartedPulling="2026-05-27 20:11:33.542676179 +0000 UTC m=+3.070744799" lastFinishedPulling="2026-05-27 20:11:50.970044867 +0000 UTC m=+20.498113506" observedRunningTime="2026-05-27 20:11:51.212348917 +0000 UTC m=+20.740417560" watchObservedRunningTime="2026-05-27 20:11:51.212523812 +0000 UTC m=+20.740592454" May 27 20:11:52.200712 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:52.200423 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mgcm2" event={"ID":"99458291-9c93-4139-9ac4-008f6d1edfb7","Type":"ContainerStarted","Data":"1f410a3a595bab780e172d0495d4293c2420bf12550ff2f7b2bd807273a1e327"} May 27 20:11:52.201734 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:52.201716 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-57cz2" event={"ID":"4def15c9-ddcd-4d42-a061-ef4f279c7f63","Type":"ContainerStarted","Data":"1d43cc822fd97b1d960b8fd9eba0376982908c6bcfa026b876f5a9233fbe59b4"} May 27 20:11:52.203867 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:52.203846 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/ovn-acl-logging/0.log" May 27 20:11:52.204166 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:52.204149 2554 generic.go:358] "Generic (PLEG): container finished" podID="cd676956-4f28-460e-bbf5-3d1502663715" containerID="5ff2ec99000ec67129c9cdfdd1b89da44a6f22e30b3755b62abfba790a93b299" exitCode=1 May 27 20:11:52.204226 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:52.204210 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" event={"ID":"cd676956-4f28-460e-bbf5-3d1502663715","Type":"ContainerStarted","Data":"966f233b3f35228b1f1cdcdd9053e28e0dfde42389f145a372db0bf18d66acd3"} May 27 20:11:52.204266 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:52.204229 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" event={"ID":"cd676956-4f28-460e-bbf5-3d1502663715","Type":"ContainerStarted","Data":"88821d238a587fe189f93a7c16e2e11fabfa3e8e99d38706124bbb7ac6aceff2"} May 27 20:11:52.204266 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:52.204242 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" event={"ID":"cd676956-4f28-460e-bbf5-3d1502663715","Type":"ContainerStarted","Data":"8a34655b8dc4e3437dd6bbbba2762ad6d1e45276e4e9492e9b82cc57d44ce0af"} May 27 20:11:52.204266 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:52.204249 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" event={"ID":"cd676956-4f28-460e-bbf5-3d1502663715","Type":"ContainerStarted","Data":"47bfa6740007ccba95e9310d634c1894c783460d4b2a9bcf2c6595475fa0e794"} May 27 20:11:52.204266 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:52.204257 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" event={"ID":"cd676956-4f28-460e-bbf5-3d1502663715","Type":"ContainerDied","Data":"5ff2ec99000ec67129c9cdfdd1b89da44a6f22e30b3755b62abfba790a93b299"} May 27 20:11:52.204266 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:52.204267 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" event={"ID":"cd676956-4f28-460e-bbf5-3d1502663715","Type":"ContainerStarted","Data":"355be8f4b9a99d494fd8948fc62b00e3344243b170984f1235f671fcad39ba9c"} May 27 20:11:52.205344 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:52.205325 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w86br" event={"ID":"0e6cae6b-bb5a-44a0-b929-68b455a68a96","Type":"ContainerStarted","Data":"04c6937beab6c101f35c38000e83490cd076a4575c690e83234d4d21f32da75f"} May 27 20:11:52.207736 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:52.207715 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-whz8c" event={"ID":"278e5fd7-5304-49ae-a572-0d64b2a7f995","Type":"ContainerStarted","Data":"cee295a28db190c9db16664a64d105dc10cea656ddac7121cf44d3a647673da1"} May 27 20:11:52.209161 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:52.209136 2554 generic.go:358] "Generic (PLEG): container finished" podID="19db3f5a-b350-4f80-960d-073d72ca4e4b" containerID="4edd7eeda34f975f639245935d3ea6c1e4fcb7d24eb5ece4c35dc92fe8ee7f65" exitCode=0 May 27 20:11:52.209244 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:52.209185 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69bpk" event={"ID":"19db3f5a-b350-4f80-960d-073d72ca4e4b","Type":"ContainerDied","Data":"4edd7eeda34f975f639245935d3ea6c1e4fcb7d24eb5ece4c35dc92fe8ee7f65"} May 27 20:11:52.217446 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:52.217412 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-mgcm2" podStartSLOduration=3.431258187 podStartE2EDuration="21.217402013s" podCreationTimestamp="2026-05-27 20:11:31 +0000 UTC" firstStartedPulling="2026-05-27 20:11:33.549828169 +0000 UTC m=+3.077896796" lastFinishedPulling="2026-05-27 20:11:51.335971987 +0000 UTC m=+20.864040622" observedRunningTime="2026-05-27 20:11:52.217231649 +0000 UTC m=+21.745300290" watchObservedRunningTime="2026-05-27 20:11:52.217402013 +0000 UTC m=+21.745470655" May 27 20:11:52.248894 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:52.248861 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-57cz2" podStartSLOduration=3.795599309 podStartE2EDuration="21.248852081s" podCreationTimestamp="2026-05-27 20:11:31 +0000 UTC" firstStartedPulling="2026-05-27 20:11:33.546388076 +0000 UTC m=+3.074456702" lastFinishedPulling="2026-05-27 20:11:50.999640853 +0000 UTC m=+20.527709474" observedRunningTime="2026-05-27 20:11:52.248670881 +0000 UTC m=+21.776739523" watchObservedRunningTime="2026-05-27 20:11:52.248852081 +0000 UTC m=+21.776920722" May 27 20:11:52.262424 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:52.262391 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w86br" podStartSLOduration=3.810658052 podStartE2EDuration="21.262383625s" podCreationTimestamp="2026-05-27 20:11:31 +0000 UTC" firstStartedPulling="2026-05-27 20:11:33.547913059 +0000 UTC m=+3.075981681" lastFinishedPulling="2026-05-27 20:11:50.999638616 +0000 UTC m=+20.527707254" observedRunningTime="2026-05-27 20:11:52.262008582 +0000 UTC m=+21.790077225" watchObservedRunningTime="2026-05-27 20:11:52.262383625 +0000 UTC m=+21.790452267" May 27 20:11:52.279182 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:52.279154 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-whz8c" podStartSLOduration=3.818218615 podStartE2EDuration="21.279143939s" podCreationTimestamp="2026-05-27 20:11:31 +0000 UTC" firstStartedPulling="2026-05-27 20:11:33.540209094 +0000 UTC m=+3.068277714" lastFinishedPulling="2026-05-27 20:11:51.0011344 +0000 UTC m=+20.529203038" observedRunningTime="2026-05-27 20:11:52.279085317 +0000 UTC m=+21.807153949" watchObservedRunningTime="2026-05-27 20:11:52.279143939 +0000 UTC m=+21.807212578" May 27 20:11:52.490550 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:52.490524 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 27 20:11:52.999017 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:52.998914 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-27T20:11:52.49054485Z","UUID":"281357ee-1e71-40bd-b17d-42584b2e87b4","Handler":null,"Name":"","Endpoint":""} May 27 20:11:53.002512 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:53.002478 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 27 20:11:53.002512 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:53.002509 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 27 20:11:53.050079 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:53.050044 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:53.050223 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:53.050050 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:11:53.050223 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:53.050158 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jv8k" podUID="a51bfffe-2896-4ffe-84b0-23a5b5127cdd" May 27 20:11:53.050334 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:53.050237 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm2h8" podUID="d572187c-753d-447a-8232-d89446920689" May 27 20:11:53.212468 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:53.212429 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fdssp" event={"ID":"d4d137f7-70a2-4bbb-bf8a-4ec43c9a3ebd","Type":"ContainerStarted","Data":"4aed4554303c45b6dca8e79bcace95d0b0f3e6e9d24c04588a44ae3ff537fff5"} May 27 20:11:53.214924 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:53.214894 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" event={"ID":"6b3d222a-0650-477d-82ac-95564e317e69","Type":"ContainerStarted","Data":"6d167ca6aff30937c67c4c8b1f94b5fbe767a68e67f2fcd64fab7f8f5f5562aa"} May 27 20:11:53.227013 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:53.226963 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fdssp" podStartSLOduration=4.801695778 podStartE2EDuration="22.226946671s" podCreationTimestamp="2026-05-27 20:11:31 +0000 UTC" firstStartedPulling="2026-05-27 20:11:33.544790503 +0000 UTC m=+3.072859137" lastFinishedPulling="2026-05-27 20:11:50.970041407 +0000 UTC m=+20.498110030" observedRunningTime="2026-05-27 20:11:53.226180952 +0000 UTC m=+22.754249595" watchObservedRunningTime="2026-05-27 20:11:53.226946671 +0000 UTC m=+22.755015314" May 27 20:11:53.327798 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:53.327719 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l7zcw" May 27 20:11:53.328524 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:53.328501 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l7zcw" May 27 20:11:54.218862 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:54.218652 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/ovn-acl-logging/0.log" May 27 20:11:54.219281 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:54.219157 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" event={"ID":"cd676956-4f28-460e-bbf5-3d1502663715","Type":"ContainerStarted","Data":"caf229da2a72d34fb5f24d40c360b6d6a9e0663b6b0b91f6b2dd1e81db219d18"} May 27 20:11:54.220734 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:54.220711 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" event={"ID":"6b3d222a-0650-477d-82ac-95564e317e69","Type":"ContainerStarted","Data":"2f12f1be56b87ead2d552ac2143972f28c45a286f066a545bb2fcde268b240e4"} May 27 20:11:54.237184 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:54.237147 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9b2j" podStartSLOduration=3.293637214 podStartE2EDuration="23.237137976s" podCreationTimestamp="2026-05-27 20:11:31 +0000 UTC" firstStartedPulling="2026-05-27 20:11:33.539364193 +0000 UTC m=+3.067432820" lastFinishedPulling="2026-05-27 20:11:53.482864947 +0000 UTC m=+23.010933582" observedRunningTime="2026-05-27 20:11:54.236864738 +0000 UTC m=+23.764933371" watchObservedRunningTime="2026-05-27 20:11:54.237137976 +0000 UTC m=+23.765206617" May 27 20:11:55.050825 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:55.050789 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:11:55.050825 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:55.050815 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:55.051037 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:55.050911 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm2h8" podUID="d572187c-753d-447a-8232-d89446920689" May 27 20:11:55.051037 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:55.051026 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jv8k" podUID="a51bfffe-2896-4ffe-84b0-23a5b5127cdd" May 27 20:11:57.050400 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:57.050364 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:11:57.051234 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:57.050360 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:57.051234 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:57.050492 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm2h8" podUID="d572187c-753d-447a-8232-d89446920689" May 27 20:11:57.051234 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:57.050600 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jv8k" podUID="a51bfffe-2896-4ffe-84b0-23a5b5127cdd" May 27 20:11:57.649313 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:57.649020 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l7zcw" May 27 20:11:57.649476 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:57.649396 2554 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 27 20:11:57.649806 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:57.649782 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l7zcw" May 27 20:11:58.228947 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:58.228912 2554 generic.go:358] "Generic (PLEG): container finished" podID="19db3f5a-b350-4f80-960d-073d72ca4e4b" containerID="1b7274083fa117d70d6905e6b679f6d2cf0c823502c18e91d34a24bae0ceebc6" exitCode=0 May 27 20:11:58.229484 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:58.228993 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69bpk" event={"ID":"19db3f5a-b350-4f80-960d-073d72ca4e4b","Type":"ContainerDied","Data":"1b7274083fa117d70d6905e6b679f6d2cf0c823502c18e91d34a24bae0ceebc6"} May 27 20:11:58.232148 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:58.232107 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/ovn-acl-logging/0.log" May 27 20:11:58.232525 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:58.232479 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" event={"ID":"cd676956-4f28-460e-bbf5-3d1502663715","Type":"ContainerStarted","Data":"8735819f124ce71ff28382dcb0bcb33207693989bd7271bf0c5fbe1bc733953b"} May 27 20:11:58.232924 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:58.232891 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:58.233042 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:58.233027 2554 scope.go:117] "RemoveContainer" containerID="5ff2ec99000ec67129c9cdfdd1b89da44a6f22e30b3755b62abfba790a93b299" May 27 20:11:58.248105 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:58.248087 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:59.050377 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:59.050347 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:11:59.050666 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:59.050347 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:59.050666 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:59.050451 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm2h8" podUID="d572187c-753d-447a-8232-d89446920689" May 27 20:11:59.050666 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:59.050564 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jv8k" podUID="a51bfffe-2896-4ffe-84b0-23a5b5127cdd" May 27 20:11:59.238392 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:59.238232 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/ovn-acl-logging/0.log" May 27 20:11:59.238833 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:59.238715 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" event={"ID":"cd676956-4f28-460e-bbf5-3d1502663715","Type":"ContainerStarted","Data":"3f1d8c601bf0af4a15efbf21555b12056f845e82c77a28f2aa526f0b293745e9"} May 27 20:11:59.238833 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:59.238818 2554 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 27 20:11:59.239045 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:59.239024 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:59.240791 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:59.240767 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69bpk" event={"ID":"19db3f5a-b350-4f80-960d-073d72ca4e4b","Type":"ContainerStarted","Data":"833ecd334d33f5edb23b1ae47cd9d45fcfc8819d6290e924d2bb5fc2913a0792"} May 27 20:11:59.255136 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:59.255109 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:11:59.267182 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:59.267133 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" podStartSLOduration=10.764682404 podStartE2EDuration="28.267116755s" podCreationTimestamp="2026-05-27 20:11:31 +0000 UTC" firstStartedPulling="2026-05-27 20:11:33.543777351 +0000 UTC m=+3.071845977" lastFinishedPulling="2026-05-27 20:11:51.046211694 +0000 UTC m=+20.574280328" observedRunningTime="2026-05-27 20:11:59.266251357 +0000 UTC m=+28.794320023" watchObservedRunningTime="2026-05-27 20:11:59.267116755 +0000 UTC m=+28.795185378" May 27 20:11:59.355153 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:59.355068 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5jv8k"] May 27 20:11:59.355302 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:59.355210 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:11:59.355346 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:59.355309 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jv8k" podUID="a51bfffe-2896-4ffe-84b0-23a5b5127cdd" May 27 20:11:59.355797 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:59.355776 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hm2h8"] May 27 20:11:59.355895 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:11:59.355882 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:11:59.355994 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:11:59.355972 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm2h8" podUID="d572187c-753d-447a-8232-d89446920689" May 27 20:12:00.244701 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:00.244670 2554 generic.go:358] "Generic (PLEG): container finished" podID="19db3f5a-b350-4f80-960d-073d72ca4e4b" containerID="833ecd334d33f5edb23b1ae47cd9d45fcfc8819d6290e924d2bb5fc2913a0792" exitCode=0 May 27 20:12:00.245015 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:00.244739 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69bpk" event={"ID":"19db3f5a-b350-4f80-960d-073d72ca4e4b","Type":"ContainerDied","Data":"833ecd334d33f5edb23b1ae47cd9d45fcfc8819d6290e924d2bb5fc2913a0792"} May 27 20:12:00.245015 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:00.244882 2554 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 27 20:12:01.051288 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:01.051254 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:12:01.051468 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:01.051363 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jv8k" podUID="a51bfffe-2896-4ffe-84b0-23a5b5127cdd" May 27 20:12:01.051468 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:01.051429 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:12:01.051573 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:01.051506 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm2h8" podUID="d572187c-753d-447a-8232-d89446920689" May 27 20:12:01.248360 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:01.248326 2554 generic.go:358] "Generic (PLEG): container finished" podID="19db3f5a-b350-4f80-960d-073d72ca4e4b" containerID="caa246a4090a34a6e6e200f2d3f14164c6fa909af40ef6526eea321b1d7d5e1b" exitCode=0 May 27 20:12:01.249118 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:01.248404 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69bpk" event={"ID":"19db3f5a-b350-4f80-960d-073d72ca4e4b","Type":"ContainerDied","Data":"caa246a4090a34a6e6e200f2d3f14164c6fa909af40ef6526eea321b1d7d5e1b"} May 27 20:12:01.249118 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:01.248693 2554 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 27 20:12:01.843692 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:01.843615 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:12:02.268450 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:02.268424 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sbcv5" May 27 20:12:03.050295 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:03.050261 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:12:03.050483 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:03.050261 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:12:03.050483 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:03.050401 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5jv8k" podUID="a51bfffe-2896-4ffe-84b0-23a5b5127cdd" May 27 20:12:03.050483 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:03.050449 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm2h8" podUID="d572187c-753d-447a-8232-d89446920689" May 27 20:12:03.806909 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:03.806885 2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeReady" May 27 20:12:03.807310 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:03.806992 2554 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 27 20:12:03.851378 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:03.851347 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pwnms"] May 27 20:12:03.875205 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:03.875178 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jqxt2"] May 27 20:12:03.875348 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:03.875330 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pwnms" May 27 20:12:03.877742 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:03.877715 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 27 20:12:03.877873 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:03.877805 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 27 20:12:03.878001 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:03.877978 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jcg7q\"" May 27 20:12:03.891129 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:03.891105 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pwnms"] May 27 20:12:03.891221 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:03.891139 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jqxt2"] May 27 20:12:03.891221 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:03.891138 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jqxt2" May 27 20:12:03.893499 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:03.893478 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 27 20:12:03.893597 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:03.893503 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c8wsm\"" May 27 20:12:03.893597 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:03.893537 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 27 20:12:03.893732 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:03.893482 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 27 20:12:03.979187 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:03.979161 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hn8b\" (UniqueName: \"kubernetes.io/projected/db22aafa-06fa-48ee-b31f-69581a977745-kube-api-access-5hn8b\") pod \"dns-default-pwnms\" (UID: \"db22aafa-06fa-48ee-b31f-69581a977745\") " pod="openshift-dns/dns-default-pwnms" May 27 20:12:03.979357 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:03.979199 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db22aafa-06fa-48ee-b31f-69581a977745-metrics-tls\") pod \"dns-default-pwnms\" (UID: \"db22aafa-06fa-48ee-b31f-69581a977745\") " pod="openshift-dns/dns-default-pwnms" May 27 20:12:03.979357 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:03.979263 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/db22aafa-06fa-48ee-b31f-69581a977745-config-volume\") pod \"dns-default-pwnms\" (UID: \"db22aafa-06fa-48ee-b31f-69581a977745\") " pod="openshift-dns/dns-default-pwnms" May 27 20:12:03.979357 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:03.979291 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db22aafa-06fa-48ee-b31f-69581a977745-tmp-dir\") pod \"dns-default-pwnms\" (UID: \"db22aafa-06fa-48ee-b31f-69581a977745\") " pod="openshift-dns/dns-default-pwnms" May 27 20:12:04.079796 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:04.079728 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj9wb\" (UniqueName: \"kubernetes.io/projected/b59afc02-dbe6-4e59-b84a-f7c108bd70e3-kube-api-access-zj9wb\") pod \"ingress-canary-jqxt2\" (UID: \"b59afc02-dbe6-4e59-b84a-f7c108bd70e3\") " pod="openshift-ingress-canary/ingress-canary-jqxt2" May 27 20:12:04.079796 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:04.079766 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db22aafa-06fa-48ee-b31f-69581a977745-metrics-tls\") pod \"dns-default-pwnms\" (UID: \"db22aafa-06fa-48ee-b31f-69581a977745\") " pod="openshift-dns/dns-default-pwnms" May 27 20:12:04.079960 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:04.079820 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/db22aafa-06fa-48ee-b31f-69581a977745-config-volume\") pod \"dns-default-pwnms\" (UID: \"db22aafa-06fa-48ee-b31f-69581a977745\") " pod="openshift-dns/dns-default-pwnms" May 27 20:12:04.079960 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:04.079837 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db22aafa-06fa-48ee-b31f-69581a977745-tmp-dir\") pod \"dns-default-pwnms\" (UID: \"db22aafa-06fa-48ee-b31f-69581a977745\") " pod="openshift-dns/dns-default-pwnms" May 27 20:12:04.079960 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:04.079856 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b59afc02-dbe6-4e59-b84a-f7c108bd70e3-cert\") pod \"ingress-canary-jqxt2\" (UID: \"b59afc02-dbe6-4e59-b84a-f7c108bd70e3\") " pod="openshift-ingress-canary/ingress-canary-jqxt2" May 27 20:12:04.079960 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:04.079896 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5hn8b\" (UniqueName: \"kubernetes.io/projected/db22aafa-06fa-48ee-b31f-69581a977745-kube-api-access-5hn8b\") pod \"dns-default-pwnms\" (UID: \"db22aafa-06fa-48ee-b31f-69581a977745\") " pod="openshift-dns/dns-default-pwnms" May 27 20:12:04.079960 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:04.079901 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 20:12:04.080175 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:04.079995 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db22aafa-06fa-48ee-b31f-69581a977745-metrics-tls podName:db22aafa-06fa-48ee-b31f-69581a977745 nodeName:}" failed. No retries permitted until 2026-05-27 20:12:04.579979551 +0000 UTC m=+34.108048170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db22aafa-06fa-48ee-b31f-69581a977745-metrics-tls") pod "dns-default-pwnms" (UID: "db22aafa-06fa-48ee-b31f-69581a977745") : secret "dns-default-metrics-tls" not found May 27 20:12:04.080175 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:04.080153 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db22aafa-06fa-48ee-b31f-69581a977745-tmp-dir\") pod \"dns-default-pwnms\" (UID: \"db22aafa-06fa-48ee-b31f-69581a977745\") " pod="openshift-dns/dns-default-pwnms" May 27 20:12:04.080400 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:04.080383 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/db22aafa-06fa-48ee-b31f-69581a977745-config-volume\") pod \"dns-default-pwnms\" (UID: \"db22aafa-06fa-48ee-b31f-69581a977745\") " pod="openshift-dns/dns-default-pwnms" May 27 20:12:04.090470 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:04.090438 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hn8b\" (UniqueName: \"kubernetes.io/projected/db22aafa-06fa-48ee-b31f-69581a977745-kube-api-access-5hn8b\") pod \"dns-default-pwnms\" (UID: \"db22aafa-06fa-48ee-b31f-69581a977745\") " pod="openshift-dns/dns-default-pwnms" May 27 20:12:04.180372 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:04.180334 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zj9wb\" (UniqueName: \"kubernetes.io/projected/b59afc02-dbe6-4e59-b84a-f7c108bd70e3-kube-api-access-zj9wb\") pod \"ingress-canary-jqxt2\" (UID: \"b59afc02-dbe6-4e59-b84a-f7c108bd70e3\") " pod="openshift-ingress-canary/ingress-canary-jqxt2" May 27 20:12:04.180515 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:04.180414 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b59afc02-dbe6-4e59-b84a-f7c108bd70e3-cert\") pod \"ingress-canary-jqxt2\" (UID: \"b59afc02-dbe6-4e59-b84a-f7c108bd70e3\") " pod="openshift-ingress-canary/ingress-canary-jqxt2" May 27 20:12:04.180556 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:04.180519 2554 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 20:12:04.180617 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:04.180587 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b59afc02-dbe6-4e59-b84a-f7c108bd70e3-cert podName:b59afc02-dbe6-4e59-b84a-f7c108bd70e3 nodeName:}" failed. No retries permitted until 2026-05-27 20:12:04.680560116 +0000 UTC m=+34.208628747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b59afc02-dbe6-4e59-b84a-f7c108bd70e3-cert") pod "ingress-canary-jqxt2" (UID: "b59afc02-dbe6-4e59-b84a-f7c108bd70e3") : secret "canary-serving-cert" not found May 27 20:12:04.191270 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:04.191239 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj9wb\" (UniqueName: \"kubernetes.io/projected/b59afc02-dbe6-4e59-b84a-f7c108bd70e3-kube-api-access-zj9wb\") pod \"ingress-canary-jqxt2\" (UID: \"b59afc02-dbe6-4e59-b84a-f7c108bd70e3\") " pod="openshift-ingress-canary/ingress-canary-jqxt2" May 27 20:12:04.582941 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:04.582901 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db22aafa-06fa-48ee-b31f-69581a977745-metrics-tls\") pod \"dns-default-pwnms\" (UID: \"db22aafa-06fa-48ee-b31f-69581a977745\") " pod="openshift-dns/dns-default-pwnms" May 27 20:12:04.583169 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:04.583050 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 20:12:04.583169 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:04.583119 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db22aafa-06fa-48ee-b31f-69581a977745-metrics-tls podName:db22aafa-06fa-48ee-b31f-69581a977745 nodeName:}" failed. No retries permitted until 2026-05-27 20:12:05.583099808 +0000 UTC m=+35.111168445 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db22aafa-06fa-48ee-b31f-69581a977745-metrics-tls") pod "dns-default-pwnms" (UID: "db22aafa-06fa-48ee-b31f-69581a977745") : secret "dns-default-metrics-tls" not found May 27 20:12:04.683288 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:04.683252 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b59afc02-dbe6-4e59-b84a-f7c108bd70e3-cert\") pod \"ingress-canary-jqxt2\" (UID: \"b59afc02-dbe6-4e59-b84a-f7c108bd70e3\") " pod="openshift-ingress-canary/ingress-canary-jqxt2" May 27 20:12:04.683441 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:04.683296 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-metrics-certs\") pod \"network-metrics-daemon-5jv8k\" (UID: \"a51bfffe-2896-4ffe-84b0-23a5b5127cdd\") " pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:12:04.683441 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:04.683403 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 20:12:04.683441 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:04.683403 2554 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 20:12:04.683558 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:04.683472 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b59afc02-dbe6-4e59-b84a-f7c108bd70e3-cert podName:b59afc02-dbe6-4e59-b84a-f7c108bd70e3 nodeName:}" failed. No retries permitted until 2026-05-27 20:12:05.683454722 +0000 UTC m=+35.211523356 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b59afc02-dbe6-4e59-b84a-f7c108bd70e3-cert") pod "ingress-canary-jqxt2" (UID: "b59afc02-dbe6-4e59-b84a-f7c108bd70e3") : secret "canary-serving-cert" not found May 27 20:12:04.683558 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:04.683487 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-metrics-certs podName:a51bfffe-2896-4ffe-84b0-23a5b5127cdd nodeName:}" failed. No retries permitted until 2026-05-27 20:12:36.683479896 +0000 UTC m=+66.211548516 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-metrics-certs") pod "network-metrics-daemon-5jv8k" (UID: "a51bfffe-2896-4ffe-84b0-23a5b5127cdd") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 20:12:04.784119 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:04.784082 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqdft\" (UniqueName: \"kubernetes.io/projected/d572187c-753d-447a-8232-d89446920689-kube-api-access-mqdft\") pod \"network-check-target-hm2h8\" (UID: \"d572187c-753d-447a-8232-d89446920689\") " pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:12:04.784281 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:04.784238 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 20:12:04.784281 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:04.784258 2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 20:12:04.784281 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:04.784268 2554 projected.go:194] Error preparing data for projected volume kube-api-access-mqdft for pod openshift-network-diagnostics/network-check-target-hm2h8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 20:12:04.784387 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:04.784321 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d572187c-753d-447a-8232-d89446920689-kube-api-access-mqdft podName:d572187c-753d-447a-8232-d89446920689 nodeName:}" failed. No retries permitted until 2026-05-27 20:12:36.784304928 +0000 UTC m=+66.312373554 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mqdft" (UniqueName: "kubernetes.io/projected/d572187c-753d-447a-8232-d89446920689-kube-api-access-mqdft") pod "network-check-target-hm2h8" (UID: "d572187c-753d-447a-8232-d89446920689") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 20:12:05.050635 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:05.050576 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:12:05.050635 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:05.050615 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:12:05.053874 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:05.053845 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 20:12:05.054015 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:05.053886 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 20:12:05.054015 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:05.053937 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b7jlg\"" May 27 20:12:05.054015 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:05.053966 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g79gn\"" May 27 20:12:05.054170 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:05.054055 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 20:12:05.589831 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:05.589788 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db22aafa-06fa-48ee-b31f-69581a977745-metrics-tls\") pod \"dns-default-pwnms\" (UID: \"db22aafa-06fa-48ee-b31f-69581a977745\") " pod="openshift-dns/dns-default-pwnms" May 27 20:12:05.589996 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:05.589958 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 20:12:05.590043 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:05.590022 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db22aafa-06fa-48ee-b31f-69581a977745-metrics-tls podName:db22aafa-06fa-48ee-b31f-69581a977745 nodeName:}" failed. No retries permitted until 2026-05-27 20:12:07.590006396 +0000 UTC m=+37.118075021 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db22aafa-06fa-48ee-b31f-69581a977745-metrics-tls") pod "dns-default-pwnms" (UID: "db22aafa-06fa-48ee-b31f-69581a977745") : secret "dns-default-metrics-tls" not found May 27 20:12:05.690307 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:05.690266 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b59afc02-dbe6-4e59-b84a-f7c108bd70e3-cert\") pod \"ingress-canary-jqxt2\" (UID: \"b59afc02-dbe6-4e59-b84a-f7c108bd70e3\") " pod="openshift-ingress-canary/ingress-canary-jqxt2" May 27 20:12:05.690473 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:05.690428 2554 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 20:12:05.690525 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:05.690504 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b59afc02-dbe6-4e59-b84a-f7c108bd70e3-cert podName:b59afc02-dbe6-4e59-b84a-f7c108bd70e3 nodeName:}" failed. No retries permitted until 2026-05-27 20:12:07.690488809 +0000 UTC m=+37.218557435 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b59afc02-dbe6-4e59-b84a-f7c108bd70e3-cert") pod "ingress-canary-jqxt2" (UID: "b59afc02-dbe6-4e59-b84a-f7c108bd70e3") : secret "canary-serving-cert" not found May 27 20:12:07.605174 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:07.604967 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db22aafa-06fa-48ee-b31f-69581a977745-metrics-tls\") pod \"dns-default-pwnms\" (UID: \"db22aafa-06fa-48ee-b31f-69581a977745\") " pod="openshift-dns/dns-default-pwnms" May 27 20:12:07.605559 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:07.605117 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 20:12:07.605559 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:07.605302 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db22aafa-06fa-48ee-b31f-69581a977745-metrics-tls podName:db22aafa-06fa-48ee-b31f-69581a977745 nodeName:}" failed. No retries permitted until 2026-05-27 20:12:11.605281204 +0000 UTC m=+41.133349906 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db22aafa-06fa-48ee-b31f-69581a977745-metrics-tls") pod "dns-default-pwnms" (UID: "db22aafa-06fa-48ee-b31f-69581a977745") : secret "dns-default-metrics-tls" not found May 27 20:12:07.706337 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:07.706289 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b59afc02-dbe6-4e59-b84a-f7c108bd70e3-cert\") pod \"ingress-canary-jqxt2\" (UID: \"b59afc02-dbe6-4e59-b84a-f7c108bd70e3\") " pod="openshift-ingress-canary/ingress-canary-jqxt2" May 27 20:12:07.706512 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:07.706457 2554 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 20:12:07.706580 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:07.706568 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b59afc02-dbe6-4e59-b84a-f7c108bd70e3-cert podName:b59afc02-dbe6-4e59-b84a-f7c108bd70e3 nodeName:}" failed. No retries permitted until 2026-05-27 20:12:11.706544812 +0000 UTC m=+41.234613457 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b59afc02-dbe6-4e59-b84a-f7c108bd70e3-cert") pod "ingress-canary-jqxt2" (UID: "b59afc02-dbe6-4e59-b84a-f7c108bd70e3") : secret "canary-serving-cert" not found May 27 20:12:09.267251 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:09.267206 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69bpk" event={"ID":"19db3f5a-b350-4f80-960d-073d72ca4e4b","Type":"ContainerStarted","Data":"a27d86b31a50b57f97da47d0986a4d40ed72f9fbef16a609d0396e61b713b969"} May 27 20:12:10.273458 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:10.273422 2554 generic.go:358] "Generic (PLEG): container finished" podID="19db3f5a-b350-4f80-960d-073d72ca4e4b" containerID="a27d86b31a50b57f97da47d0986a4d40ed72f9fbef16a609d0396e61b713b969" exitCode=0 May 27 20:12:10.273851 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:10.273463 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69bpk" event={"ID":"19db3f5a-b350-4f80-960d-073d72ca4e4b","Type":"ContainerDied","Data":"a27d86b31a50b57f97da47d0986a4d40ed72f9fbef16a609d0396e61b713b969"} May 27 20:12:11.277589 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:11.277553 2554 generic.go:358] "Generic (PLEG): container finished" podID="19db3f5a-b350-4f80-960d-073d72ca4e4b" containerID="669a3182514a1b4a2fab8a28020be413f48d7d9d26d403e45d2607b38f6d1883" exitCode=0 May 27 20:12:11.277971 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:11.277597 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69bpk" event={"ID":"19db3f5a-b350-4f80-960d-073d72ca4e4b","Type":"ContainerDied","Data":"669a3182514a1b4a2fab8a28020be413f48d7d9d26d403e45d2607b38f6d1883"} May 27 20:12:11.634740 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:11.634649 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db22aafa-06fa-48ee-b31f-69581a977745-metrics-tls\") pod \"dns-default-pwnms\" (UID: \"db22aafa-06fa-48ee-b31f-69581a977745\") " pod="openshift-dns/dns-default-pwnms" May 27 20:12:11.634878 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:11.634789 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 20:12:11.634878 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:11.634852 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db22aafa-06fa-48ee-b31f-69581a977745-metrics-tls podName:db22aafa-06fa-48ee-b31f-69581a977745 nodeName:}" failed. No retries permitted until 2026-05-27 20:12:19.634833001 +0000 UTC m=+49.162901630 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db22aafa-06fa-48ee-b31f-69581a977745-metrics-tls") pod "dns-default-pwnms" (UID: "db22aafa-06fa-48ee-b31f-69581a977745") : secret "dns-default-metrics-tls" not found May 27 20:12:11.735182 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:11.735150 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b59afc02-dbe6-4e59-b84a-f7c108bd70e3-cert\") pod \"ingress-canary-jqxt2\" (UID: \"b59afc02-dbe6-4e59-b84a-f7c108bd70e3\") " pod="openshift-ingress-canary/ingress-canary-jqxt2" May 27 20:12:11.735318 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:11.735255 2554 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 20:12:11.735318 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:11.735305 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b59afc02-dbe6-4e59-b84a-f7c108bd70e3-cert podName:b59afc02-dbe6-4e59-b84a-f7c108bd70e3 nodeName:}" failed. No retries permitted until 2026-05-27 20:12:19.735289717 +0000 UTC m=+49.263358339 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b59afc02-dbe6-4e59-b84a-f7c108bd70e3-cert") pod "ingress-canary-jqxt2" (UID: "b59afc02-dbe6-4e59-b84a-f7c108bd70e3") : secret "canary-serving-cert" not found May 27 20:12:12.281664 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:12.281617 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69bpk" event={"ID":"19db3f5a-b350-4f80-960d-073d72ca4e4b","Type":"ContainerStarted","Data":"037606f6de3cb4b7d6f57c12c96f2ba7ec72f816f9e9565fe23d432804cb115e"} May 27 20:12:12.303399 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:12.303363 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-69bpk" podStartSLOduration=5.780774108 podStartE2EDuration="41.303348202s" podCreationTimestamp="2026-05-27 20:11:31 +0000 UTC" firstStartedPulling="2026-05-27 20:11:33.537125859 +0000 UTC m=+3.065194483" lastFinishedPulling="2026-05-27 20:12:09.059699954 +0000 UTC m=+38.587768577" observedRunningTime="2026-05-27 20:12:12.302262978 +0000 UTC m=+41.830331643" watchObservedRunningTime="2026-05-27 20:12:12.303348202 +0000 UTC m=+41.831416847" May 27 20:12:14.547127 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.547096 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kfvgn"] May 27 20:12:14.580616 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.580592 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-pb94r"] May 27 20:12:14.580775 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.580756 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kfvgn" May 27 20:12:14.583426 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.583404 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 27 20:12:14.583521 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.583404 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 27 20:12:14.583521 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.583407 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 27 20:12:14.583521 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.583500 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 27 20:12:14.584284 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.584258 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2rq9n\"" May 27 20:12:14.594408 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.594392 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kfvgn"] May 27 20:12:14.594509 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.594412 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-pb94r"] May 27 20:12:14.594565 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.594549 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-pb94r" May 27 20:12:14.596785 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.596766 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 27 20:12:14.596878 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.596767 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 27 20:12:14.596878 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.596865 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 27 20:12:14.597183 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.597167 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 27 20:12:14.597237 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.597207 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-hhlbr\"" May 27 20:12:14.601734 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.601714 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 27 20:12:14.651202 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.651178 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m9rnr"] May 27 20:12:14.654753 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.654710 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb578cb6-73de-4fe4-a720-1283d855030b-config\") pod \"console-operator-76dff48d59-pb94r\" (UID: \"bb578cb6-73de-4fe4-a720-1283d855030b\") " pod="openshift-console-operator/console-operator-76dff48d59-pb94r" May 27 20:12:14.654947 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.654924 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42327801-84b0-458e-9515-67ebe5684ff6-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-kfvgn\" (UID: \"42327801-84b0-458e-9515-67ebe5684ff6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kfvgn" May 27 20:12:14.655085 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.655070 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42327801-84b0-458e-9515-67ebe5684ff6-config\") pod \"kube-storage-version-migrator-operator-565644f49-kfvgn\" (UID: \"42327801-84b0-458e-9515-67ebe5684ff6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kfvgn" May 27 20:12:14.655213 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.655189 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb578cb6-73de-4fe4-a720-1283d855030b-serving-cert\") pod \"console-operator-76dff48d59-pb94r\" (UID: \"bb578cb6-73de-4fe4-a720-1283d855030b\") " pod="openshift-console-operator/console-operator-76dff48d59-pb94r" May 27 20:12:14.655318 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.655226 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb578cb6-73de-4fe4-a720-1283d855030b-trusted-ca\") pod \"console-operator-76dff48d59-pb94r\" (UID: \"bb578cb6-73de-4fe4-a720-1283d855030b\") " pod="openshift-console-operator/console-operator-76dff48d59-pb94r" May 27 20:12:14.655318 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.655243 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgb7w\" (UniqueName: \"kubernetes.io/projected/42327801-84b0-458e-9515-67ebe5684ff6-kube-api-access-qgb7w\") pod \"kube-storage-version-migrator-operator-565644f49-kfvgn\" (UID: \"42327801-84b0-458e-9515-67ebe5684ff6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kfvgn" May 27 20:12:14.655318 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.655268 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28tkz\" (UniqueName: \"kubernetes.io/projected/bb578cb6-73de-4fe4-a720-1283d855030b-kube-api-access-28tkz\") pod \"console-operator-76dff48d59-pb94r\" (UID: \"bb578cb6-73de-4fe4-a720-1283d855030b\") " pod="openshift-console-operator/console-operator-76dff48d59-pb94r" May 27 20:12:14.669171 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.669149 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-pcwwj"] May 27 20:12:14.669322 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.669303 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m9rnr" May 27 20:12:14.673047 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.673027 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5ks2z\"" May 27 20:12:14.673146 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.673056 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 27 20:12:14.673146 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.673127 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 27 20:12:14.688385 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.688365 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-mrhn2"] May 27 20:12:14.688506 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.688491 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" May 27 20:12:14.690736 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.690703 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 27 20:12:14.690883 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.690765 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 27 20:12:14.691047 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.691024 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 27 20:12:14.691154 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.691067 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 27 20:12:14.691154 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.691080 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jgds9\"" May 27 20:12:14.699760 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.699737 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 27 20:12:14.713543 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.713524 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-696899764b-7qrxr"] May 27 20:12:14.713700 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.713685 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mrhn2" May 27 20:12:14.716171 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.716153 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 27 20:12:14.716171 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.716164 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 27 20:12:14.716338 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.716218 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bnlgz\"" May 27 20:12:14.716338 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.716231 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 27 20:12:14.716338 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.716300 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 27 20:12:14.731819 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.731798 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-775798d4bd-pxkp7"] May 27 20:12:14.731909 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.731899 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:14.734155 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.734140 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 27 20:12:14.734249 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.734140 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 27 20:12:14.734249 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.734158 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vnh8k\"" May 27 20:12:14.734444 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.734430 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 27 20:12:14.734497 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.734475 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 27 20:12:14.734557 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.734507 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 27 20:12:14.734557 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.734509 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 27 20:12:14.755080 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.755061 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m9rnr"] May 27 20:12:14.755158 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.755085 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-pcwwj"] May 27 20:12:14.755158 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.755095 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-mrhn2"] May 27 20:12:14.755158 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.755102 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-696899764b-7qrxr"] May 27 20:12:14.755158 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.755112 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-775798d4bd-pxkp7"] May 27 20:12:14.755288 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.755188 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:14.755510 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.755492 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb578cb6-73de-4fe4-a720-1283d855030b-trusted-ca\") pod \"console-operator-76dff48d59-pb94r\" (UID: \"bb578cb6-73de-4fe4-a720-1283d855030b\") " pod="openshift-console-operator/console-operator-76dff48d59-pb94r" May 27 20:12:14.755586 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.755519 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qgb7w\" (UniqueName: \"kubernetes.io/projected/42327801-84b0-458e-9515-67ebe5684ff6-kube-api-access-qgb7w\") pod \"kube-storage-version-migrator-operator-565644f49-kfvgn\" (UID: \"42327801-84b0-458e-9515-67ebe5684ff6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kfvgn" May 27 20:12:14.755586 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.755546 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28tkz\" (UniqueName: \"kubernetes.io/projected/bb578cb6-73de-4fe4-a720-1283d855030b-kube-api-access-28tkz\") pod \"console-operator-76dff48d59-pb94r\" (UID: \"bb578cb6-73de-4fe4-a720-1283d855030b\") " pod="openshift-console-operator/console-operator-76dff48d59-pb94r" May 27 20:12:14.755586 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.755574 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f237de37-4fce-4257-af56-52a222da551a-snapshots\") pod \"insights-operator-78bdfb888c-pcwwj\" (UID: \"f237de37-4fce-4257-af56-52a222da551a\") " pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" May 27 20:12:14.755742 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.755616 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1c0112d8-ba42-4e30-95fd-d8b4554622fc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-mrhn2\" (UID: \"1c0112d8-ba42-4e30-95fd-d8b4554622fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mrhn2" May 27 20:12:14.755742 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.755671 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hb25\" (UniqueName: \"kubernetes.io/projected/1c0112d8-ba42-4e30-95fd-d8b4554622fc-kube-api-access-2hb25\") pod \"cluster-monitoring-operator-6c75959455-mrhn2\" (UID: \"1c0112d8-ba42-4e30-95fd-d8b4554622fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mrhn2" May 27 20:12:14.755742 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.755697 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f237de37-4fce-4257-af56-52a222da551a-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-pcwwj\" (UID: \"f237de37-4fce-4257-af56-52a222da551a\") " pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" May 27 20:12:14.755888 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.755774 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb578cb6-73de-4fe4-a720-1283d855030b-config\") pod \"console-operator-76dff48d59-pb94r\" (UID: \"bb578cb6-73de-4fe4-a720-1283d855030b\") " pod="openshift-console-operator/console-operator-76dff48d59-pb94r" May 27 20:12:14.755888 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.755801 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f237de37-4fce-4257-af56-52a222da551a-tmp\") pod \"insights-operator-78bdfb888c-pcwwj\" (UID: \"f237de37-4fce-4257-af56-52a222da551a\") " pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" May 27 20:12:14.755888 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.755826 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f237de37-4fce-4257-af56-52a222da551a-service-ca-bundle\") pod \"insights-operator-78bdfb888c-pcwwj\" (UID: \"f237de37-4fce-4257-af56-52a222da551a\") " pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" May 27 20:12:14.755888 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.755852 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-service-ca-bundle\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:14.755888 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.755878 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-metrics-certs\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:14.756059 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.755937 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1c0112d8-ba42-4e30-95fd-d8b4554622fc-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-mrhn2\" (UID: \"1c0112d8-ba42-4e30-95fd-d8b4554622fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mrhn2" May 27 20:12:14.756059 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.755985 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7m68\" (UniqueName: \"kubernetes.io/projected/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-kube-api-access-q7m68\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:14.756059 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.756020 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42327801-84b0-458e-9515-67ebe5684ff6-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-kfvgn\" (UID: \"42327801-84b0-458e-9515-67ebe5684ff6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kfvgn" May 27 20:12:14.756059 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.756047 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwwtv\" (UniqueName: \"kubernetes.io/projected/f237de37-4fce-4257-af56-52a222da551a-kube-api-access-cwwtv\") pod \"insights-operator-78bdfb888c-pcwwj\" (UID: \"f237de37-4fce-4257-af56-52a222da551a\") " pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" May 27 20:12:14.756228 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.756074 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-stats-auth\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:14.756228 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.756116 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f237de37-4fce-4257-af56-52a222da551a-serving-cert\") pod \"insights-operator-78bdfb888c-pcwwj\" (UID: \"f237de37-4fce-4257-af56-52a222da551a\") " pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" May 27 20:12:14.756228 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.756142 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88744\" (UniqueName: \"kubernetes.io/projected/97288a13-4a11-4860-ab23-8d4f178e65fb-kube-api-access-88744\") pod \"volume-data-source-validator-5cf8c89d64-m9rnr\" (UID: \"97288a13-4a11-4860-ab23-8d4f178e65fb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m9rnr" May 27 20:12:14.756228 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.756173 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42327801-84b0-458e-9515-67ebe5684ff6-config\") pod \"kube-storage-version-migrator-operator-565644f49-kfvgn\" (UID: \"42327801-84b0-458e-9515-67ebe5684ff6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kfvgn" May 27 20:12:14.756228 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.756201 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb578cb6-73de-4fe4-a720-1283d855030b-serving-cert\") pod \"console-operator-76dff48d59-pb94r\" (UID: \"bb578cb6-73de-4fe4-a720-1283d855030b\") " pod="openshift-console-operator/console-operator-76dff48d59-pb94r" May 27 20:12:14.756458 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.756229 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-default-certificate\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:14.756458 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.756397 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb578cb6-73de-4fe4-a720-1283d855030b-config\") pod \"console-operator-76dff48d59-pb94r\" (UID: \"bb578cb6-73de-4fe4-a720-1283d855030b\") " pod="openshift-console-operator/console-operator-76dff48d59-pb94r" May 27 20:12:14.756565 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.756482 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb578cb6-73de-4fe4-a720-1283d855030b-trusted-ca\") pod \"console-operator-76dff48d59-pb94r\" (UID: \"bb578cb6-73de-4fe4-a720-1283d855030b\") " pod="openshift-console-operator/console-operator-76dff48d59-pb94r" May 27 20:12:14.756786 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.756769 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42327801-84b0-458e-9515-67ebe5684ff6-config\") pod \"kube-storage-version-migrator-operator-565644f49-kfvgn\" (UID: \"42327801-84b0-458e-9515-67ebe5684ff6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kfvgn" May 27 20:12:14.757278 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.757255 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 27 20:12:14.757379 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.757302 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vxj6j\"" May 27 20:12:14.757587 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.757569 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 27 20:12:14.757587 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.757579 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 27 20:12:14.759540 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.759521 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42327801-84b0-458e-9515-67ebe5684ff6-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-kfvgn\" (UID: \"42327801-84b0-458e-9515-67ebe5684ff6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kfvgn" May 27 20:12:14.759711 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.759586 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb578cb6-73de-4fe4-a720-1283d855030b-serving-cert\") pod \"console-operator-76dff48d59-pb94r\" (UID: \"bb578cb6-73de-4fe4-a720-1283d855030b\") " pod="openshift-console-operator/console-operator-76dff48d59-pb94r" May 27 20:12:14.763491 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.763470 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 27 20:12:14.766451 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.766417 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgb7w\" (UniqueName: \"kubernetes.io/projected/42327801-84b0-458e-9515-67ebe5684ff6-kube-api-access-qgb7w\") pod \"kube-storage-version-migrator-operator-565644f49-kfvgn\" (UID: \"42327801-84b0-458e-9515-67ebe5684ff6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kfvgn" May 27 20:12:14.767480 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.767465 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28tkz\" (UniqueName: \"kubernetes.io/projected/bb578cb6-73de-4fe4-a720-1283d855030b-kube-api-access-28tkz\") pod \"console-operator-76dff48d59-pb94r\" (UID: \"bb578cb6-73de-4fe4-a720-1283d855030b\") " pod="openshift-console-operator/console-operator-76dff48d59-pb94r" May 27 20:12:14.857100 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857036 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6fbb9f64-eea9-4507-a785-4ad5104b601d-image-registry-private-configuration\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:14.857100 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857075 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f237de37-4fce-4257-af56-52a222da551a-snapshots\") pod \"insights-operator-78bdfb888c-pcwwj\" (UID: \"f237de37-4fce-4257-af56-52a222da551a\") " pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" May 27 20:12:14.857100 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857098 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-metrics-certs\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:14.857319 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857117 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-certificates\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:14.857319 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857135 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1c0112d8-ba42-4e30-95fd-d8b4554622fc-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-mrhn2\" (UID: \"1c0112d8-ba42-4e30-95fd-d8b4554622fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mrhn2" May 27 20:12:14.857319 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857151 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q7m68\" (UniqueName: \"kubernetes.io/projected/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-kube-api-access-q7m68\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:14.857319 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857167 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cwwtv\" (UniqueName: \"kubernetes.io/projected/f237de37-4fce-4257-af56-52a222da551a-kube-api-access-cwwtv\") pod \"insights-operator-78bdfb888c-pcwwj\" (UID: \"f237de37-4fce-4257-af56-52a222da551a\") " pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" May 27 20:12:14.857319 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:14.857178 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 20:12:14.857319 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857194 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2hb25\" (UniqueName: \"kubernetes.io/projected/1c0112d8-ba42-4e30-95fd-d8b4554622fc-kube-api-access-2hb25\") pod \"cluster-monitoring-operator-6c75959455-mrhn2\" (UID: \"1c0112d8-ba42-4e30-95fd-d8b4554622fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mrhn2" May 27 20:12:14.857319 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857222 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6fbb9f64-eea9-4507-a785-4ad5104b601d-trusted-ca\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:14.857319 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:14.857244 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-metrics-certs podName:b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f nodeName:}" failed. No retries permitted until 2026-05-27 20:12:15.357224148 +0000 UTC m=+44.885292769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-metrics-certs") pod "router-default-696899764b-7qrxr" (UID: "b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f") : secret "router-metrics-certs-default" not found May 27 20:12:14.857703 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857337 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6fbb9f64-eea9-4507-a785-4ad5104b601d-installation-pull-secrets\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:14.857703 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857390 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1c0112d8-ba42-4e30-95fd-d8b4554622fc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-mrhn2\" (UID: \"1c0112d8-ba42-4e30-95fd-d8b4554622fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mrhn2" May 27 20:12:14.857703 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857418 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6fbb9f64-eea9-4507-a785-4ad5104b601d-ca-trust-extracted\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:14.857703 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857441 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f237de37-4fce-4257-af56-52a222da551a-tmp\") pod \"insights-operator-78bdfb888c-pcwwj\" (UID: \"f237de37-4fce-4257-af56-52a222da551a\") " pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" May 27 20:12:14.857703 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:14.857498 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 20:12:14.857703 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857505 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-service-ca-bundle\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:14.857703 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857539 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-stats-auth\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:14.857703 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:14.857562 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c0112d8-ba42-4e30-95fd-d8b4554622fc-cluster-monitoring-operator-tls podName:1c0112d8-ba42-4e30-95fd-d8b4554622fc nodeName:}" failed. No retries permitted until 2026-05-27 20:12:15.357545318 +0000 UTC m=+44.885613956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1c0112d8-ba42-4e30-95fd-d8b4554622fc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-mrhn2" (UID: "1c0112d8-ba42-4e30-95fd-d8b4554622fc") : secret "cluster-monitoring-operator-tls" not found May 27 20:12:14.857703 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857675 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5qtr\" (UniqueName: \"kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-kube-api-access-c5qtr\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:14.857703 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:14.857704 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-service-ca-bundle podName:b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f nodeName:}" failed. No retries permitted until 2026-05-27 20:12:15.357687068 +0000 UTC m=+44.885755687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-service-ca-bundle") pod "router-default-696899764b-7qrxr" (UID: "b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f") : configmap references non-existent config key: service-ca.crt May 27 20:12:14.858130 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857742 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f237de37-4fce-4257-af56-52a222da551a-service-ca-bundle\") pod \"insights-operator-78bdfb888c-pcwwj\" (UID: \"f237de37-4fce-4257-af56-52a222da551a\") " pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" May 27 20:12:14.858130 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857782 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-tls\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:14.858130 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857815 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f237de37-4fce-4257-af56-52a222da551a-serving-cert\") pod \"insights-operator-78bdfb888c-pcwwj\" (UID: \"f237de37-4fce-4257-af56-52a222da551a\") " pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" May 27 20:12:14.858130 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857833 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f237de37-4fce-4257-af56-52a222da551a-snapshots\") pod \"insights-operator-78bdfb888c-pcwwj\" (UID: \"f237de37-4fce-4257-af56-52a222da551a\") " pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" May 27 20:12:14.858130 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857840 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88744\" (UniqueName: \"kubernetes.io/projected/97288a13-4a11-4860-ab23-8d4f178e65fb-kube-api-access-88744\") pod \"volume-data-source-validator-5cf8c89d64-m9rnr\" (UID: \"97288a13-4a11-4860-ab23-8d4f178e65fb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m9rnr" May 27 20:12:14.858130 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857743 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f237de37-4fce-4257-af56-52a222da551a-tmp\") pod \"insights-operator-78bdfb888c-pcwwj\" (UID: \"f237de37-4fce-4257-af56-52a222da551a\") " pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" May 27 20:12:14.858130 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857867 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-bound-sa-token\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:14.858130 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857895 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f237de37-4fce-4257-af56-52a222da551a-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-pcwwj\" (UID: \"f237de37-4fce-4257-af56-52a222da551a\") " pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" May 27 20:12:14.858130 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857931 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-default-certificate\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:14.858130 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.857944 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1c0112d8-ba42-4e30-95fd-d8b4554622fc-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-mrhn2\" (UID: \"1c0112d8-ba42-4e30-95fd-d8b4554622fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mrhn2" May 27 20:12:14.858513 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.858247 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f237de37-4fce-4257-af56-52a222da551a-service-ca-bundle\") pod \"insights-operator-78bdfb888c-pcwwj\" (UID: \"f237de37-4fce-4257-af56-52a222da551a\") " pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" May 27 20:12:14.858715 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.858699 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f237de37-4fce-4257-af56-52a222da551a-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-pcwwj\" (UID: \"f237de37-4fce-4257-af56-52a222da551a\") " pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" May 27 20:12:14.860193 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.860178 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-default-certificate\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:14.860317 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.860300 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f237de37-4fce-4257-af56-52a222da551a-serving-cert\") pod \"insights-operator-78bdfb888c-pcwwj\" (UID: \"f237de37-4fce-4257-af56-52a222da551a\") " pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" May 27 20:12:14.860442 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.860423 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-stats-auth\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:14.872893 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.872865 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7m68\" (UniqueName: \"kubernetes.io/projected/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-kube-api-access-q7m68\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:14.872893 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.872875 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hb25\" (UniqueName: \"kubernetes.io/projected/1c0112d8-ba42-4e30-95fd-d8b4554622fc-kube-api-access-2hb25\") pod \"cluster-monitoring-operator-6c75959455-mrhn2\" (UID: \"1c0112d8-ba42-4e30-95fd-d8b4554622fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mrhn2" May 27 20:12:14.873237 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.873215 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88744\" (UniqueName: \"kubernetes.io/projected/97288a13-4a11-4860-ab23-8d4f178e65fb-kube-api-access-88744\") pod \"volume-data-source-validator-5cf8c89d64-m9rnr\" (UID: \"97288a13-4a11-4860-ab23-8d4f178e65fb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m9rnr" May 27 20:12:14.873462 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.873446 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwwtv\" (UniqueName: \"kubernetes.io/projected/f237de37-4fce-4257-af56-52a222da551a-kube-api-access-cwwtv\") pod \"insights-operator-78bdfb888c-pcwwj\" (UID: \"f237de37-4fce-4257-af56-52a222da551a\") " pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" May 27 20:12:14.889101 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.889085 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kfvgn" May 27 20:12:14.903883 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.903864 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-pb94r" May 27 20:12:14.958844 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.958811 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-tls\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:14.958844 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.958848 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-bound-sa-token\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:14.959054 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.958877 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6fbb9f64-eea9-4507-a785-4ad5104b601d-image-registry-private-configuration\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:14.959054 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.958918 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-certificates\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:14.959054 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.958948 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6fbb9f64-eea9-4507-a785-4ad5104b601d-trusted-ca\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:14.959054 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.958971 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6fbb9f64-eea9-4507-a785-4ad5104b601d-installation-pull-secrets\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:14.959054 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.959001 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6fbb9f64-eea9-4507-a785-4ad5104b601d-ca-trust-extracted\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:14.959054 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.959038 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c5qtr\" (UniqueName: \"kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-kube-api-access-c5qtr\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:14.959347 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:14.958969 2554 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 20:12:14.959347 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:14.959088 2554 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775798d4bd-pxkp7: secret "image-registry-tls" not found May 27 20:12:14.959347 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:14.959141 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-tls podName:6fbb9f64-eea9-4507-a785-4ad5104b601d nodeName:}" failed. No retries permitted until 2026-05-27 20:12:15.45912752 +0000 UTC m=+44.987196140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-tls") pod "image-registry-775798d4bd-pxkp7" (UID: "6fbb9f64-eea9-4507-a785-4ad5104b601d") : secret "image-registry-tls" not found May 27 20:12:14.959508 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.959479 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6fbb9f64-eea9-4507-a785-4ad5104b601d-ca-trust-extracted\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:14.959580 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.959557 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-certificates\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:14.960065 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.960040 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6fbb9f64-eea9-4507-a785-4ad5104b601d-trusted-ca\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:14.961222 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.961205 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6fbb9f64-eea9-4507-a785-4ad5104b601d-installation-pull-secrets\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:14.961275 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.961237 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6fbb9f64-eea9-4507-a785-4ad5104b601d-image-registry-private-configuration\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:14.970123 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.970098 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5qtr\" (UniqueName: \"kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-kube-api-access-c5qtr\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:14.970421 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.970401 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-bound-sa-token\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:14.979679 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.979241 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m9rnr" May 27 20:12:14.997702 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:14.997526 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" May 27 20:12:15.106345 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:15.106314 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-pb94r"] May 27 20:12:15.110235 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:12:15.110189 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb578cb6_73de_4fe4_a720_1283d855030b.slice/crio-ba16594127f4d5d106262e4c8c04129507d5d1c353b22cc361afd4606cca2d48 WatchSource:0}: Error finding container ba16594127f4d5d106262e4c8c04129507d5d1c353b22cc361afd4606cca2d48: Status 404 returned error can't find the container with id ba16594127f4d5d106262e4c8c04129507d5d1c353b22cc361afd4606cca2d48 May 27 20:12:15.140013 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:15.139988 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m9rnr"] May 27 20:12:15.143566 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:12:15.143541 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97288a13_4a11_4860_ab23_8d4f178e65fb.slice/crio-1e1c9db282aa4956af9d3625e909f73f0a051b37d074a4a29546062f35b0d02f WatchSource:0}: Error finding container 1e1c9db282aa4956af9d3625e909f73f0a051b37d074a4a29546062f35b0d02f: Status 404 returned error can't find the container with id 1e1c9db282aa4956af9d3625e909f73f0a051b37d074a4a29546062f35b0d02f May 27 20:12:15.167165 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:15.167139 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-pcwwj"] May 27 20:12:15.169668 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:12:15.169644 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf237de37_4fce_4257_af56_52a222da551a.slice/crio-2c155990cfea6175d5b5fa38ae8968fc16fba94294a4df0025d636c8623564b5 WatchSource:0}: Error finding container 2c155990cfea6175d5b5fa38ae8968fc16fba94294a4df0025d636c8623564b5: Status 404 returned error can't find the container with id 2c155990cfea6175d5b5fa38ae8968fc16fba94294a4df0025d636c8623564b5 May 27 20:12:15.266786 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:15.266759 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kfvgn"] May 27 20:12:15.269246 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:12:15.269221 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42327801_84b0_458e_9515_67ebe5684ff6.slice/crio-a32726af6509fd8dd26ac57aa54ce117511d18447d8426b7043a27a6623ed225 WatchSource:0}: Error finding container a32726af6509fd8dd26ac57aa54ce117511d18447d8426b7043a27a6623ed225: Status 404 returned error can't find the container with id a32726af6509fd8dd26ac57aa54ce117511d18447d8426b7043a27a6623ed225 May 27 20:12:15.288601 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:15.288557 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m9rnr" event={"ID":"97288a13-4a11-4860-ab23-8d4f178e65fb","Type":"ContainerStarted","Data":"1e1c9db282aa4956af9d3625e909f73f0a051b37d074a4a29546062f35b0d02f"} May 27 20:12:15.289477 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:15.289456 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kfvgn" event={"ID":"42327801-84b0-458e-9515-67ebe5684ff6","Type":"ContainerStarted","Data":"a32726af6509fd8dd26ac57aa54ce117511d18447d8426b7043a27a6623ed225"} May 27 20:12:15.290481 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:15.290463 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-pb94r" event={"ID":"bb578cb6-73de-4fe4-a720-1283d855030b","Type":"ContainerStarted","Data":"ba16594127f4d5d106262e4c8c04129507d5d1c353b22cc361afd4606cca2d48"} May 27 20:12:15.291355 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:15.291338 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" event={"ID":"f237de37-4fce-4257-af56-52a222da551a","Type":"ContainerStarted","Data":"2c155990cfea6175d5b5fa38ae8968fc16fba94294a4df0025d636c8623564b5"} May 27 20:12:15.364341 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:15.364284 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-service-ca-bundle\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:15.364443 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:15.364353 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-metrics-certs\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:15.364443 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:15.364405 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1c0112d8-ba42-4e30-95fd-d8b4554622fc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-mrhn2\" (UID: \"1c0112d8-ba42-4e30-95fd-d8b4554622fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mrhn2" May 27 20:12:15.364561 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:15.364473 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-service-ca-bundle podName:b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f nodeName:}" failed. No retries permitted until 2026-05-27 20:12:16.364449341 +0000 UTC m=+45.892517978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-service-ca-bundle") pod "router-default-696899764b-7qrxr" (UID: "b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f") : configmap references non-existent config key: service-ca.crt May 27 20:12:15.364561 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:15.364511 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 20:12:15.364690 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:15.364562 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c0112d8-ba42-4e30-95fd-d8b4554622fc-cluster-monitoring-operator-tls podName:1c0112d8-ba42-4e30-95fd-d8b4554622fc nodeName:}" failed. No retries permitted until 2026-05-27 20:12:16.36454284 +0000 UTC m=+45.892611459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1c0112d8-ba42-4e30-95fd-d8b4554622fc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-mrhn2" (UID: "1c0112d8-ba42-4e30-95fd-d8b4554622fc") : secret "cluster-monitoring-operator-tls" not found May 27 20:12:15.364690 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:15.364511 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 20:12:15.364690 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:15.364593 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-metrics-certs podName:b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f nodeName:}" failed. No retries permitted until 2026-05-27 20:12:16.364586643 +0000 UTC m=+45.892655263 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-metrics-certs") pod "router-default-696899764b-7qrxr" (UID: "b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f") : secret "router-metrics-certs-default" not found May 27 20:12:15.465126 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:15.465095 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-tls\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:15.465256 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:15.465236 2554 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 20:12:15.465299 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:15.465259 2554 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775798d4bd-pxkp7: secret "image-registry-tls" not found May 27 20:12:15.465332 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:15.465310 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-tls podName:6fbb9f64-eea9-4507-a785-4ad5104b601d nodeName:}" failed. No retries permitted until 2026-05-27 20:12:16.465295329 +0000 UTC m=+45.993363949 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-tls") pod "image-registry-775798d4bd-pxkp7" (UID: "6fbb9f64-eea9-4507-a785-4ad5104b601d") : secret "image-registry-tls" not found May 27 20:12:16.373044 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:16.372982 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-metrics-certs\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:16.373532 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:16.373094 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1c0112d8-ba42-4e30-95fd-d8b4554622fc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-mrhn2\" (UID: \"1c0112d8-ba42-4e30-95fd-d8b4554622fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mrhn2" May 27 20:12:16.373532 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:16.373249 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 20:12:16.373532 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:16.373323 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 20:12:16.373722 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:16.373707 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-service-ca-bundle\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:16.373865 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:16.373846 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-service-ca-bundle podName:b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f nodeName:}" failed. No retries permitted until 2026-05-27 20:12:18.373825291 +0000 UTC m=+47.901893927 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-service-ca-bundle") pod "router-default-696899764b-7qrxr" (UID: "b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f") : configmap references non-existent config key: service-ca.crt May 27 20:12:16.373924 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:16.373877 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-metrics-certs podName:b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f nodeName:}" failed. No retries permitted until 2026-05-27 20:12:18.373865923 +0000 UTC m=+47.901934544 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-metrics-certs") pod "router-default-696899764b-7qrxr" (UID: "b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f") : secret "router-metrics-certs-default" not found May 27 20:12:16.373924 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:16.373893 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c0112d8-ba42-4e30-95fd-d8b4554622fc-cluster-monitoring-operator-tls podName:1c0112d8-ba42-4e30-95fd-d8b4554622fc nodeName:}" failed. No retries permitted until 2026-05-27 20:12:18.373884306 +0000 UTC m=+47.901952927 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1c0112d8-ba42-4e30-95fd-d8b4554622fc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-mrhn2" (UID: "1c0112d8-ba42-4e30-95fd-d8b4554622fc") : secret "cluster-monitoring-operator-tls" not found May 27 20:12:16.475209 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:16.474867 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-tls\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:16.475209 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:16.475040 2554 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 20:12:16.475209 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:16.475059 2554 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775798d4bd-pxkp7: secret "image-registry-tls" not found May 27 20:12:16.475209 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:16.475117 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-tls podName:6fbb9f64-eea9-4507-a785-4ad5104b601d nodeName:}" failed. No retries permitted until 2026-05-27 20:12:18.475098481 +0000 UTC m=+48.003167108 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-tls") pod "image-registry-775798d4bd-pxkp7" (UID: "6fbb9f64-eea9-4507-a785-4ad5104b601d") : secret "image-registry-tls" not found May 27 20:12:18.393916 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:18.393850 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-metrics-certs\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:18.394287 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:18.393995 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 20:12:18.394287 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:18.394048 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1c0112d8-ba42-4e30-95fd-d8b4554622fc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-mrhn2\" (UID: \"1c0112d8-ba42-4e30-95fd-d8b4554622fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mrhn2" May 27 20:12:18.394287 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:18.394058 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-metrics-certs podName:b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f nodeName:}" failed. No retries permitted until 2026-05-27 20:12:22.394043738 +0000 UTC m=+51.922112358 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-metrics-certs") pod "router-default-696899764b-7qrxr" (UID: "b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f") : secret "router-metrics-certs-default" not found May 27 20:12:18.394287 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:18.394086 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-service-ca-bundle\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:18.394287 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:18.394165 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 20:12:18.394287 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:18.394210 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c0112d8-ba42-4e30-95fd-d8b4554622fc-cluster-monitoring-operator-tls podName:1c0112d8-ba42-4e30-95fd-d8b4554622fc nodeName:}" failed. No retries permitted until 2026-05-27 20:12:22.394198737 +0000 UTC m=+51.922267357 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1c0112d8-ba42-4e30-95fd-d8b4554622fc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-mrhn2" (UID: "1c0112d8-ba42-4e30-95fd-d8b4554622fc") : secret "cluster-monitoring-operator-tls" not found May 27 20:12:18.394287 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:18.394223 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-service-ca-bundle podName:b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f nodeName:}" failed. No retries permitted until 2026-05-27 20:12:22.394217364 +0000 UTC m=+51.922285983 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-service-ca-bundle") pod "router-default-696899764b-7qrxr" (UID: "b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f") : configmap references non-existent config key: service-ca.crt May 27 20:12:18.495332 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:18.495298 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-tls\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:18.495508 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:18.495452 2554 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 20:12:18.495508 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:18.495475 2554 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775798d4bd-pxkp7: secret "image-registry-tls" not found May 27 20:12:18.495577 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:18.495544 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-tls podName:6fbb9f64-eea9-4507-a785-4ad5104b601d nodeName:}" failed. No retries permitted until 2026-05-27 20:12:22.495525455 +0000 UTC m=+52.023594094 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-tls") pod "image-registry-775798d4bd-pxkp7" (UID: "6fbb9f64-eea9-4507-a785-4ad5104b601d") : secret "image-registry-tls" not found May 27 20:12:19.706383 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:19.706353 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db22aafa-06fa-48ee-b31f-69581a977745-metrics-tls\") pod \"dns-default-pwnms\" (UID: \"db22aafa-06fa-48ee-b31f-69581a977745\") " pod="openshift-dns/dns-default-pwnms" May 27 20:12:19.706768 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:19.706472 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 20:12:19.706768 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:19.706528 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db22aafa-06fa-48ee-b31f-69581a977745-metrics-tls podName:db22aafa-06fa-48ee-b31f-69581a977745 nodeName:}" failed. No retries permitted until 2026-05-27 20:12:35.706511197 +0000 UTC m=+65.234579818 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db22aafa-06fa-48ee-b31f-69581a977745-metrics-tls") pod "dns-default-pwnms" (UID: "db22aafa-06fa-48ee-b31f-69581a977745") : secret "dns-default-metrics-tls" not found May 27 20:12:19.807574 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:19.807539 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b59afc02-dbe6-4e59-b84a-f7c108bd70e3-cert\") pod \"ingress-canary-jqxt2\" (UID: \"b59afc02-dbe6-4e59-b84a-f7c108bd70e3\") " pod="openshift-ingress-canary/ingress-canary-jqxt2" May 27 20:12:19.807746 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:19.807723 2554 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 20:12:19.807809 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:19.807799 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b59afc02-dbe6-4e59-b84a-f7c108bd70e3-cert podName:b59afc02-dbe6-4e59-b84a-f7c108bd70e3 nodeName:}" failed. No retries permitted until 2026-05-27 20:12:35.807778836 +0000 UTC m=+65.335847471 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b59afc02-dbe6-4e59-b84a-f7c108bd70e3-cert") pod "ingress-canary-jqxt2" (UID: "b59afc02-dbe6-4e59-b84a-f7c108bd70e3") : secret "canary-serving-cert" not found May 27 20:12:20.306569 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:20.306531 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kfvgn" event={"ID":"42327801-84b0-458e-9515-67ebe5684ff6","Type":"ContainerStarted","Data":"4457994eeac170fd834fb4afa220fdc9ae2cab41738f35c0cf4ff40875b469f7"} May 27 20:12:20.308171 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:20.308147 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pb94r_bb578cb6-73de-4fe4-a720-1283d855030b/console-operator/0.log" May 27 20:12:20.308306 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:20.308184 2554 generic.go:358] "Generic (PLEG): container finished" podID="bb578cb6-73de-4fe4-a720-1283d855030b" containerID="a979c717ea66cefa090311b42d2de55bdd439dbd23e9412f27fddfe4b218e0ad" exitCode=255 May 27 20:12:20.308306 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:20.308275 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-pb94r" event={"ID":"bb578cb6-73de-4fe4-a720-1283d855030b","Type":"ContainerDied","Data":"a979c717ea66cefa090311b42d2de55bdd439dbd23e9412f27fddfe4b218e0ad"} May 27 20:12:20.308500 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:20.308478 2554 scope.go:117] "RemoveContainer" containerID="a979c717ea66cefa090311b42d2de55bdd439dbd23e9412f27fddfe4b218e0ad" May 27 20:12:20.309687 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:20.309669 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" event={"ID":"f237de37-4fce-4257-af56-52a222da551a","Type":"ContainerStarted","Data":"bcbed587d071d4407cafae331bf96fe3edfcfcb4f8ab96918c169572ea6bdf18"} May 27 20:12:20.311052 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:20.311028 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m9rnr" event={"ID":"97288a13-4a11-4860-ab23-8d4f178e65fb","Type":"ContainerStarted","Data":"441560a82a9a3c8528a4dc0e44353a75379c80dce3ffed8d47e7565be78509b8"} May 27 20:12:20.322065 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:20.322027 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kfvgn" podStartSLOduration=2.254576308 podStartE2EDuration="6.322016014s" podCreationTimestamp="2026-05-27 20:12:14 +0000 UTC" firstStartedPulling="2026-05-27 20:12:15.271034685 +0000 UTC m=+44.799103304" lastFinishedPulling="2026-05-27 20:12:19.338474385 +0000 UTC m=+48.866543010" observedRunningTime="2026-05-27 20:12:20.320976246 +0000 UTC m=+49.849044888" watchObservedRunningTime="2026-05-27 20:12:20.322016014 +0000 UTC m=+49.850084652" May 27 20:12:20.336732 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:20.336686 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" podStartSLOduration=2.175516796 podStartE2EDuration="6.336670211s" podCreationTimestamp="2026-05-27 20:12:14 +0000 UTC" firstStartedPulling="2026-05-27 20:12:15.171173606 +0000 UTC m=+44.699242225" lastFinishedPulling="2026-05-27 20:12:19.332327008 +0000 UTC m=+48.860395640" observedRunningTime="2026-05-27 20:12:20.335805101 +0000 UTC m=+49.863873758" watchObservedRunningTime="2026-05-27 20:12:20.336670211 +0000 UTC m=+49.864738851" May 27 20:12:20.370008 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:20.369952 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m9rnr" podStartSLOduration=2.183039052 podStartE2EDuration="6.369931456s" podCreationTimestamp="2026-05-27 20:12:14 +0000 UTC" firstStartedPulling="2026-05-27 20:12:15.145435899 +0000 UTC m=+44.673504519" lastFinishedPulling="2026-05-27 20:12:19.332328298 +0000 UTC m=+48.860396923" observedRunningTime="2026-05-27 20:12:20.368881484 +0000 UTC m=+49.896950126" watchObservedRunningTime="2026-05-27 20:12:20.369931456 +0000 UTC m=+49.898000099" May 27 20:12:21.315067 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:21.315044 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pb94r_bb578cb6-73de-4fe4-a720-1283d855030b/console-operator/1.log" May 27 20:12:21.315726 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:21.315371 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pb94r_bb578cb6-73de-4fe4-a720-1283d855030b/console-operator/0.log" May 27 20:12:21.315726 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:21.315399 2554 generic.go:358] "Generic (PLEG): container finished" podID="bb578cb6-73de-4fe4-a720-1283d855030b" containerID="745afece3d94b40d6faf682a812535d555f668360cfd4521b9337b4715f44eec" exitCode=255 May 27 20:12:21.315726 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:21.315433 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-pb94r" event={"ID":"bb578cb6-73de-4fe4-a720-1283d855030b","Type":"ContainerDied","Data":"745afece3d94b40d6faf682a812535d555f668360cfd4521b9337b4715f44eec"} May 27 20:12:21.315726 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:21.315488 2554 scope.go:117] "RemoveContainer" containerID="a979c717ea66cefa090311b42d2de55bdd439dbd23e9412f27fddfe4b218e0ad" May 27 20:12:21.315944 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:21.315760 2554 scope.go:117] "RemoveContainer" containerID="745afece3d94b40d6faf682a812535d555f668360cfd4521b9337b4715f44eec" May 27 20:12:21.316011 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:21.315984 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-pb94r_openshift-console-operator(bb578cb6-73de-4fe4-a720-1283d855030b)\"" pod="openshift-console-operator/console-operator-76dff48d59-pb94r" podUID="bb578cb6-73de-4fe4-a720-1283d855030b" May 27 20:12:22.318339 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:22.318310 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pb94r_bb578cb6-73de-4fe4-a720-1283d855030b/console-operator/1.log" May 27 20:12:22.318723 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:22.318667 2554 scope.go:117] "RemoveContainer" containerID="745afece3d94b40d6faf682a812535d555f668360cfd4521b9337b4715f44eec" May 27 20:12:22.318853 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:22.318835 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-pb94r_openshift-console-operator(bb578cb6-73de-4fe4-a720-1283d855030b)\"" pod="openshift-console-operator/console-operator-76dff48d59-pb94r" podUID="bb578cb6-73de-4fe4-a720-1283d855030b" May 27 20:12:22.431604 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:22.431571 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-metrics-certs\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:22.431808 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:22.431678 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1c0112d8-ba42-4e30-95fd-d8b4554622fc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-mrhn2\" (UID: \"1c0112d8-ba42-4e30-95fd-d8b4554622fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mrhn2" May 27 20:12:22.431808 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:22.431710 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-service-ca-bundle\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:22.431808 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:22.431753 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 20:12:22.431808 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:22.431780 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 20:12:22.432020 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:22.431815 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-service-ca-bundle podName:b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f nodeName:}" failed. No retries permitted until 2026-05-27 20:12:30.431795708 +0000 UTC m=+59.959864342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-service-ca-bundle") pod "router-default-696899764b-7qrxr" (UID: "b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f") : configmap references non-existent config key: service-ca.crt May 27 20:12:22.432020 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:22.431834 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-metrics-certs podName:b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f nodeName:}" failed. No retries permitted until 2026-05-27 20:12:30.431824795 +0000 UTC m=+59.959893418 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-metrics-certs") pod "router-default-696899764b-7qrxr" (UID: "b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f") : secret "router-metrics-certs-default" not found May 27 20:12:22.432020 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:22.431877 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c0112d8-ba42-4e30-95fd-d8b4554622fc-cluster-monitoring-operator-tls podName:1c0112d8-ba42-4e30-95fd-d8b4554622fc nodeName:}" failed. No retries permitted until 2026-05-27 20:12:30.431854163 +0000 UTC m=+59.959922789 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1c0112d8-ba42-4e30-95fd-d8b4554622fc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-mrhn2" (UID: "1c0112d8-ba42-4e30-95fd-d8b4554622fc") : secret "cluster-monitoring-operator-tls" not found May 27 20:12:22.533033 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:22.533006 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-tls\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:22.533164 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:22.533099 2554 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 20:12:22.533164 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:22.533111 2554 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775798d4bd-pxkp7: secret "image-registry-tls" not found May 27 20:12:22.533164 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:22.533157 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-tls podName:6fbb9f64-eea9-4507-a785-4ad5104b601d nodeName:}" failed. No retries permitted until 2026-05-27 20:12:30.533140878 +0000 UTC m=+60.061209498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-tls") pod "image-registry-775798d4bd-pxkp7" (UID: "6fbb9f64-eea9-4507-a785-4ad5104b601d") : secret "image-registry-tls" not found May 27 20:12:22.869195 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:22.869161 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-jhb9r"] May 27 20:12:22.901317 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:22.901287 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-jhb9r"] May 27 20:12:22.901467 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:22.901405 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-jhb9r" May 27 20:12:22.903673 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:22.903649 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 27 20:12:22.903794 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:22.903761 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jk4jd\"" May 27 20:12:22.903794 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:22.903771 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 27 20:12:22.903794 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:22.903768 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 27 20:12:22.903963 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:22.903873 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 27 20:12:22.936791 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:22.936760 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a2c48f3b-5330-4d3e-a89d-2b8447be3294-signing-key\") pod \"service-ca-67d667c7d-jhb9r\" (UID: \"a2c48f3b-5330-4d3e-a89d-2b8447be3294\") " pod="openshift-service-ca/service-ca-67d667c7d-jhb9r" May 27 20:12:22.936941 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:22.936815 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j2mz\" (UniqueName: \"kubernetes.io/projected/a2c48f3b-5330-4d3e-a89d-2b8447be3294-kube-api-access-6j2mz\") pod \"service-ca-67d667c7d-jhb9r\" (UID: \"a2c48f3b-5330-4d3e-a89d-2b8447be3294\") " pod="openshift-service-ca/service-ca-67d667c7d-jhb9r" May 27 20:12:22.936941 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:22.936837 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a2c48f3b-5330-4d3e-a89d-2b8447be3294-signing-cabundle\") pod \"service-ca-67d667c7d-jhb9r\" (UID: \"a2c48f3b-5330-4d3e-a89d-2b8447be3294\") " pod="openshift-service-ca/service-ca-67d667c7d-jhb9r" May 27 20:12:23.037260 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:23.037223 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a2c48f3b-5330-4d3e-a89d-2b8447be3294-signing-key\") pod \"service-ca-67d667c7d-jhb9r\" (UID: \"a2c48f3b-5330-4d3e-a89d-2b8447be3294\") " pod="openshift-service-ca/service-ca-67d667c7d-jhb9r" May 27 20:12:23.037412 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:23.037293 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6j2mz\" (UniqueName: \"kubernetes.io/projected/a2c48f3b-5330-4d3e-a89d-2b8447be3294-kube-api-access-6j2mz\") pod \"service-ca-67d667c7d-jhb9r\" (UID: \"a2c48f3b-5330-4d3e-a89d-2b8447be3294\") " pod="openshift-service-ca/service-ca-67d667c7d-jhb9r" May 27 20:12:23.037412 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:23.037322 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a2c48f3b-5330-4d3e-a89d-2b8447be3294-signing-cabundle\") pod \"service-ca-67d667c7d-jhb9r\" (UID: \"a2c48f3b-5330-4d3e-a89d-2b8447be3294\") " pod="openshift-service-ca/service-ca-67d667c7d-jhb9r" May 27 20:12:23.037980 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:23.037957 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a2c48f3b-5330-4d3e-a89d-2b8447be3294-signing-cabundle\") pod \"service-ca-67d667c7d-jhb9r\" (UID: \"a2c48f3b-5330-4d3e-a89d-2b8447be3294\") " pod="openshift-service-ca/service-ca-67d667c7d-jhb9r" May 27 20:12:23.039525 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:23.039507 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a2c48f3b-5330-4d3e-a89d-2b8447be3294-signing-key\") pod \"service-ca-67d667c7d-jhb9r\" (UID: \"a2c48f3b-5330-4d3e-a89d-2b8447be3294\") " pod="openshift-service-ca/service-ca-67d667c7d-jhb9r" May 27 20:12:23.046434 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:23.046413 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j2mz\" (UniqueName: \"kubernetes.io/projected/a2c48f3b-5330-4d3e-a89d-2b8447be3294-kube-api-access-6j2mz\") pod \"service-ca-67d667c7d-jhb9r\" (UID: \"a2c48f3b-5330-4d3e-a89d-2b8447be3294\") " pod="openshift-service-ca/service-ca-67d667c7d-jhb9r" May 27 20:12:23.210897 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:23.210867 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-jhb9r" May 27 20:12:23.329830 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:23.329799 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-jhb9r"] May 27 20:12:23.332513 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:12:23.332484 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2c48f3b_5330_4d3e_a89d_2b8447be3294.slice/crio-9269457bc93552fdf3895a25bc16395df3c0e9e37eb119a523f13e75514c3fbf WatchSource:0}: Error finding container 9269457bc93552fdf3895a25bc16395df3c0e9e37eb119a523f13e75514c3fbf: Status 404 returned error can't find the container with id 9269457bc93552fdf3895a25bc16395df3c0e9e37eb119a523f13e75514c3fbf May 27 20:12:24.079449 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:24.079424 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-57cz2_4def15c9-ddcd-4d42-a061-ef4f279c7f63/dns-node-resolver/0.log" May 27 20:12:24.323165 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:24.323128 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-jhb9r" event={"ID":"a2c48f3b-5330-4d3e-a89d-2b8447be3294","Type":"ContainerStarted","Data":"9269457bc93552fdf3895a25bc16395df3c0e9e37eb119a523f13e75514c3fbf"} May 27 20:12:24.904478 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:24.904447 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-pb94r" May 27 20:12:24.904908 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:24.904493 2554 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-pb94r" May 27 20:12:24.904908 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:24.904869 2554 scope.go:117] "RemoveContainer" containerID="745afece3d94b40d6faf682a812535d555f668360cfd4521b9337b4715f44eec" May 27 20:12:24.905070 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:24.905046 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-pb94r_openshift-console-operator(bb578cb6-73de-4fe4-a720-1283d855030b)\"" pod="openshift-console-operator/console-operator-76dff48d59-pb94r" podUID="bb578cb6-73de-4fe4-a720-1283d855030b" May 27 20:12:25.479775 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:25.479748 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w86br_0e6cae6b-bb5a-44a0-b929-68b455a68a96/node-ca/0.log" May 27 20:12:26.334873 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:26.334833 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-jhb9r" event={"ID":"a2c48f3b-5330-4d3e-a89d-2b8447be3294","Type":"ContainerStarted","Data":"dbfb90e26ed870878d01ddb104208d3562226efc1133e022ca60e571ea27a011"} May 27 20:12:26.352161 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:26.352105 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-jhb9r" podStartSLOduration=2.224361397 podStartE2EDuration="4.352088907s" podCreationTimestamp="2026-05-27 20:12:22 +0000 UTC" firstStartedPulling="2026-05-27 20:12:23.334393403 +0000 UTC m=+52.862462027" lastFinishedPulling="2026-05-27 20:12:25.462120917 +0000 UTC m=+54.990189537" observedRunningTime="2026-05-27 20:12:26.3517989 +0000 UTC m=+55.879867543" watchObservedRunningTime="2026-05-27 20:12:26.352088907 +0000 UTC m=+55.880157550" May 27 20:12:26.881101 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:26.881054 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-kfvgn_42327801-84b0-458e-9515-67ebe5684ff6/kube-storage-version-migrator-operator/0.log" May 27 20:12:30.502256 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:30.502221 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-metrics-certs\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:30.502662 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:30.502293 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1c0112d8-ba42-4e30-95fd-d8b4554622fc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-mrhn2\" (UID: \"1c0112d8-ba42-4e30-95fd-d8b4554622fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mrhn2" May 27 20:12:30.502662 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:30.502336 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-service-ca-bundle\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:30.502662 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:30.502397 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 20:12:30.502662 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:30.502468 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-metrics-certs podName:b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f nodeName:}" failed. No retries permitted until 2026-05-27 20:12:46.502450299 +0000 UTC m=+76.030518934 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-metrics-certs") pod "router-default-696899764b-7qrxr" (UID: "b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f") : secret "router-metrics-certs-default" not found May 27 20:12:30.502662 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:30.502487 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-service-ca-bundle podName:b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f nodeName:}" failed. No retries permitted until 2026-05-27 20:12:46.502478584 +0000 UTC m=+76.030547205 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-service-ca-bundle") pod "router-default-696899764b-7qrxr" (UID: "b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f") : configmap references non-existent config key: service-ca.crt May 27 20:12:30.502662 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:30.502466 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 20:12:30.502662 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:30.502587 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c0112d8-ba42-4e30-95fd-d8b4554622fc-cluster-monitoring-operator-tls podName:1c0112d8-ba42-4e30-95fd-d8b4554622fc nodeName:}" failed. No retries permitted until 2026-05-27 20:12:46.502568571 +0000 UTC m=+76.030637196 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1c0112d8-ba42-4e30-95fd-d8b4554622fc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-mrhn2" (UID: "1c0112d8-ba42-4e30-95fd-d8b4554622fc") : secret "cluster-monitoring-operator-tls" not found May 27 20:12:30.603488 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:30.603457 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-tls\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:30.606008 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:30.605986 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-tls\") pod \"image-registry-775798d4bd-pxkp7\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:30.677228 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:30.677202 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:30.801720 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:30.801686 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-775798d4bd-pxkp7"] May 27 20:12:30.804337 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:12:30.804298 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fbb9f64_eea9_4507_a785_4ad5104b601d.slice/crio-97f3832df01672744f370657adc826351ca22c4134fe00254513fd817650da6f WatchSource:0}: Error finding container 97f3832df01672744f370657adc826351ca22c4134fe00254513fd817650da6f: Status 404 returned error can't find the container with id 97f3832df01672744f370657adc826351ca22c4134fe00254513fd817650da6f May 27 20:12:31.349575 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:31.349542 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" event={"ID":"6fbb9f64-eea9-4507-a785-4ad5104b601d","Type":"ContainerStarted","Data":"70b9f7f6cfb8d9a4ddb553ee6d7b154309ea343980bea67ec72404e1d25c462c"} May 27 20:12:31.349575 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:31.349582 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" event={"ID":"6fbb9f64-eea9-4507-a785-4ad5104b601d","Type":"ContainerStarted","Data":"97f3832df01672744f370657adc826351ca22c4134fe00254513fd817650da6f"} May 27 20:12:31.349810 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:31.349732 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:31.369173 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:31.369130 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" podStartSLOduration=17.369116485 podStartE2EDuration="17.369116485s" podCreationTimestamp="2026-05-27 20:12:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:12:31.368297157 +0000 UTC m=+60.896365800" watchObservedRunningTime="2026-05-27 20:12:31.369116485 +0000 UTC m=+60.897185126" May 27 20:12:35.748345 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:35.748301 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db22aafa-06fa-48ee-b31f-69581a977745-metrics-tls\") pod \"dns-default-pwnms\" (UID: \"db22aafa-06fa-48ee-b31f-69581a977745\") " pod="openshift-dns/dns-default-pwnms" May 27 20:12:35.750543 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:35.750517 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db22aafa-06fa-48ee-b31f-69581a977745-metrics-tls\") pod \"dns-default-pwnms\" (UID: \"db22aafa-06fa-48ee-b31f-69581a977745\") " pod="openshift-dns/dns-default-pwnms" May 27 20:12:35.849858 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:35.849818 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b59afc02-dbe6-4e59-b84a-f7c108bd70e3-cert\") pod \"ingress-canary-jqxt2\" (UID: \"b59afc02-dbe6-4e59-b84a-f7c108bd70e3\") " pod="openshift-ingress-canary/ingress-canary-jqxt2" May 27 20:12:35.852209 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:35.852183 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b59afc02-dbe6-4e59-b84a-f7c108bd70e3-cert\") pod \"ingress-canary-jqxt2\" (UID: \"b59afc02-dbe6-4e59-b84a-f7c108bd70e3\") " pod="openshift-ingress-canary/ingress-canary-jqxt2" May 27 20:12:35.989515 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:35.989485 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jcg7q\"" May 27 20:12:35.997429 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:35.997404 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pwnms" May 27 20:12:36.002964 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:36.002913 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c8wsm\"" May 27 20:12:36.010854 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:36.010831 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jqxt2" May 27 20:12:36.142288 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:36.142245 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pwnms"] May 27 20:12:36.146668 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:12:36.146640 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb22aafa_06fa_48ee_b31f_69581a977745.slice/crio-4787a545e66ecb9c8015fdcf7e080ff8aeafe2b2fbb5b43aef3ff06003f6b46c WatchSource:0}: Error finding container 4787a545e66ecb9c8015fdcf7e080ff8aeafe2b2fbb5b43aef3ff06003f6b46c: Status 404 returned error can't find the container with id 4787a545e66ecb9c8015fdcf7e080ff8aeafe2b2fbb5b43aef3ff06003f6b46c May 27 20:12:36.154675 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:36.154654 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jqxt2"] May 27 20:12:36.157997 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:12:36.157972 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb59afc02_dbe6_4e59_b84a_f7c108bd70e3.slice/crio-b63b12d1cd381e138f05cb682fe6e70df455b1cd98ad44482153d6ec7a16160d WatchSource:0}: Error finding container b63b12d1cd381e138f05cb682fe6e70df455b1cd98ad44482153d6ec7a16160d: Status 404 returned error can't find the container with id b63b12d1cd381e138f05cb682fe6e70df455b1cd98ad44482153d6ec7a16160d May 27 20:12:36.365175 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:36.365091 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pwnms" event={"ID":"db22aafa-06fa-48ee-b31f-69581a977745","Type":"ContainerStarted","Data":"4787a545e66ecb9c8015fdcf7e080ff8aeafe2b2fbb5b43aef3ff06003f6b46c"} May 27 20:12:36.365988 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:36.365966 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jqxt2" event={"ID":"b59afc02-dbe6-4e59-b84a-f7c108bd70e3","Type":"ContainerStarted","Data":"b63b12d1cd381e138f05cb682fe6e70df455b1cd98ad44482153d6ec7a16160d"} May 27 20:12:36.759896 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:36.759857 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-metrics-certs\") pod \"network-metrics-daemon-5jv8k\" (UID: \"a51bfffe-2896-4ffe-84b0-23a5b5127cdd\") " pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:12:36.762781 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:36.762762 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 20:12:36.772490 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:36.772467 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a51bfffe-2896-4ffe-84b0-23a5b5127cdd-metrics-certs\") pod \"network-metrics-daemon-5jv8k\" (UID: \"a51bfffe-2896-4ffe-84b0-23a5b5127cdd\") " pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:12:36.860940 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:36.860907 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqdft\" (UniqueName: \"kubernetes.io/projected/d572187c-753d-447a-8232-d89446920689-kube-api-access-mqdft\") pod \"network-check-target-hm2h8\" (UID: \"d572187c-753d-447a-8232-d89446920689\") " pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:12:36.863503 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:36.863478 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 20:12:36.864756 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:36.864725 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b7jlg\"" May 27 20:12:36.872838 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:36.872817 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5jv8k" May 27 20:12:36.873894 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:36.873869 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 20:12:36.885842 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:36.885353 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqdft\" (UniqueName: \"kubernetes.io/projected/d572187c-753d-447a-8232-d89446920689-kube-api-access-mqdft\") pod \"network-check-target-hm2h8\" (UID: \"d572187c-753d-447a-8232-d89446920689\") " pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:12:37.017588 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:37.017436 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5jv8k"] May 27 20:12:37.020130 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:12:37.020089 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda51bfffe_2896_4ffe_84b0_23a5b5127cdd.slice/crio-4feb8d46ac1ff78d3310d1c8edc70d8526f1885f78d7414a705f495d59da8bef WatchSource:0}: Error finding container 4feb8d46ac1ff78d3310d1c8edc70d8526f1885f78d7414a705f495d59da8bef: Status 404 returned error can't find the container with id 4feb8d46ac1ff78d3310d1c8edc70d8526f1885f78d7414a705f495d59da8bef May 27 20:12:37.170100 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:37.170042 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g79gn\"" May 27 20:12:37.178092 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:37.178069 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:12:37.326090 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:37.325397 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hm2h8"] May 27 20:12:37.328760 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:12:37.328728 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd572187c_753d_447a_8232_d89446920689.slice/crio-1cf949584fa01768c5bc4fe2b5fd85d9ab915ade049f1a2f0dd40b5a6a0ff55b WatchSource:0}: Error finding container 1cf949584fa01768c5bc4fe2b5fd85d9ab915ade049f1a2f0dd40b5a6a0ff55b: Status 404 returned error can't find the container with id 1cf949584fa01768c5bc4fe2b5fd85d9ab915ade049f1a2f0dd40b5a6a0ff55b May 27 20:12:37.370194 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:37.370158 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hm2h8" event={"ID":"d572187c-753d-447a-8232-d89446920689","Type":"ContainerStarted","Data":"1cf949584fa01768c5bc4fe2b5fd85d9ab915ade049f1a2f0dd40b5a6a0ff55b"} May 27 20:12:37.371533 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:37.371502 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5jv8k" event={"ID":"a51bfffe-2896-4ffe-84b0-23a5b5127cdd","Type":"ContainerStarted","Data":"4feb8d46ac1ff78d3310d1c8edc70d8526f1885f78d7414a705f495d59da8bef"} May 27 20:12:38.051123 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:38.051094 2554 scope.go:117] "RemoveContainer" containerID="745afece3d94b40d6faf682a812535d555f668360cfd4521b9337b4715f44eec" May 27 20:12:39.380477 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:39.380415 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pwnms" event={"ID":"db22aafa-06fa-48ee-b31f-69581a977745","Type":"ContainerStarted","Data":"08b2780b79691e9f45110d571ef24b0916b34450eb1c433b6dc23ad0b2bf1f57"} May 27 20:12:39.380477 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:39.380454 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pwnms" event={"ID":"db22aafa-06fa-48ee-b31f-69581a977745","Type":"ContainerStarted","Data":"110c82a7f1410d734027ae7492fa432f43163e69406386b96895961ea98e9734"} May 27 20:12:39.381004 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:39.380581 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pwnms" May 27 20:12:39.381991 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:39.381962 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jqxt2" event={"ID":"b59afc02-dbe6-4e59-b84a-f7c108bd70e3","Type":"ContainerStarted","Data":"b73523e8f149b09b0a4f4293b743720302c672de76f68c4fd0ff656e12f04207"} May 27 20:12:39.383715 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:39.383685 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5jv8k" event={"ID":"a51bfffe-2896-4ffe-84b0-23a5b5127cdd","Type":"ContainerStarted","Data":"b86419aba650570110a61cc06d028d480a7dc4227cd01b3a296e40128e423cb2"} May 27 20:12:39.383830 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:39.383718 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5jv8k" event={"ID":"a51bfffe-2896-4ffe-84b0-23a5b5127cdd","Type":"ContainerStarted","Data":"153896a02dd62119b3ff841937c1e56b1193eb2c2b188e36d6e29a1511907873"} May 27 20:12:39.385415 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:39.385394 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pb94r_bb578cb6-73de-4fe4-a720-1283d855030b/console-operator/1.log" May 27 20:12:39.385533 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:39.385441 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-pb94r" event={"ID":"bb578cb6-73de-4fe4-a720-1283d855030b","Type":"ContainerStarted","Data":"bb0aedba7bea237529f1f7fcf332f4667d7ae424ca37248aae58e1702b938c69"} May 27 20:12:39.385722 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:39.385693 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-pb94r" May 27 20:12:39.400124 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:39.400078 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-pwnms" podStartSLOduration=33.897365097 podStartE2EDuration="36.400064843s" podCreationTimestamp="2026-05-27 20:12:03 +0000 UTC" firstStartedPulling="2026-05-27 20:12:36.14837162 +0000 UTC m=+65.676440241" lastFinishedPulling="2026-05-27 20:12:38.651071354 +0000 UTC m=+68.179139987" observedRunningTime="2026-05-27 20:12:39.399496181 +0000 UTC m=+68.927564824" watchObservedRunningTime="2026-05-27 20:12:39.400064843 +0000 UTC m=+68.928133486" May 27 20:12:39.418168 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:39.418119 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-pb94r" podStartSLOduration=21.198414489 podStartE2EDuration="25.41810385s" podCreationTimestamp="2026-05-27 20:12:14 +0000 UTC" firstStartedPulling="2026-05-27 20:12:15.11285496 +0000 UTC m=+44.640923580" lastFinishedPulling="2026-05-27 20:12:19.332544315 +0000 UTC m=+48.860612941" observedRunningTime="2026-05-27 20:12:39.416013451 +0000 UTC m=+68.944082096" watchObservedRunningTime="2026-05-27 20:12:39.41810385 +0000 UTC m=+68.946172493" May 27 20:12:39.431692 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:39.431646 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5jv8k" podStartSLOduration=66.805574219 podStartE2EDuration="1m8.431631724s" podCreationTimestamp="2026-05-27 20:11:31 +0000 UTC" firstStartedPulling="2026-05-27 20:12:37.022533547 +0000 UTC m=+66.550602172" lastFinishedPulling="2026-05-27 20:12:38.648591041 +0000 UTC m=+68.176659677" observedRunningTime="2026-05-27 20:12:39.430649931 +0000 UTC m=+68.958718586" watchObservedRunningTime="2026-05-27 20:12:39.431631724 +0000 UTC m=+68.959700358" May 27 20:12:39.445556 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:39.445517 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jqxt2" podStartSLOduration=33.958042701 podStartE2EDuration="36.445508365s" podCreationTimestamp="2026-05-27 20:12:03 +0000 UTC" firstStartedPulling="2026-05-27 20:12:36.159731269 +0000 UTC m=+65.687799889" lastFinishedPulling="2026-05-27 20:12:38.64719692 +0000 UTC m=+68.175265553" observedRunningTime="2026-05-27 20:12:39.444771456 +0000 UTC m=+68.972840100" watchObservedRunningTime="2026-05-27 20:12:39.445508365 +0000 UTC m=+68.973577007" May 27 20:12:39.720295 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:39.720263 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-pb94r" May 27 20:12:41.393041 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:41.392940 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hm2h8" event={"ID":"d572187c-753d-447a-8232-d89446920689","Type":"ContainerStarted","Data":"13e3f78e88026c592fda9f3fe5f867b3045fa2ea92b1bc2409746367afd7a2bd"} May 27 20:12:41.393434 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:41.393198 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:12:41.409830 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:41.409779 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hm2h8" podStartSLOduration=66.75264222 podStartE2EDuration="1m10.409764796s" podCreationTimestamp="2026-05-27 20:11:31 +0000 UTC" firstStartedPulling="2026-05-27 20:12:37.331278021 +0000 UTC m=+66.859346646" lastFinishedPulling="2026-05-27 20:12:40.988400583 +0000 UTC m=+70.516469222" observedRunningTime="2026-05-27 20:12:41.40853218 +0000 UTC m=+70.936600822" watchObservedRunningTime="2026-05-27 20:12:41.409764796 +0000 UTC m=+70.937833439" May 27 20:12:44.943846 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:44.943745 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xgzn9"] May 27 20:12:44.946244 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:44.946228 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xgzn9" May 27 20:12:44.949830 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:44.949809 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 27 20:12:44.949956 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:44.949846 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 27 20:12:44.949956 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:44.949847 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4nk26\"" May 27 20:12:44.957493 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:44.957474 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xgzn9"] May 27 20:12:44.994775 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:44.994747 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-775798d4bd-pxkp7"] May 27 20:12:45.030323 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.030292 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-vmck4"] May 27 20:12:45.032066 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.032050 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-vmck4" May 27 20:12:45.034493 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.034472 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-rg5gw\"" May 27 20:12:45.034583 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.034479 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 27 20:12:45.034583 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.034548 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 27 20:12:45.045771 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.045752 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-vmck4"] May 27 20:12:45.131263 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.131233 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx2zk\" (UniqueName: \"kubernetes.io/projected/b00b05e6-6ed0-457d-882c-402d915f029e-kube-api-access-lx2zk\") pod \"downloads-57bd96b888-vmck4\" (UID: \"b00b05e6-6ed0-457d-882c-402d915f029e\") " pod="openshift-console/downloads-57bd96b888-vmck4" May 27 20:12:45.131454 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.131278 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5817ede5-e832-4828-b02b-9fef252e17f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xgzn9\" (UID: \"5817ede5-e832-4828-b02b-9fef252e17f2\") " pod="openshift-insights/insights-runtime-extractor-xgzn9" May 27 20:12:45.131454 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.131307 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5817ede5-e832-4828-b02b-9fef252e17f2-data-volume\") pod \"insights-runtime-extractor-xgzn9\" (UID: \"5817ede5-e832-4828-b02b-9fef252e17f2\") " pod="openshift-insights/insights-runtime-extractor-xgzn9" May 27 20:12:45.131454 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.131379 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5817ede5-e832-4828-b02b-9fef252e17f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xgzn9\" (UID: \"5817ede5-e832-4828-b02b-9fef252e17f2\") " pod="openshift-insights/insights-runtime-extractor-xgzn9" May 27 20:12:45.131454 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.131423 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k49lw\" (UniqueName: \"kubernetes.io/projected/5817ede5-e832-4828-b02b-9fef252e17f2-kube-api-access-k49lw\") pod \"insights-runtime-extractor-xgzn9\" (UID: \"5817ede5-e832-4828-b02b-9fef252e17f2\") " pod="openshift-insights/insights-runtime-extractor-xgzn9" May 27 20:12:45.131454 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.131446 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5817ede5-e832-4828-b02b-9fef252e17f2-crio-socket\") pod \"insights-runtime-extractor-xgzn9\" (UID: \"5817ede5-e832-4828-b02b-9fef252e17f2\") " pod="openshift-insights/insights-runtime-extractor-xgzn9" May 27 20:12:45.232165 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.232092 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k49lw\" (UniqueName: \"kubernetes.io/projected/5817ede5-e832-4828-b02b-9fef252e17f2-kube-api-access-k49lw\") pod \"insights-runtime-extractor-xgzn9\" (UID: \"5817ede5-e832-4828-b02b-9fef252e17f2\") " pod="openshift-insights/insights-runtime-extractor-xgzn9" May 27 20:12:45.232165 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.232126 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5817ede5-e832-4828-b02b-9fef252e17f2-crio-socket\") pod \"insights-runtime-extractor-xgzn9\" (UID: \"5817ede5-e832-4828-b02b-9fef252e17f2\") " pod="openshift-insights/insights-runtime-extractor-xgzn9" May 27 20:12:45.232165 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.232167 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lx2zk\" (UniqueName: \"kubernetes.io/projected/b00b05e6-6ed0-457d-882c-402d915f029e-kube-api-access-lx2zk\") pod \"downloads-57bd96b888-vmck4\" (UID: \"b00b05e6-6ed0-457d-882c-402d915f029e\") " pod="openshift-console/downloads-57bd96b888-vmck4" May 27 20:12:45.232467 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.232237 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5817ede5-e832-4828-b02b-9fef252e17f2-crio-socket\") pod \"insights-runtime-extractor-xgzn9\" (UID: \"5817ede5-e832-4828-b02b-9fef252e17f2\") " pod="openshift-insights/insights-runtime-extractor-xgzn9" May 27 20:12:45.232467 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.232334 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5817ede5-e832-4828-b02b-9fef252e17f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xgzn9\" (UID: \"5817ede5-e832-4828-b02b-9fef252e17f2\") " pod="openshift-insights/insights-runtime-extractor-xgzn9" May 27 20:12:45.232467 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.232378 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5817ede5-e832-4828-b02b-9fef252e17f2-data-volume\") pod \"insights-runtime-extractor-xgzn9\" (UID: \"5817ede5-e832-4828-b02b-9fef252e17f2\") " pod="openshift-insights/insights-runtime-extractor-xgzn9" May 27 20:12:45.232467 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.232436 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5817ede5-e832-4828-b02b-9fef252e17f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xgzn9\" (UID: \"5817ede5-e832-4828-b02b-9fef252e17f2\") " pod="openshift-insights/insights-runtime-extractor-xgzn9" May 27 20:12:45.232774 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.232756 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5817ede5-e832-4828-b02b-9fef252e17f2-data-volume\") pod \"insights-runtime-extractor-xgzn9\" (UID: \"5817ede5-e832-4828-b02b-9fef252e17f2\") " pod="openshift-insights/insights-runtime-extractor-xgzn9" May 27 20:12:45.232895 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.232879 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5817ede5-e832-4828-b02b-9fef252e17f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xgzn9\" (UID: \"5817ede5-e832-4828-b02b-9fef252e17f2\") " pod="openshift-insights/insights-runtime-extractor-xgzn9" May 27 20:12:45.234777 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.234762 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5817ede5-e832-4828-b02b-9fef252e17f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xgzn9\" (UID: \"5817ede5-e832-4828-b02b-9fef252e17f2\") " pod="openshift-insights/insights-runtime-extractor-xgzn9" May 27 20:12:45.242820 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.242797 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k49lw\" (UniqueName: \"kubernetes.io/projected/5817ede5-e832-4828-b02b-9fef252e17f2-kube-api-access-k49lw\") pod \"insights-runtime-extractor-xgzn9\" (UID: \"5817ede5-e832-4828-b02b-9fef252e17f2\") " pod="openshift-insights/insights-runtime-extractor-xgzn9" May 27 20:12:45.243078 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.243059 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx2zk\" (UniqueName: \"kubernetes.io/projected/b00b05e6-6ed0-457d-882c-402d915f029e-kube-api-access-lx2zk\") pod \"downloads-57bd96b888-vmck4\" (UID: \"b00b05e6-6ed0-457d-882c-402d915f029e\") " pod="openshift-console/downloads-57bd96b888-vmck4" May 27 20:12:45.254791 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.254765 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xgzn9" May 27 20:12:45.340120 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.340089 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-vmck4" May 27 20:12:45.399003 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.398978 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xgzn9"] May 27 20:12:45.401593 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:12:45.401568 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5817ede5_e832_4828_b02b_9fef252e17f2.slice/crio-4d817da1d386f8061c653752de10ae7d296fa216376fdbceb604dc46c82c5655 WatchSource:0}: Error finding container 4d817da1d386f8061c653752de10ae7d296fa216376fdbceb604dc46c82c5655: Status 404 returned error can't find the container with id 4d817da1d386f8061c653752de10ae7d296fa216376fdbceb604dc46c82c5655 May 27 20:12:45.465275 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:45.465227 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-vmck4"] May 27 20:12:45.467533 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:12:45.467511 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb00b05e6_6ed0_457d_882c_402d915f029e.slice/crio-a0f7c868b06c64f764a56f4113f497531c14bbf5e2d904ffc43684fa13f6df5d WatchSource:0}: Error finding container a0f7c868b06c64f764a56f4113f497531c14bbf5e2d904ffc43684fa13f6df5d: Status 404 returned error can't find the container with id a0f7c868b06c64f764a56f4113f497531c14bbf5e2d904ffc43684fa13f6df5d May 27 20:12:46.407067 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:46.406983 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xgzn9" event={"ID":"5817ede5-e832-4828-b02b-9fef252e17f2","Type":"ContainerStarted","Data":"fd9efad56e5ce5848d171552dab4b679d316ac3a723ba4de32812e08a8b036f5"} May 27 20:12:46.407067 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:46.407024 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xgzn9" event={"ID":"5817ede5-e832-4828-b02b-9fef252e17f2","Type":"ContainerStarted","Data":"ae313516765ce109ddcbebedb66086eba302684f60d6de2a451c97dc4357a709"} May 27 20:12:46.407067 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:46.407041 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xgzn9" event={"ID":"5817ede5-e832-4828-b02b-9fef252e17f2","Type":"ContainerStarted","Data":"4d817da1d386f8061c653752de10ae7d296fa216376fdbceb604dc46c82c5655"} May 27 20:12:46.408154 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:46.408121 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-vmck4" event={"ID":"b00b05e6-6ed0-457d-882c-402d915f029e","Type":"ContainerStarted","Data":"a0f7c868b06c64f764a56f4113f497531c14bbf5e2d904ffc43684fa13f6df5d"} May 27 20:12:46.543732 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:46.543699 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-metrics-certs\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:46.543906 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:46.543761 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1c0112d8-ba42-4e30-95fd-d8b4554622fc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-mrhn2\" (UID: \"1c0112d8-ba42-4e30-95fd-d8b4554622fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mrhn2" May 27 20:12:46.543906 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:46.543812 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-service-ca-bundle\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:46.544451 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:46.544414 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-service-ca-bundle\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:46.546283 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:46.546261 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f-metrics-certs\") pod \"router-default-696899764b-7qrxr\" (UID: \"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f\") " pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:46.546470 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:46.546447 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1c0112d8-ba42-4e30-95fd-d8b4554622fc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-mrhn2\" (UID: \"1c0112d8-ba42-4e30-95fd-d8b4554622fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mrhn2" May 27 20:12:46.823724 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:46.823693 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bnlgz\"" May 27 20:12:46.831542 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:46.831513 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mrhn2" May 27 20:12:46.841571 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:46.841551 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vnh8k\"" May 27 20:12:46.850255 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:46.850231 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:47.001355 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:47.001302 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-mrhn2"] May 27 20:12:47.005121 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:12:47.005085 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c0112d8_ba42_4e30_95fd_d8b4554622fc.slice/crio-c2fc96a0a0eb69c7a5378df09dc6225029b8e41741008c795197698f4736e01f WatchSource:0}: Error finding container c2fc96a0a0eb69c7a5378df09dc6225029b8e41741008c795197698f4736e01f: Status 404 returned error can't find the container with id c2fc96a0a0eb69c7a5378df09dc6225029b8e41741008c795197698f4736e01f May 27 20:12:47.038071 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:47.038043 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-696899764b-7qrxr"] May 27 20:12:47.041180 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:12:47.041143 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4c04590_5a56_4dd4_ac22_9a3f9b06ae5f.slice/crio-fe9ad5d6ca5d2b12d3f7b227ebc77366c4df54370e6789c5986c3fdef993ca8c WatchSource:0}: Error finding container fe9ad5d6ca5d2b12d3f7b227ebc77366c4df54370e6789c5986c3fdef993ca8c: Status 404 returned error can't find the container with id fe9ad5d6ca5d2b12d3f7b227ebc77366c4df54370e6789c5986c3fdef993ca8c May 27 20:12:47.413750 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:47.413665 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-696899764b-7qrxr" event={"ID":"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f","Type":"ContainerStarted","Data":"4a4ba2da9e79a19cd3c89accd92c6dcecbb956e0c783357efe5a3385d7447af7"} May 27 20:12:47.413750 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:47.413717 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-696899764b-7qrxr" event={"ID":"b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f","Type":"ContainerStarted","Data":"fe9ad5d6ca5d2b12d3f7b227ebc77366c4df54370e6789c5986c3fdef993ca8c"} May 27 20:12:47.414998 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:47.414973 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mrhn2" event={"ID":"1c0112d8-ba42-4e30-95fd-d8b4554622fc","Type":"ContainerStarted","Data":"c2fc96a0a0eb69c7a5378df09dc6225029b8e41741008c795197698f4736e01f"} May 27 20:12:47.435377 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:47.435324 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-696899764b-7qrxr" podStartSLOduration=33.435306486 podStartE2EDuration="33.435306486s" podCreationTimestamp="2026-05-27 20:12:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:12:47.432854677 +0000 UTC m=+76.960923319" watchObservedRunningTime="2026-05-27 20:12:47.435306486 +0000 UTC m=+76.963375129" May 27 20:12:47.850617 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:47.850573 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:47.853744 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:47.853717 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:48.017675 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.017634 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-64f6bb5d44-kwv66"] May 27 20:12:48.020819 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.020793 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:12:48.023933 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.023909 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 27 20:12:48.024252 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.024229 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 27 20:12:48.024330 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.024248 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 27 20:12:48.024548 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.024523 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 27 20:12:48.024739 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.024715 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 27 20:12:48.024818 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.024784 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-h9gjg\"" May 27 20:12:48.031782 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.031762 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64f6bb5d44-kwv66"] May 27 20:12:48.155489 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.155416 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-console-oauth-config\") pod \"console-64f6bb5d44-kwv66\" (UID: \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\") " pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:12:48.155489 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.155449 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-oauth-serving-cert\") pod \"console-64f6bb5d44-kwv66\" (UID: \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\") " pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:12:48.155676 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.155544 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-console-config\") pod \"console-64f6bb5d44-kwv66\" (UID: \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\") " pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:12:48.155676 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.155580 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-service-ca\") pod \"console-64f6bb5d44-kwv66\" (UID: \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\") " pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:12:48.155676 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.155601 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwjmt\" (UniqueName: \"kubernetes.io/projected/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-kube-api-access-mwjmt\") pod \"console-64f6bb5d44-kwv66\" (UID: \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\") " pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:12:48.155676 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.155646 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-console-serving-cert\") pod \"console-64f6bb5d44-kwv66\" (UID: \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\") " pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:12:48.256128 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.256044 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-console-config\") pod \"console-64f6bb5d44-kwv66\" (UID: \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\") " pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:12:48.256128 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.256097 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-service-ca\") pod \"console-64f6bb5d44-kwv66\" (UID: \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\") " pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:12:48.256128 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.256128 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mwjmt\" (UniqueName: \"kubernetes.io/projected/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-kube-api-access-mwjmt\") pod \"console-64f6bb5d44-kwv66\" (UID: \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\") " pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:12:48.256407 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.256159 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-console-serving-cert\") pod \"console-64f6bb5d44-kwv66\" (UID: \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\") " pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:12:48.256407 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.256208 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-console-oauth-config\") pod \"console-64f6bb5d44-kwv66\" (UID: \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\") " pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:12:48.256407 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.256234 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-oauth-serving-cert\") pod \"console-64f6bb5d44-kwv66\" (UID: \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\") " pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:12:48.256854 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.256825 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-console-config\") pod \"console-64f6bb5d44-kwv66\" (UID: \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\") " pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:12:48.256966 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.256950 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-oauth-serving-cert\") pod \"console-64f6bb5d44-kwv66\" (UID: \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\") " pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:12:48.257617 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.257585 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-service-ca\") pod \"console-64f6bb5d44-kwv66\" (UID: \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\") " pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:12:48.259071 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.259046 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-console-serving-cert\") pod \"console-64f6bb5d44-kwv66\" (UID: \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\") " pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:12:48.259366 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.259343 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-console-oauth-config\") pod \"console-64f6bb5d44-kwv66\" (UID: \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\") " pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:12:48.265285 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.265241 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwjmt\" (UniqueName: \"kubernetes.io/projected/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-kube-api-access-mwjmt\") pod \"console-64f6bb5d44-kwv66\" (UID: \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\") " pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:12:48.333273 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.333243 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:12:48.430742 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.428485 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xgzn9" event={"ID":"5817ede5-e832-4828-b02b-9fef252e17f2","Type":"ContainerStarted","Data":"36c71eae2cab357119e4306ebe57bbe4fee17f76015b07a253368e4127a63b0c"} May 27 20:12:48.430742 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.430393 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:48.434122 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.431914 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-696899764b-7qrxr" May 27 20:12:48.447424 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.447133 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xgzn9" podStartSLOduration=2.327247616 podStartE2EDuration="4.447114971s" podCreationTimestamp="2026-05-27 20:12:44 +0000 UTC" firstStartedPulling="2026-05-27 20:12:45.464261591 +0000 UTC m=+74.992330217" lastFinishedPulling="2026-05-27 20:12:47.584128952 +0000 UTC m=+77.112197572" observedRunningTime="2026-05-27 20:12:48.445798398 +0000 UTC m=+77.973867077" watchObservedRunningTime="2026-05-27 20:12:48.447114971 +0000 UTC m=+77.975183615" May 27 20:12:48.480037 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:48.479966 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64f6bb5d44-kwv66"] May 27 20:12:48.987389 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:12:48.987355 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9f5dc3f_6d63_489b_af5c_a2e7e55f8f17.slice/crio-d134eede63d57c36c9385ab898cd03c7c822d2e61469351b42d21dcaadc68353 WatchSource:0}: Error finding container d134eede63d57c36c9385ab898cd03c7c822d2e61469351b42d21dcaadc68353: Status 404 returned error can't find the container with id d134eede63d57c36c9385ab898cd03c7c822d2e61469351b42d21dcaadc68353 May 27 20:12:49.391586 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:49.391508 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pwnms" May 27 20:12:49.431240 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:49.431211 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mrhn2" event={"ID":"1c0112d8-ba42-4e30-95fd-d8b4554622fc","Type":"ContainerStarted","Data":"a040d0366bf94d6de3d97ce88e27f90932fc929a8d75c7864c42380be5ce2134"} May 27 20:12:49.432484 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:49.432457 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64f6bb5d44-kwv66" event={"ID":"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17","Type":"ContainerStarted","Data":"d134eede63d57c36c9385ab898cd03c7c822d2e61469351b42d21dcaadc68353"} May 27 20:12:49.447718 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:49.447138 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mrhn2" podStartSLOduration=33.423179429 podStartE2EDuration="35.447120023s" podCreationTimestamp="2026-05-27 20:12:14 +0000 UTC" firstStartedPulling="2026-05-27 20:12:47.007517826 +0000 UTC m=+76.535586447" lastFinishedPulling="2026-05-27 20:12:49.03145842 +0000 UTC m=+78.559527041" observedRunningTime="2026-05-27 20:12:49.446136915 +0000 UTC m=+78.974205556" watchObservedRunningTime="2026-05-27 20:12:49.447120023 +0000 UTC m=+78.975188666" May 27 20:12:50.607895 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.607860 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dd8568cdd-7g6v9"] May 27 20:12:50.641086 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.641059 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dd8568cdd-7g6v9"] May 27 20:12:50.641233 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.641190 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:12:50.652659 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.652606 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 27 20:12:50.779398 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.779349 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk2tm\" (UniqueName: \"kubernetes.io/projected/f970ad2f-d529-4e13-86a5-44e4cc962586-kube-api-access-zk2tm\") pod \"console-7dd8568cdd-7g6v9\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:12:50.779584 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.779442 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f970ad2f-d529-4e13-86a5-44e4cc962586-oauth-serving-cert\") pod \"console-7dd8568cdd-7g6v9\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:12:50.779584 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.779475 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f970ad2f-d529-4e13-86a5-44e4cc962586-console-oauth-config\") pod \"console-7dd8568cdd-7g6v9\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:12:50.779584 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.779501 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f970ad2f-d529-4e13-86a5-44e4cc962586-console-config\") pod \"console-7dd8568cdd-7g6v9\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:12:50.779584 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.779528 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f970ad2f-d529-4e13-86a5-44e4cc962586-service-ca\") pod \"console-7dd8568cdd-7g6v9\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:12:50.779584 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.779553 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f970ad2f-d529-4e13-86a5-44e4cc962586-trusted-ca-bundle\") pod \"console-7dd8568cdd-7g6v9\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:12:50.779810 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.779593 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f970ad2f-d529-4e13-86a5-44e4cc962586-console-serving-cert\") pod \"console-7dd8568cdd-7g6v9\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:12:50.880315 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.880231 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f970ad2f-d529-4e13-86a5-44e4cc962586-oauth-serving-cert\") pod \"console-7dd8568cdd-7g6v9\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:12:50.880315 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.880281 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f970ad2f-d529-4e13-86a5-44e4cc962586-console-oauth-config\") pod \"console-7dd8568cdd-7g6v9\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:12:50.880315 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.880311 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f970ad2f-d529-4e13-86a5-44e4cc962586-console-config\") pod \"console-7dd8568cdd-7g6v9\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:12:50.880581 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.880336 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f970ad2f-d529-4e13-86a5-44e4cc962586-service-ca\") pod \"console-7dd8568cdd-7g6v9\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:12:50.880581 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.880361 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f970ad2f-d529-4e13-86a5-44e4cc962586-trusted-ca-bundle\") pod \"console-7dd8568cdd-7g6v9\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:12:50.880581 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.880388 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f970ad2f-d529-4e13-86a5-44e4cc962586-console-serving-cert\") pod \"console-7dd8568cdd-7g6v9\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:12:50.880581 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.880458 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zk2tm\" (UniqueName: \"kubernetes.io/projected/f970ad2f-d529-4e13-86a5-44e4cc962586-kube-api-access-zk2tm\") pod \"console-7dd8568cdd-7g6v9\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:12:50.881175 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.881114 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f970ad2f-d529-4e13-86a5-44e4cc962586-oauth-serving-cert\") pod \"console-7dd8568cdd-7g6v9\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:12:50.881175 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.881157 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f970ad2f-d529-4e13-86a5-44e4cc962586-service-ca\") pod \"console-7dd8568cdd-7g6v9\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:12:50.881345 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.881304 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f970ad2f-d529-4e13-86a5-44e4cc962586-trusted-ca-bundle\") pod \"console-7dd8568cdd-7g6v9\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:12:50.883163 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.883138 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f970ad2f-d529-4e13-86a5-44e4cc962586-console-oauth-config\") pod \"console-7dd8568cdd-7g6v9\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:12:50.883400 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.883381 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f970ad2f-d529-4e13-86a5-44e4cc962586-console-serving-cert\") pod \"console-7dd8568cdd-7g6v9\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:12:50.888588 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.888555 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk2tm\" (UniqueName: \"kubernetes.io/projected/f970ad2f-d529-4e13-86a5-44e4cc962586-kube-api-access-zk2tm\") pod \"console-7dd8568cdd-7g6v9\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:12:50.891557 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.891525 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f970ad2f-d529-4e13-86a5-44e4cc962586-console-config\") pod \"console-7dd8568cdd-7g6v9\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:12:50.952477 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:50.952448 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:12:51.104725 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:51.104676 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dd8568cdd-7g6v9"] May 27 20:12:51.108170 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:12:51.108137 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf970ad2f_d529_4e13_86a5_44e4cc962586.slice/crio-7760d71ad57674513619810eb55cc8a2edde4b8baf015568d62b8a85e92a706b WatchSource:0}: Error finding container 7760d71ad57674513619810eb55cc8a2edde4b8baf015568d62b8a85e92a706b: Status 404 returned error can't find the container with id 7760d71ad57674513619810eb55cc8a2edde4b8baf015568d62b8a85e92a706b May 27 20:12:51.440989 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:51.440946 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd8568cdd-7g6v9" event={"ID":"f970ad2f-d529-4e13-86a5-44e4cc962586","Type":"ContainerStarted","Data":"7760d71ad57674513619810eb55cc8a2edde4b8baf015568d62b8a85e92a706b"} May 27 20:12:53.449167 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:53.449132 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd8568cdd-7g6v9" event={"ID":"f970ad2f-d529-4e13-86a5-44e4cc962586","Type":"ContainerStarted","Data":"302e9a398bf2bb8303e48a1f1b8f2f5eb1a569137e2cb65d8f5bce44df50bb1d"} May 27 20:12:53.450566 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:53.450538 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64f6bb5d44-kwv66" event={"ID":"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17","Type":"ContainerStarted","Data":"f363f27145c93e228669fbf813f4f4729cf35fa891613cea1653ae51f819672a"} May 27 20:12:53.465878 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:53.465841 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7dd8568cdd-7g6v9" podStartSLOduration=1.33802256 podStartE2EDuration="3.465828285s" podCreationTimestamp="2026-05-27 20:12:50 +0000 UTC" firstStartedPulling="2026-05-27 20:12:51.11044537 +0000 UTC m=+80.638514004" lastFinishedPulling="2026-05-27 20:12:53.238251108 +0000 UTC m=+82.766319729" observedRunningTime="2026-05-27 20:12:53.464819511 +0000 UTC m=+82.992888153" watchObservedRunningTime="2026-05-27 20:12:53.465828285 +0000 UTC m=+82.993896926" May 27 20:12:55.001317 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:55.001285 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:12:55.021973 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:55.021925 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-64f6bb5d44-kwv66" podStartSLOduration=2.780199312 podStartE2EDuration="7.021910693s" podCreationTimestamp="2026-05-27 20:12:48 +0000 UTC" firstStartedPulling="2026-05-27 20:12:48.989599988 +0000 UTC m=+78.517668607" lastFinishedPulling="2026-05-27 20:12:53.231311358 +0000 UTC m=+82.759379988" observedRunningTime="2026-05-27 20:12:53.480899782 +0000 UTC m=+83.008968447" watchObservedRunningTime="2026-05-27 20:12:55.021910693 +0000 UTC m=+84.549979335" May 27 20:12:57.034528 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.033536 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4cbtv"] May 27 20:12:57.036763 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.036680 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.041448 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.040304 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mflgp\"" May 27 20:12:57.041448 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.040663 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 27 20:12:57.041448 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.040847 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 27 20:12:57.041448 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.041110 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 27 20:12:57.041448 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.041270 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 27 20:12:57.132803 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.132766 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-sys\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.132803 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.132809 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-node-exporter-tls\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.133008 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.132836 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-root\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.133008 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.132882 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-metrics-client-ca\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.133008 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.132950 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.133008 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.132983 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.133151 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.133011 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-node-exporter-wtmp\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.133151 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.133042 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q67sm\" (UniqueName: \"kubernetes.io/projected/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-kube-api-access-q67sm\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.133151 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.133079 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-node-exporter-textfile\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.233737 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.233698 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-sys\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.233896 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.233746 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-node-exporter-tls\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.233896 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.233781 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-root\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.233896 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.233828 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-metrics-client-ca\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.233896 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.233874 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.233896 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.233882 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-sys\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.234174 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.233903 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.234174 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.233958 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-node-exporter-wtmp\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.234174 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.234012 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q67sm\" (UniqueName: \"kubernetes.io/projected/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-kube-api-access-q67sm\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.234174 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.234043 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-node-exporter-textfile\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.234372 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.234345 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-node-exporter-textfile\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.234509 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.234487 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-node-exporter-wtmp\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.234780 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.234727 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-root\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.235024 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.234981 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.235116 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.235082 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-metrics-client-ca\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.237219 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.237199 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.237862 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.237839 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-node-exporter-tls\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.243454 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.243435 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q67sm\" (UniqueName: \"kubernetes.io/projected/5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd-kube-api-access-q67sm\") pod \"node-exporter-4cbtv\" (UID: \"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd\") " pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.354480 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.354402 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4cbtv" May 27 20:12:57.365993 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:12:57.365964 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fc52c5a_bc8c_4d9d_8fe4_e33bd3e898fd.slice/crio-1aa55b22f5df195a5aa5010fa35757a7e776fcc6c42825162259ba1762ac8a5a WatchSource:0}: Error finding container 1aa55b22f5df195a5aa5010fa35757a7e776fcc6c42825162259ba1762ac8a5a: Status 404 returned error can't find the container with id 1aa55b22f5df195a5aa5010fa35757a7e776fcc6c42825162259ba1762ac8a5a May 27 20:12:57.464601 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:57.464555 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4cbtv" event={"ID":"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd","Type":"ContainerStarted","Data":"1aa55b22f5df195a5aa5010fa35757a7e776fcc6c42825162259ba1762ac8a5a"} May 27 20:12:58.012532 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.012496 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 20:12:58.017527 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.017499 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.020148 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.020121 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 27 20:12:58.020269 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.020136 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 27 20:12:58.020357 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.020341 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 27 20:12:58.020553 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.020535 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 27 20:12:58.020670 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.020659 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 27 20:12:58.020960 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.020923 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 27 20:12:58.021588 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.021474 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 27 20:12:58.021588 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.021549 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 27 20:12:58.021757 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.021551 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 27 20:12:58.021757 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.021690 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l566d\"" May 27 20:12:58.028167 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.028129 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 20:12:58.042077 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.042046 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dad89792-4533-4bc9-a798-540e06e1acd7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.042077 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.042075 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dad89792-4533-4bc9-a798-540e06e1acd7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.042482 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.042093 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dad89792-4533-4bc9-a798-540e06e1acd7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.042482 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.042112 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg9v2\" (UniqueName: \"kubernetes.io/projected/dad89792-4533-4bc9-a798-540e06e1acd7-kube-api-access-hg9v2\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.042482 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.042129 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dad89792-4533-4bc9-a798-540e06e1acd7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.042482 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.042149 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dad89792-4533-4bc9-a798-540e06e1acd7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.042482 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.042165 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dad89792-4533-4bc9-a798-540e06e1acd7-config-out\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.042482 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.042179 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dad89792-4533-4bc9-a798-540e06e1acd7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.042482 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.042194 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dad89792-4533-4bc9-a798-540e06e1acd7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.042482 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.042210 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dad89792-4533-4bc9-a798-540e06e1acd7-web-config\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.042482 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.042234 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dad89792-4533-4bc9-a798-540e06e1acd7-config-volume\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.042482 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.042262 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dad89792-4533-4bc9-a798-540e06e1acd7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.042482 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.042290 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dad89792-4533-4bc9-a798-540e06e1acd7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.143345 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.143311 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hg9v2\" (UniqueName: \"kubernetes.io/projected/dad89792-4533-4bc9-a798-540e06e1acd7-kube-api-access-hg9v2\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.143345 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.143357 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dad89792-4533-4bc9-a798-540e06e1acd7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.143553 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.143393 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dad89792-4533-4bc9-a798-540e06e1acd7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.143553 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.143418 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dad89792-4533-4bc9-a798-540e06e1acd7-config-out\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.143553 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.143442 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dad89792-4533-4bc9-a798-540e06e1acd7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.143553 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.143466 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dad89792-4533-4bc9-a798-540e06e1acd7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.143553 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.143491 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dad89792-4533-4bc9-a798-540e06e1acd7-web-config\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.143553 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.143526 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dad89792-4533-4bc9-a798-540e06e1acd7-config-volume\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.144929 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.143567 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dad89792-4533-4bc9-a798-540e06e1acd7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.144929 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.143609 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dad89792-4533-4bc9-a798-540e06e1acd7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.144929 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.143672 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dad89792-4533-4bc9-a798-540e06e1acd7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.144929 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.143700 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dad89792-4533-4bc9-a798-540e06e1acd7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.144929 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.143726 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dad89792-4533-4bc9-a798-540e06e1acd7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.144929 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:12:58.143870 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dad89792-4533-4bc9-a798-540e06e1acd7-alertmanager-trusted-ca-bundle podName:dad89792-4533-4bc9-a798-540e06e1acd7 nodeName:}" failed. No retries permitted until 2026-05-27 20:12:58.64384574 +0000 UTC m=+88.171914366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/dad89792-4533-4bc9-a798-540e06e1acd7-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "dad89792-4533-4bc9-a798-540e06e1acd7") : configmap references non-existent config key: ca-bundle.crt May 27 20:12:58.144929 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.144594 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dad89792-4533-4bc9-a798-540e06e1acd7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.146966 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.146941 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dad89792-4533-4bc9-a798-540e06e1acd7-config-volume\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.147258 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.147234 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dad89792-4533-4bc9-a798-540e06e1acd7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.148235 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.148127 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dad89792-4533-4bc9-a798-540e06e1acd7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.150485 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.150439 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dad89792-4533-4bc9-a798-540e06e1acd7-config-out\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.150731 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.150711 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dad89792-4533-4bc9-a798-540e06e1acd7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.151044 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.150995 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dad89792-4533-4bc9-a798-540e06e1acd7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.151655 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.151512 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dad89792-4533-4bc9-a798-540e06e1acd7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.151814 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.151773 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dad89792-4533-4bc9-a798-540e06e1acd7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.151882 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.151864 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dad89792-4533-4bc9-a798-540e06e1acd7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.152456 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.152416 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg9v2\" (UniqueName: \"kubernetes.io/projected/dad89792-4533-4bc9-a798-540e06e1acd7-kube-api-access-hg9v2\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.154297 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.154275 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dad89792-4533-4bc9-a798-540e06e1acd7-web-config\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.337898 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.333833 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:12:58.337898 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.333888 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:12:58.342077 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.342051 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:12:58.472050 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.472017 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:12:58.649473 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.649376 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dad89792-4533-4bc9-a798-540e06e1acd7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.650167 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.650137 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dad89792-4533-4bc9-a798-540e06e1acd7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dad89792-4533-4bc9-a798-540e06e1acd7\") " pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:58.932826 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:58.932798 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 20:12:59.028312 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.028274 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-85757fdc65-tjl7p"] May 27 20:12:59.032517 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.032494 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.035096 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.035071 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 27 20:12:59.035245 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.035221 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 27 20:12:59.035245 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.035238 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4684l\"" May 27 20:12:59.035396 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.035294 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 27 20:12:59.035396 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.035221 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5u9ptam0rnn1\"" May 27 20:12:59.035396 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.035370 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 27 20:12:59.035610 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.035527 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 27 20:12:59.042852 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.042828 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-85757fdc65-tjl7p"] May 27 20:12:59.053425 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.053399 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3d96ebcd-18f4-438b-9a1c-86718d1dd0e8-secret-grpc-tls\") pod \"thanos-querier-85757fdc65-tjl7p\" (UID: \"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8\") " pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.053531 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.053453 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d96ebcd-18f4-438b-9a1c-86718d1dd0e8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85757fdc65-tjl7p\" (UID: \"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8\") " pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.053531 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.053512 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k7gg\" (UniqueName: \"kubernetes.io/projected/3d96ebcd-18f4-438b-9a1c-86718d1dd0e8-kube-api-access-7k7gg\") pod \"thanos-querier-85757fdc65-tjl7p\" (UID: \"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8\") " pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.053672 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.053586 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d96ebcd-18f4-438b-9a1c-86718d1dd0e8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85757fdc65-tjl7p\" (UID: \"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8\") " pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.053672 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.053608 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3d96ebcd-18f4-438b-9a1c-86718d1dd0e8-secret-thanos-querier-tls\") pod \"thanos-querier-85757fdc65-tjl7p\" (UID: \"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8\") " pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.053780 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.053686 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3d96ebcd-18f4-438b-9a1c-86718d1dd0e8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85757fdc65-tjl7p\" (UID: \"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8\") " pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.053780 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.053722 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d96ebcd-18f4-438b-9a1c-86718d1dd0e8-metrics-client-ca\") pod \"thanos-querier-85757fdc65-tjl7p\" (UID: \"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8\") " pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.053780 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.053745 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3d96ebcd-18f4-438b-9a1c-86718d1dd0e8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85757fdc65-tjl7p\" (UID: \"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8\") " pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.154795 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.154757 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3d96ebcd-18f4-438b-9a1c-86718d1dd0e8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85757fdc65-tjl7p\" (UID: \"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8\") " pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.154975 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.154807 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d96ebcd-18f4-438b-9a1c-86718d1dd0e8-metrics-client-ca\") pod \"thanos-querier-85757fdc65-tjl7p\" (UID: \"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8\") " pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.154975 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.154839 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3d96ebcd-18f4-438b-9a1c-86718d1dd0e8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85757fdc65-tjl7p\" (UID: \"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8\") " pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.154975 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.154871 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3d96ebcd-18f4-438b-9a1c-86718d1dd0e8-secret-grpc-tls\") pod \"thanos-querier-85757fdc65-tjl7p\" (UID: \"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8\") " pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.154975 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.154902 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d96ebcd-18f4-438b-9a1c-86718d1dd0e8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85757fdc65-tjl7p\" (UID: \"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8\") " pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.154975 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.154928 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7k7gg\" (UniqueName: \"kubernetes.io/projected/3d96ebcd-18f4-438b-9a1c-86718d1dd0e8-kube-api-access-7k7gg\") pod \"thanos-querier-85757fdc65-tjl7p\" (UID: \"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8\") " pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.155200 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.155008 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d96ebcd-18f4-438b-9a1c-86718d1dd0e8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85757fdc65-tjl7p\" (UID: \"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8\") " pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.155200 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.155039 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3d96ebcd-18f4-438b-9a1c-86718d1dd0e8-secret-thanos-querier-tls\") pod \"thanos-querier-85757fdc65-tjl7p\" (UID: \"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8\") " pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.155646 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.155603 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d96ebcd-18f4-438b-9a1c-86718d1dd0e8-metrics-client-ca\") pod \"thanos-querier-85757fdc65-tjl7p\" (UID: \"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8\") " pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.158157 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.158067 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3d96ebcd-18f4-438b-9a1c-86718d1dd0e8-secret-grpc-tls\") pod \"thanos-querier-85757fdc65-tjl7p\" (UID: \"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8\") " pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.158157 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.158092 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d96ebcd-18f4-438b-9a1c-86718d1dd0e8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85757fdc65-tjl7p\" (UID: \"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8\") " pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.158157 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.158112 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3d96ebcd-18f4-438b-9a1c-86718d1dd0e8-secret-thanos-querier-tls\") pod \"thanos-querier-85757fdc65-tjl7p\" (UID: \"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8\") " pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.158355 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.158284 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3d96ebcd-18f4-438b-9a1c-86718d1dd0e8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85757fdc65-tjl7p\" (UID: \"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8\") " pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.158586 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.158559 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3d96ebcd-18f4-438b-9a1c-86718d1dd0e8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85757fdc65-tjl7p\" (UID: \"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8\") " pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.159040 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.159018 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d96ebcd-18f4-438b-9a1c-86718d1dd0e8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85757fdc65-tjl7p\" (UID: \"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8\") " pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.163245 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.163224 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k7gg\" (UniqueName: \"kubernetes.io/projected/3d96ebcd-18f4-438b-9a1c-86718d1dd0e8-kube-api-access-7k7gg\") pod \"thanos-querier-85757fdc65-tjl7p\" (UID: \"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8\") " pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:12:59.345053 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:12:59.344966 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:13:00.953445 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:00.953403 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:13:00.953445 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:00.953460 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:13:00.959614 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:00.959567 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:13:01.482125 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.482092 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:13:01.554375 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.554344 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8"] May 27 20:13:01.560352 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.560326 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64f6bb5d44-kwv66"] May 27 20:13:01.560729 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.560711 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:01.566091 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.565907 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 27 20:13:01.566091 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.565944 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-x4mxj\"" May 27 20:13:01.566091 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.566049 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 27 20:13:01.566313 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.566128 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 27 20:13:01.566367 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.566343 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 27 20:13:01.566771 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.566747 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1nusba916f48a\"" May 27 20:13:01.580063 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.580037 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8"] May 27 20:13:01.679345 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.679312 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a56e4b67-e0c3-49af-ae40-143730eec714-secret-metrics-server-client-certs\") pod \"metrics-server-5bc8c4b5c-vbsp8\" (UID: \"a56e4b67-e0c3-49af-ae40-143730eec714\") " pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:01.679496 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.679364 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a56e4b67-e0c3-49af-ae40-143730eec714-metrics-server-audit-profiles\") pod \"metrics-server-5bc8c4b5c-vbsp8\" (UID: \"a56e4b67-e0c3-49af-ae40-143730eec714\") " pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:01.679561 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.679492 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a56e4b67-e0c3-49af-ae40-143730eec714-client-ca-bundle\") pod \"metrics-server-5bc8c4b5c-vbsp8\" (UID: \"a56e4b67-e0c3-49af-ae40-143730eec714\") " pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:01.679561 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.679520 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a56e4b67-e0c3-49af-ae40-143730eec714-secret-metrics-server-tls\") pod \"metrics-server-5bc8c4b5c-vbsp8\" (UID: \"a56e4b67-e0c3-49af-ae40-143730eec714\") " pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:01.679561 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.679539 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhbv5\" (UniqueName: \"kubernetes.io/projected/a56e4b67-e0c3-49af-ae40-143730eec714-kube-api-access-qhbv5\") pod \"metrics-server-5bc8c4b5c-vbsp8\" (UID: \"a56e4b67-e0c3-49af-ae40-143730eec714\") " pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:01.679747 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.679562 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a56e4b67-e0c3-49af-ae40-143730eec714-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bc8c4b5c-vbsp8\" (UID: \"a56e4b67-e0c3-49af-ae40-143730eec714\") " pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:01.679856 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.679832 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a56e4b67-e0c3-49af-ae40-143730eec714-audit-log\") pod \"metrics-server-5bc8c4b5c-vbsp8\" (UID: \"a56e4b67-e0c3-49af-ae40-143730eec714\") " pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:01.781235 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.781145 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a56e4b67-e0c3-49af-ae40-143730eec714-client-ca-bundle\") pod \"metrics-server-5bc8c4b5c-vbsp8\" (UID: \"a56e4b67-e0c3-49af-ae40-143730eec714\") " pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:01.781235 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.781199 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a56e4b67-e0c3-49af-ae40-143730eec714-secret-metrics-server-tls\") pod \"metrics-server-5bc8c4b5c-vbsp8\" (UID: \"a56e4b67-e0c3-49af-ae40-143730eec714\") " pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:01.781235 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.781228 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qhbv5\" (UniqueName: \"kubernetes.io/projected/a56e4b67-e0c3-49af-ae40-143730eec714-kube-api-access-qhbv5\") pod \"metrics-server-5bc8c4b5c-vbsp8\" (UID: \"a56e4b67-e0c3-49af-ae40-143730eec714\") " pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:01.781505 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.781257 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a56e4b67-e0c3-49af-ae40-143730eec714-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bc8c4b5c-vbsp8\" (UID: \"a56e4b67-e0c3-49af-ae40-143730eec714\") " pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:01.781505 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.781292 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a56e4b67-e0c3-49af-ae40-143730eec714-audit-log\") pod \"metrics-server-5bc8c4b5c-vbsp8\" (UID: \"a56e4b67-e0c3-49af-ae40-143730eec714\") " pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:01.781505 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.781328 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a56e4b67-e0c3-49af-ae40-143730eec714-secret-metrics-server-client-certs\") pod \"metrics-server-5bc8c4b5c-vbsp8\" (UID: \"a56e4b67-e0c3-49af-ae40-143730eec714\") " pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:01.781505 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.781369 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a56e4b67-e0c3-49af-ae40-143730eec714-metrics-server-audit-profiles\") pod \"metrics-server-5bc8c4b5c-vbsp8\" (UID: \"a56e4b67-e0c3-49af-ae40-143730eec714\") " pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:01.782610 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.782542 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a56e4b67-e0c3-49af-ae40-143730eec714-metrics-server-audit-profiles\") pod \"metrics-server-5bc8c4b5c-vbsp8\" (UID: \"a56e4b67-e0c3-49af-ae40-143730eec714\") " pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:01.782741 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.782645 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a56e4b67-e0c3-49af-ae40-143730eec714-audit-log\") pod \"metrics-server-5bc8c4b5c-vbsp8\" (UID: \"a56e4b67-e0c3-49af-ae40-143730eec714\") " pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:01.783210 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.783178 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a56e4b67-e0c3-49af-ae40-143730eec714-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bc8c4b5c-vbsp8\" (UID: \"a56e4b67-e0c3-49af-ae40-143730eec714\") " pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:01.785954 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.785930 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a56e4b67-e0c3-49af-ae40-143730eec714-secret-metrics-server-tls\") pod \"metrics-server-5bc8c4b5c-vbsp8\" (UID: \"a56e4b67-e0c3-49af-ae40-143730eec714\") " pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:01.786053 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.786036 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a56e4b67-e0c3-49af-ae40-143730eec714-client-ca-bundle\") pod \"metrics-server-5bc8c4b5c-vbsp8\" (UID: \"a56e4b67-e0c3-49af-ae40-143730eec714\") " pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:01.786595 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.786574 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a56e4b67-e0c3-49af-ae40-143730eec714-secret-metrics-server-client-certs\") pod \"metrics-server-5bc8c4b5c-vbsp8\" (UID: \"a56e4b67-e0c3-49af-ae40-143730eec714\") " pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:01.793382 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.793255 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhbv5\" (UniqueName: \"kubernetes.io/projected/a56e4b67-e0c3-49af-ae40-143730eec714-kube-api-access-qhbv5\") pod \"metrics-server-5bc8c4b5c-vbsp8\" (UID: \"a56e4b67-e0c3-49af-ae40-143730eec714\") " pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:01.835278 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.835246 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-76wd4"] May 27 20:13:01.839895 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.839869 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-76wd4" May 27 20:13:01.843521 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.843480 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 27 20:13:01.843521 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.843499 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-2gt72\"" May 27 20:13:01.852025 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.851983 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-76wd4"] May 27 20:13:01.872869 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.872845 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:01.882924 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.882899 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/82539367-b967-4328-a53b-e0e71ff6ae8c-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-76wd4\" (UID: \"82539367-b967-4328-a53b-e0e71ff6ae8c\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-76wd4" May 27 20:13:01.984255 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:01.984217 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/82539367-b967-4328-a53b-e0e71ff6ae8c-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-76wd4\" (UID: \"82539367-b967-4328-a53b-e0e71ff6ae8c\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-76wd4" May 27 20:13:01.984751 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:13:01.984363 2554 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 27 20:13:01.984751 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:13:01.984445 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82539367-b967-4328-a53b-e0e71ff6ae8c-monitoring-plugin-cert podName:82539367-b967-4328-a53b-e0e71ff6ae8c nodeName:}" failed. No retries permitted until 2026-05-27 20:13:02.484423248 +0000 UTC m=+92.012491883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/82539367-b967-4328-a53b-e0e71ff6ae8c-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-76wd4" (UID: "82539367-b967-4328-a53b-e0e71ff6ae8c") : secret "monitoring-plugin-cert" not found May 27 20:13:02.302115 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.302082 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6"] May 27 20:13:02.305762 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.305738 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.309091 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.309065 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 27 20:13:02.309091 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.309078 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 27 20:13:02.309264 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.309184 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 27 20:13:02.309264 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.309216 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 27 20:13:02.309467 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.309452 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 27 20:13:02.309659 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.309646 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-x9c7q\"" May 27 20:13:02.318938 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.318920 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 27 20:13:02.326156 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.326122 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6"] May 27 20:13:02.387483 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.387407 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/47216135-f4cd-46eb-8111-a68eabc24fa9-federate-client-tls\") pod \"telemeter-client-5cdd44b4f8-7xgv6\" (UID: \"47216135-f4cd-46eb-8111-a68eabc24fa9\") " pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.387483 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.387464 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttzpq\" (UniqueName: \"kubernetes.io/projected/47216135-f4cd-46eb-8111-a68eabc24fa9-kube-api-access-ttzpq\") pod \"telemeter-client-5cdd44b4f8-7xgv6\" (UID: \"47216135-f4cd-46eb-8111-a68eabc24fa9\") " pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.387740 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.387504 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47216135-f4cd-46eb-8111-a68eabc24fa9-metrics-client-ca\") pod \"telemeter-client-5cdd44b4f8-7xgv6\" (UID: \"47216135-f4cd-46eb-8111-a68eabc24fa9\") " pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.387740 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.387582 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47216135-f4cd-46eb-8111-a68eabc24fa9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5cdd44b4f8-7xgv6\" (UID: \"47216135-f4cd-46eb-8111-a68eabc24fa9\") " pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.387740 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.387688 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/47216135-f4cd-46eb-8111-a68eabc24fa9-secret-telemeter-client\") pod \"telemeter-client-5cdd44b4f8-7xgv6\" (UID: \"47216135-f4cd-46eb-8111-a68eabc24fa9\") " pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.387740 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.387724 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/47216135-f4cd-46eb-8111-a68eabc24fa9-telemeter-client-tls\") pod \"telemeter-client-5cdd44b4f8-7xgv6\" (UID: \"47216135-f4cd-46eb-8111-a68eabc24fa9\") " pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.387940 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.387750 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47216135-f4cd-46eb-8111-a68eabc24fa9-serving-certs-ca-bundle\") pod \"telemeter-client-5cdd44b4f8-7xgv6\" (UID: \"47216135-f4cd-46eb-8111-a68eabc24fa9\") " pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.387940 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.387776 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47216135-f4cd-46eb-8111-a68eabc24fa9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5cdd44b4f8-7xgv6\" (UID: \"47216135-f4cd-46eb-8111-a68eabc24fa9\") " pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.488745 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.488711 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/47216135-f4cd-46eb-8111-a68eabc24fa9-secret-telemeter-client\") pod \"telemeter-client-5cdd44b4f8-7xgv6\" (UID: \"47216135-f4cd-46eb-8111-a68eabc24fa9\") " pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.488955 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.488757 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/47216135-f4cd-46eb-8111-a68eabc24fa9-telemeter-client-tls\") pod \"telemeter-client-5cdd44b4f8-7xgv6\" (UID: \"47216135-f4cd-46eb-8111-a68eabc24fa9\") " pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.488955 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.488789 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47216135-f4cd-46eb-8111-a68eabc24fa9-serving-certs-ca-bundle\") pod \"telemeter-client-5cdd44b4f8-7xgv6\" (UID: \"47216135-f4cd-46eb-8111-a68eabc24fa9\") " pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.488955 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.488813 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47216135-f4cd-46eb-8111-a68eabc24fa9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5cdd44b4f8-7xgv6\" (UID: \"47216135-f4cd-46eb-8111-a68eabc24fa9\") " pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.488955 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.488838 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/47216135-f4cd-46eb-8111-a68eabc24fa9-federate-client-tls\") pod \"telemeter-client-5cdd44b4f8-7xgv6\" (UID: \"47216135-f4cd-46eb-8111-a68eabc24fa9\") " pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.488955 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.488873 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ttzpq\" (UniqueName: \"kubernetes.io/projected/47216135-f4cd-46eb-8111-a68eabc24fa9-kube-api-access-ttzpq\") pod \"telemeter-client-5cdd44b4f8-7xgv6\" (UID: \"47216135-f4cd-46eb-8111-a68eabc24fa9\") " pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.488955 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.488919 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47216135-f4cd-46eb-8111-a68eabc24fa9-metrics-client-ca\") pod \"telemeter-client-5cdd44b4f8-7xgv6\" (UID: \"47216135-f4cd-46eb-8111-a68eabc24fa9\") " pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.489240 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.488977 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/82539367-b967-4328-a53b-e0e71ff6ae8c-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-76wd4\" (UID: \"82539367-b967-4328-a53b-e0e71ff6ae8c\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-76wd4" May 27 20:13:02.489240 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.489028 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47216135-f4cd-46eb-8111-a68eabc24fa9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5cdd44b4f8-7xgv6\" (UID: \"47216135-f4cd-46eb-8111-a68eabc24fa9\") " pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.490654 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.489891 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47216135-f4cd-46eb-8111-a68eabc24fa9-serving-certs-ca-bundle\") pod \"telemeter-client-5cdd44b4f8-7xgv6\" (UID: \"47216135-f4cd-46eb-8111-a68eabc24fa9\") " pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.490654 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.490065 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47216135-f4cd-46eb-8111-a68eabc24fa9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5cdd44b4f8-7xgv6\" (UID: \"47216135-f4cd-46eb-8111-a68eabc24fa9\") " pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.490654 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.490600 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47216135-f4cd-46eb-8111-a68eabc24fa9-metrics-client-ca\") pod \"telemeter-client-5cdd44b4f8-7xgv6\" (UID: \"47216135-f4cd-46eb-8111-a68eabc24fa9\") " pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.492053 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.492030 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/47216135-f4cd-46eb-8111-a68eabc24fa9-secret-telemeter-client\") pod \"telemeter-client-5cdd44b4f8-7xgv6\" (UID: \"47216135-f4cd-46eb-8111-a68eabc24fa9\") " pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.492372 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.492351 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/82539367-b967-4328-a53b-e0e71ff6ae8c-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-76wd4\" (UID: \"82539367-b967-4328-a53b-e0e71ff6ae8c\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-76wd4" May 27 20:13:02.492863 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.492842 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/47216135-f4cd-46eb-8111-a68eabc24fa9-telemeter-client-tls\") pod \"telemeter-client-5cdd44b4f8-7xgv6\" (UID: \"47216135-f4cd-46eb-8111-a68eabc24fa9\") " pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.492942 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.492897 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47216135-f4cd-46eb-8111-a68eabc24fa9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5cdd44b4f8-7xgv6\" (UID: \"47216135-f4cd-46eb-8111-a68eabc24fa9\") " pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.493174 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.493153 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/47216135-f4cd-46eb-8111-a68eabc24fa9-federate-client-tls\") pod \"telemeter-client-5cdd44b4f8-7xgv6\" (UID: \"47216135-f4cd-46eb-8111-a68eabc24fa9\") " pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.497979 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.497959 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttzpq\" (UniqueName: \"kubernetes.io/projected/47216135-f4cd-46eb-8111-a68eabc24fa9-kube-api-access-ttzpq\") pod \"telemeter-client-5cdd44b4f8-7xgv6\" (UID: \"47216135-f4cd-46eb-8111-a68eabc24fa9\") " pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.617122 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.617045 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" May 27 20:13:02.751612 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:02.751576 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-76wd4" May 27 20:13:05.573550 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:05.571583 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-85757fdc65-tjl7p"] May 27 20:13:05.575820 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:13:05.575767 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d96ebcd_18f4_438b_9a1c_86718d1dd0e8.slice/crio-496ab6566b0d3aec3b02bd898503099a4ee4367475911c5938de9abaa7b753b6 WatchSource:0}: Error finding container 496ab6566b0d3aec3b02bd898503099a4ee4367475911c5938de9abaa7b753b6: Status 404 returned error can't find the container with id 496ab6566b0d3aec3b02bd898503099a4ee4367475911c5938de9abaa7b753b6 May 27 20:13:05.792503 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:05.792476 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6"] May 27 20:13:05.794873 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:05.794844 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 20:13:05.795674 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:13:05.795647 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47216135_f4cd_46eb_8111_a68eabc24fa9.slice/crio-bdbd72f3b75d333a1757f8f47701932f813998224354833e257b462a81c45251 WatchSource:0}: Error finding container bdbd72f3b75d333a1757f8f47701932f813998224354833e257b462a81c45251: Status 404 returned error can't find the container with id bdbd72f3b75d333a1757f8f47701932f813998224354833e257b462a81c45251 May 27 20:13:05.797912 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:13:05.797774 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad89792_4533_4bc9_a798_540e06e1acd7.slice/crio-116cc7edbc684ee8a1f8e0e56ec3a2ed24e30064b93b64fe8e429c5e70f1fd1d WatchSource:0}: Error finding container 116cc7edbc684ee8a1f8e0e56ec3a2ed24e30064b93b64fe8e429c5e70f1fd1d: Status 404 returned error can't find the container with id 116cc7edbc684ee8a1f8e0e56ec3a2ed24e30064b93b64fe8e429c5e70f1fd1d May 27 20:13:05.829002 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:05.828947 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-76wd4"] May 27 20:13:05.832312 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:05.832287 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8"] May 27 20:13:05.832432 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:13:05.832404 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82539367_b967_4328_a53b_e0e71ff6ae8c.slice/crio-30bf76531428da1072d2613810d3866bae9dafa1ecb671dea797e7e64ccc72ef WatchSource:0}: Error finding container 30bf76531428da1072d2613810d3866bae9dafa1ecb671dea797e7e64ccc72ef: Status 404 returned error can't find the container with id 30bf76531428da1072d2613810d3866bae9dafa1ecb671dea797e7e64ccc72ef May 27 20:13:05.835805 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:13:05.835774 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda56e4b67_e0c3_49af_ae40_143730eec714.slice/crio-5940b9422996893f1dbd0f3f2f1910f28f66ef9f2eefbefd8ee59ae4ef993091 WatchSource:0}: Error finding container 5940b9422996893f1dbd0f3f2f1910f28f66ef9f2eefbefd8ee59ae4ef993091: Status 404 returned error can't find the container with id 5940b9422996893f1dbd0f3f2f1910f28f66ef9f2eefbefd8ee59ae4ef993091 May 27 20:13:06.519300 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:06.519246 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dad89792-4533-4bc9-a798-540e06e1acd7","Type":"ContainerStarted","Data":"116cc7edbc684ee8a1f8e0e56ec3a2ed24e30064b93b64fe8e429c5e70f1fd1d"} May 27 20:13:06.521202 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:06.520951 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-76wd4" event={"ID":"82539367-b967-4328-a53b-e0e71ff6ae8c","Type":"ContainerStarted","Data":"30bf76531428da1072d2613810d3866bae9dafa1ecb671dea797e7e64ccc72ef"} May 27 20:13:06.523443 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:06.523390 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" event={"ID":"a56e4b67-e0c3-49af-ae40-143730eec714","Type":"ContainerStarted","Data":"5940b9422996893f1dbd0f3f2f1910f28f66ef9f2eefbefd8ee59ae4ef993091"} May 27 20:13:06.526852 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:06.526824 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" event={"ID":"47216135-f4cd-46eb-8111-a68eabc24fa9","Type":"ContainerStarted","Data":"bdbd72f3b75d333a1757f8f47701932f813998224354833e257b462a81c45251"} May 27 20:13:06.530150 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:06.530085 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" event={"ID":"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8","Type":"ContainerStarted","Data":"496ab6566b0d3aec3b02bd898503099a4ee4367475911c5938de9abaa7b753b6"} May 27 20:13:06.536329 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:06.533283 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-vmck4" event={"ID":"b00b05e6-6ed0-457d-882c-402d915f029e","Type":"ContainerStarted","Data":"3ca2c6c1eadf4e65995280213121d331b1ea1ecf060e1bf3b266aef7114212de"} May 27 20:13:06.536329 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:06.536138 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-vmck4" May 27 20:13:06.541190 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:06.541164 2554 generic.go:358] "Generic (PLEG): container finished" podID="5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd" containerID="4072c75a630759af5ea2137ea731510672e18a0e960cd90feb24f288ea2416d4" exitCode=0 May 27 20:13:06.541580 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:06.541299 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4cbtv" event={"ID":"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd","Type":"ContainerDied","Data":"4072c75a630759af5ea2137ea731510672e18a0e960cd90feb24f288ea2416d4"} May 27 20:13:06.547460 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:06.547427 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-vmck4" May 27 20:13:06.586878 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:06.586506 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-vmck4" podStartSLOduration=1.615356034 podStartE2EDuration="21.586487266s" podCreationTimestamp="2026-05-27 20:12:45 +0000 UTC" firstStartedPulling="2026-05-27 20:12:45.469263933 +0000 UTC m=+74.997332553" lastFinishedPulling="2026-05-27 20:13:05.440395163 +0000 UTC m=+94.968463785" observedRunningTime="2026-05-27 20:13:06.553046638 +0000 UTC m=+96.081115281" watchObservedRunningTime="2026-05-27 20:13:06.586487266 +0000 UTC m=+96.114555911" May 27 20:13:07.556256 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:07.556145 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4cbtv" event={"ID":"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd","Type":"ContainerStarted","Data":"feaefd07c2aadd6fe78ff6d360c65a8c8dbdba9787a915ac962759dd07510df2"} May 27 20:13:07.556256 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:07.556192 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4cbtv" event={"ID":"5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd","Type":"ContainerStarted","Data":"f80cd370a848e57613ca9b653ac0d5448fc50727fced10c3325438a25e5687ff"} May 27 20:13:07.580410 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:07.580353 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4cbtv" podStartSLOduration=2.585178921 podStartE2EDuration="10.580333381s" podCreationTimestamp="2026-05-27 20:12:57 +0000 UTC" firstStartedPulling="2026-05-27 20:12:57.367973715 +0000 UTC m=+86.896042335" lastFinishedPulling="2026-05-27 20:13:05.363128162 +0000 UTC m=+94.891196795" observedRunningTime="2026-05-27 20:13:07.578951637 +0000 UTC m=+97.107020281" watchObservedRunningTime="2026-05-27 20:13:07.580333381 +0000 UTC m=+97.108402024" May 27 20:13:10.013454 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:10.013377 2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" podUID="6fbb9f64-eea9-4507-a785-4ad5104b601d" containerName="registry" containerID="cri-o://70b9f7f6cfb8d9a4ddb553ee6d7b154309ea343980bea67ec72404e1d25c462c" gracePeriod=30 May 27 20:13:11.233996 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.233971 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:13:11.280013 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.279988 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5qtr\" (UniqueName: \"kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-kube-api-access-c5qtr\") pod \"6fbb9f64-eea9-4507-a785-4ad5104b601d\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " May 27 20:13:11.280135 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.280045 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6fbb9f64-eea9-4507-a785-4ad5104b601d-image-registry-private-configuration\") pod \"6fbb9f64-eea9-4507-a785-4ad5104b601d\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " May 27 20:13:11.280135 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.280069 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6fbb9f64-eea9-4507-a785-4ad5104b601d-ca-trust-extracted\") pod \"6fbb9f64-eea9-4507-a785-4ad5104b601d\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " May 27 20:13:11.280135 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.280108 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6fbb9f64-eea9-4507-a785-4ad5104b601d-installation-pull-secrets\") pod \"6fbb9f64-eea9-4507-a785-4ad5104b601d\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " May 27 20:13:11.280301 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.280142 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-tls\") pod \"6fbb9f64-eea9-4507-a785-4ad5104b601d\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " May 27 20:13:11.280301 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.280171 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-certificates\") pod \"6fbb9f64-eea9-4507-a785-4ad5104b601d\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " May 27 20:13:11.280301 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.280212 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-bound-sa-token\") pod \"6fbb9f64-eea9-4507-a785-4ad5104b601d\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " May 27 20:13:11.280301 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.280276 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6fbb9f64-eea9-4507-a785-4ad5104b601d-trusted-ca\") pod \"6fbb9f64-eea9-4507-a785-4ad5104b601d\" (UID: \"6fbb9f64-eea9-4507-a785-4ad5104b601d\") " May 27 20:13:11.280825 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.280793 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6fbb9f64-eea9-4507-a785-4ad5104b601d" (UID: "6fbb9f64-eea9-4507-a785-4ad5104b601d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 20:13:11.280971 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.280945 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fbb9f64-eea9-4507-a785-4ad5104b601d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6fbb9f64-eea9-4507-a785-4ad5104b601d" (UID: "6fbb9f64-eea9-4507-a785-4ad5104b601d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 20:13:11.290015 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.289831 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6fbb9f64-eea9-4507-a785-4ad5104b601d" (UID: "6fbb9f64-eea9-4507-a785-4ad5104b601d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:13:11.292144 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.292116 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fbb9f64-eea9-4507-a785-4ad5104b601d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6fbb9f64-eea9-4507-a785-4ad5104b601d" (UID: "6fbb9f64-eea9-4507-a785-4ad5104b601d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 20:13:11.296048 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.296023 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fbb9f64-eea9-4507-a785-4ad5104b601d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6fbb9f64-eea9-4507-a785-4ad5104b601d" (UID: "6fbb9f64-eea9-4507-a785-4ad5104b601d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 20:13:11.296175 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.296031 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-kube-api-access-c5qtr" (OuterVolumeSpecName: "kube-api-access-c5qtr") pod "6fbb9f64-eea9-4507-a785-4ad5104b601d" (UID: "6fbb9f64-eea9-4507-a785-4ad5104b601d"). InnerVolumeSpecName "kube-api-access-c5qtr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:13:11.296461 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.296408 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6fbb9f64-eea9-4507-a785-4ad5104b601d" (UID: "6fbb9f64-eea9-4507-a785-4ad5104b601d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:13:11.296709 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.296604 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fbb9f64-eea9-4507-a785-4ad5104b601d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6fbb9f64-eea9-4507-a785-4ad5104b601d" (UID: "6fbb9f64-eea9-4507-a785-4ad5104b601d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 20:13:11.381456 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.381430 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5qtr\" (UniqueName: \"kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-kube-api-access-c5qtr\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:13:11.381546 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.381464 2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6fbb9f64-eea9-4507-a785-4ad5104b601d-image-registry-private-configuration\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:13:11.381546 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.381480 2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6fbb9f64-eea9-4507-a785-4ad5104b601d-ca-trust-extracted\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:13:11.381546 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.381495 2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6fbb9f64-eea9-4507-a785-4ad5104b601d-installation-pull-secrets\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:13:11.381546 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.381509 2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-tls\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:13:11.381546 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.381524 2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6fbb9f64-eea9-4507-a785-4ad5104b601d-registry-certificates\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:13:11.381546 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.381539 2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fbb9f64-eea9-4507-a785-4ad5104b601d-bound-sa-token\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:13:11.381870 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.381554 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6fbb9f64-eea9-4507-a785-4ad5104b601d-trusted-ca\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:13:11.577353 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.577319 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" event={"ID":"47216135-f4cd-46eb-8111-a68eabc24fa9","Type":"ContainerStarted","Data":"18941b91bea25342a0da6d7c83e1b0edec6ac4ad6fe0f8cc955f2106e6ab202e"} May 27 20:13:11.577446 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.577367 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" event={"ID":"47216135-f4cd-46eb-8111-a68eabc24fa9","Type":"ContainerStarted","Data":"22d91b458ee617371252edbeef37e79f554634285bc3f2ad0c1298dd4f35c4e6"} May 27 20:13:11.578963 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.578938 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" event={"ID":"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8","Type":"ContainerStarted","Data":"b4d65fcb289468c7b388018914ba7b6683a1147ce1b1079efc9b39d40bf33217"} May 27 20:13:11.585889 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.585836 2554 generic.go:358] "Generic (PLEG): container finished" podID="dad89792-4533-4bc9-a798-540e06e1acd7" containerID="6fe3639848f822255add3e1294e40ce8e6d9567bfd5894ff2d3c03ce3cbef2b2" exitCode=0 May 27 20:13:11.586128 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.586104 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dad89792-4533-4bc9-a798-540e06e1acd7","Type":"ContainerDied","Data":"6fe3639848f822255add3e1294e40ce8e6d9567bfd5894ff2d3c03ce3cbef2b2"} May 27 20:13:11.588204 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.587985 2554 generic.go:358] "Generic (PLEG): container finished" podID="6fbb9f64-eea9-4507-a785-4ad5104b601d" containerID="70b9f7f6cfb8d9a4ddb553ee6d7b154309ea343980bea67ec72404e1d25c462c" exitCode=0 May 27 20:13:11.588204 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.588057 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" event={"ID":"6fbb9f64-eea9-4507-a785-4ad5104b601d","Type":"ContainerDied","Data":"70b9f7f6cfb8d9a4ddb553ee6d7b154309ea343980bea67ec72404e1d25c462c"} May 27 20:13:11.588204 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.588082 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" event={"ID":"6fbb9f64-eea9-4507-a785-4ad5104b601d","Type":"ContainerDied","Data":"97f3832df01672744f370657adc826351ca22c4134fe00254513fd817650da6f"} May 27 20:13:11.588204 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.588103 2554 scope.go:117] "RemoveContainer" containerID="70b9f7f6cfb8d9a4ddb553ee6d7b154309ea343980bea67ec72404e1d25c462c" May 27 20:13:11.588204 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.588157 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-775798d4bd-pxkp7" May 27 20:13:11.598681 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.598578 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-76wd4" event={"ID":"82539367-b967-4328-a53b-e0e71ff6ae8c","Type":"ContainerStarted","Data":"e3ed77d2b1761768bf3b049468e65b19f8ad6c39f81917a70ee88560136fdae8"} May 27 20:13:11.599550 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.599517 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-76wd4" May 27 20:13:11.603531 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.602914 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" event={"ID":"a56e4b67-e0c3-49af-ae40-143730eec714","Type":"ContainerStarted","Data":"2a77ceb1232e8bfde80569a0745697daba35a901828f1e55fcbe7df7711b16ee"} May 27 20:13:11.609488 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.609471 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-76wd4" May 27 20:13:11.615089 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.614847 2554 scope.go:117] "RemoveContainer" containerID="70b9f7f6cfb8d9a4ddb553ee6d7b154309ea343980bea67ec72404e1d25c462c" May 27 20:13:11.615702 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:13:11.615676 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70b9f7f6cfb8d9a4ddb553ee6d7b154309ea343980bea67ec72404e1d25c462c\": container with ID starting with 70b9f7f6cfb8d9a4ddb553ee6d7b154309ea343980bea67ec72404e1d25c462c not found: ID does not exist" containerID="70b9f7f6cfb8d9a4ddb553ee6d7b154309ea343980bea67ec72404e1d25c462c" May 27 20:13:11.615859 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.615817 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70b9f7f6cfb8d9a4ddb553ee6d7b154309ea343980bea67ec72404e1d25c462c"} err="failed to get container status \"70b9f7f6cfb8d9a4ddb553ee6d7b154309ea343980bea67ec72404e1d25c462c\": rpc error: code = NotFound desc = could not find container \"70b9f7f6cfb8d9a4ddb553ee6d7b154309ea343980bea67ec72404e1d25c462c\": container with ID starting with 70b9f7f6cfb8d9a4ddb553ee6d7b154309ea343980bea67ec72404e1d25c462c not found: ID does not exist" May 27 20:13:11.632052 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.632005 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-76wd4" podStartSLOduration=5.45627739 podStartE2EDuration="10.6319896s" podCreationTimestamp="2026-05-27 20:13:01 +0000 UTC" firstStartedPulling="2026-05-27 20:13:05.834407366 +0000 UTC m=+95.362475986" lastFinishedPulling="2026-05-27 20:13:11.010119573 +0000 UTC m=+100.538188196" observedRunningTime="2026-05-27 20:13:11.630931798 +0000 UTC m=+101.159000441" watchObservedRunningTime="2026-05-27 20:13:11.6319896 +0000 UTC m=+101.160058243" May 27 20:13:11.651101 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.649794 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-775798d4bd-pxkp7"] May 27 20:13:11.661161 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.660654 2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-775798d4bd-pxkp7"] May 27 20:13:11.676004 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:11.675862 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" podStartSLOduration=5.271533518 podStartE2EDuration="10.675845628s" podCreationTimestamp="2026-05-27 20:13:01 +0000 UTC" firstStartedPulling="2026-05-27 20:13:05.837761581 +0000 UTC m=+95.365830202" lastFinishedPulling="2026-05-27 20:13:11.242073688 +0000 UTC m=+100.770142312" observedRunningTime="2026-05-27 20:13:11.674900972 +0000 UTC m=+101.202969617" watchObservedRunningTime="2026-05-27 20:13:11.675845628 +0000 UTC m=+101.203914282" May 27 20:13:12.399935 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:12.399102 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hm2h8" May 27 20:13:12.610494 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:12.609773 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" event={"ID":"47216135-f4cd-46eb-8111-a68eabc24fa9","Type":"ContainerStarted","Data":"efacf7ddc9067b5703da20336e70e9b83103defd04d12bd21cdf1f3820682810"} May 27 20:13:12.612689 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:12.612594 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" event={"ID":"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8","Type":"ContainerStarted","Data":"341ffa48013f15c19081d6e855f045ca9ff30c405a9927370cb0bfa7f64d11c5"} May 27 20:13:12.612689 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:12.612648 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" event={"ID":"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8","Type":"ContainerStarted","Data":"2df500bfc38da44e34e1fa7612ed776ce965502ee8002f137a2f19203a28c1af"} May 27 20:13:12.643455 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:12.640388 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5cdd44b4f8-7xgv6" podStartSLOduration=5.429092987 podStartE2EDuration="10.640370077s" podCreationTimestamp="2026-05-27 20:13:02 +0000 UTC" firstStartedPulling="2026-05-27 20:13:05.798314198 +0000 UTC m=+95.326382835" lastFinishedPulling="2026-05-27 20:13:11.009591301 +0000 UTC m=+100.537659925" observedRunningTime="2026-05-27 20:13:12.637985884 +0000 UTC m=+102.166054521" watchObservedRunningTime="2026-05-27 20:13:12.640370077 +0000 UTC m=+102.168438718" May 27 20:13:13.056037 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:13.056003 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fbb9f64-eea9-4507-a785-4ad5104b601d" path="/var/lib/kubelet/pods/6fbb9f64-eea9-4507-a785-4ad5104b601d/volumes" May 27 20:13:14.625267 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:14.625239 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" event={"ID":"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8","Type":"ContainerStarted","Data":"796f9fc5e119e51436cc66a2f9e2e04ad8d92c77988f40d63ce1f7c133367627"} May 27 20:13:14.625638 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:14.625282 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" event={"ID":"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8","Type":"ContainerStarted","Data":"0e18ddbe893a42522612154b293a9c20966e348036e8174cb1275f8862fdc869"} May 27 20:13:14.625638 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:14.625298 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" event={"ID":"3d96ebcd-18f4-438b-9a1c-86718d1dd0e8","Type":"ContainerStarted","Data":"bd375142c35363640396fba7f574c148889ff6627eeb0316897094e43501147c"} May 27 20:13:14.625638 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:14.625387 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:13:14.627395 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:14.627377 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dad89792-4533-4bc9-a798-540e06e1acd7","Type":"ContainerStarted","Data":"318f665594c9037dbed7a96d9a24c116d970e308fe1e436f1ba454ff2051ad29"} May 27 20:13:14.627472 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:14.627399 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dad89792-4533-4bc9-a798-540e06e1acd7","Type":"ContainerStarted","Data":"8297abd108ce41ac5c3e6e8840ba78efc0f2445dd743bcfabc5302d6d842fcc4"} May 27 20:13:14.627472 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:14.627411 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dad89792-4533-4bc9-a798-540e06e1acd7","Type":"ContainerStarted","Data":"10f46c1454eb64b3ec1c79efe4cc51303524e5bb3825583059450625bec63a14"} May 27 20:13:14.627472 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:14.627419 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dad89792-4533-4bc9-a798-540e06e1acd7","Type":"ContainerStarted","Data":"4c21560466250a72d74f6b1080007bb3b63d3d5cb860272e496973c3baf6b07c"} May 27 20:13:14.651315 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:14.651276 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" podStartSLOduration=7.501771133 podStartE2EDuration="15.651264812s" podCreationTimestamp="2026-05-27 20:12:59 +0000 UTC" firstStartedPulling="2026-05-27 20:13:05.577780697 +0000 UTC m=+95.105849321" lastFinishedPulling="2026-05-27 20:13:13.727274376 +0000 UTC m=+103.255343000" observedRunningTime="2026-05-27 20:13:14.64923117 +0000 UTC m=+104.177299811" watchObservedRunningTime="2026-05-27 20:13:14.651264812 +0000 UTC m=+104.179333454" May 27 20:13:15.634180 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:15.634141 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dad89792-4533-4bc9-a798-540e06e1acd7","Type":"ContainerStarted","Data":"121627b460eb30206f7d8fdfba600eae7572c6befe4d4b9846d35912e24d30dc"} May 27 20:13:15.634180 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:15.634180 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dad89792-4533-4bc9-a798-540e06e1acd7","Type":"ContainerStarted","Data":"9072e65990b63e6807ffd972ba7153fff02f719177716cda31f64afa0e37f512"} May 27 20:13:15.669427 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:15.669383 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=10.372926448 podStartE2EDuration="18.669368599s" podCreationTimestamp="2026-05-27 20:12:57 +0000 UTC" firstStartedPulling="2026-05-27 20:13:05.801153102 +0000 UTC m=+95.329221736" lastFinishedPulling="2026-05-27 20:13:14.097595255 +0000 UTC m=+103.625663887" observedRunningTime="2026-05-27 20:13:15.668048366 +0000 UTC m=+105.196117012" watchObservedRunningTime="2026-05-27 20:13:15.669368599 +0000 UTC m=+105.197437241" May 27 20:13:19.551118 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.551078 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-695dccb598-f2nkp"] May 27 20:13:19.551608 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.551591 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fbb9f64-eea9-4507-a785-4ad5104b601d" containerName="registry" May 27 20:13:19.551684 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.551612 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fbb9f64-eea9-4507-a785-4ad5104b601d" containerName="registry" May 27 20:13:19.551719 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.551696 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="6fbb9f64-eea9-4507-a785-4ad5104b601d" containerName="registry" May 27 20:13:19.586339 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.586310 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-695dccb598-f2nkp"] May 27 20:13:19.586482 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.586416 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:19.661132 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.661103 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrbnk\" (UniqueName: \"kubernetes.io/projected/380cb38a-1b72-4611-abcf-d6ecf0e42167-kube-api-access-wrbnk\") pod \"console-695dccb598-f2nkp\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:19.661265 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.661143 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/380cb38a-1b72-4611-abcf-d6ecf0e42167-trusted-ca-bundle\") pod \"console-695dccb598-f2nkp\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:19.661265 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.661167 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/380cb38a-1b72-4611-abcf-d6ecf0e42167-console-oauth-config\") pod \"console-695dccb598-f2nkp\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:19.661265 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.661208 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/380cb38a-1b72-4611-abcf-d6ecf0e42167-oauth-serving-cert\") pod \"console-695dccb598-f2nkp\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:19.661265 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.661247 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/380cb38a-1b72-4611-abcf-d6ecf0e42167-console-config\") pod \"console-695dccb598-f2nkp\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:19.661395 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.661271 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/380cb38a-1b72-4611-abcf-d6ecf0e42167-service-ca\") pod \"console-695dccb598-f2nkp\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:19.661395 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.661291 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/380cb38a-1b72-4611-abcf-d6ecf0e42167-console-serving-cert\") pod \"console-695dccb598-f2nkp\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:19.762064 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.762035 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/380cb38a-1b72-4611-abcf-d6ecf0e42167-console-config\") pod \"console-695dccb598-f2nkp\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:19.762197 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.762072 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/380cb38a-1b72-4611-abcf-d6ecf0e42167-service-ca\") pod \"console-695dccb598-f2nkp\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:19.762197 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.762105 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/380cb38a-1b72-4611-abcf-d6ecf0e42167-console-serving-cert\") pod \"console-695dccb598-f2nkp\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:19.762197 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.762137 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wrbnk\" (UniqueName: \"kubernetes.io/projected/380cb38a-1b72-4611-abcf-d6ecf0e42167-kube-api-access-wrbnk\") pod \"console-695dccb598-f2nkp\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:19.762197 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.762179 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/380cb38a-1b72-4611-abcf-d6ecf0e42167-trusted-ca-bundle\") pod \"console-695dccb598-f2nkp\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:19.762412 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.762214 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/380cb38a-1b72-4611-abcf-d6ecf0e42167-console-oauth-config\") pod \"console-695dccb598-f2nkp\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:19.762412 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.762246 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/380cb38a-1b72-4611-abcf-d6ecf0e42167-oauth-serving-cert\") pod \"console-695dccb598-f2nkp\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:19.762829 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.762806 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/380cb38a-1b72-4611-abcf-d6ecf0e42167-service-ca\") pod \"console-695dccb598-f2nkp\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:19.762934 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.762900 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/380cb38a-1b72-4611-abcf-d6ecf0e42167-oauth-serving-cert\") pod \"console-695dccb598-f2nkp\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:19.762934 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.762900 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/380cb38a-1b72-4611-abcf-d6ecf0e42167-console-config\") pod \"console-695dccb598-f2nkp\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:19.763215 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.763188 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/380cb38a-1b72-4611-abcf-d6ecf0e42167-trusted-ca-bundle\") pod \"console-695dccb598-f2nkp\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:19.764716 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.764689 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/380cb38a-1b72-4611-abcf-d6ecf0e42167-console-oauth-config\") pod \"console-695dccb598-f2nkp\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:19.764793 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.764775 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/380cb38a-1b72-4611-abcf-d6ecf0e42167-console-serving-cert\") pod \"console-695dccb598-f2nkp\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:19.770995 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.770975 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrbnk\" (UniqueName: \"kubernetes.io/projected/380cb38a-1b72-4611-abcf-d6ecf0e42167-kube-api-access-wrbnk\") pod \"console-695dccb598-f2nkp\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:19.895766 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:19.895696 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:20.022814 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:20.022784 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-695dccb598-f2nkp"] May 27 20:13:20.025231 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:13:20.025195 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod380cb38a_1b72_4611_abcf_d6ecf0e42167.slice/crio-ce5d621c196cb80903384ce60f986fb9d1fcb77e63c94485e518763c4cb6a303 WatchSource:0}: Error finding container ce5d621c196cb80903384ce60f986fb9d1fcb77e63c94485e518763c4cb6a303: Status 404 returned error can't find the container with id ce5d621c196cb80903384ce60f986fb9d1fcb77e63c94485e518763c4cb6a303 May 27 20:13:20.640303 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:20.640273 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-85757fdc65-tjl7p" May 27 20:13:20.650147 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:20.650124 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-695dccb598-f2nkp" event={"ID":"380cb38a-1b72-4611-abcf-d6ecf0e42167","Type":"ContainerStarted","Data":"508709ff0c7255c1c79d4028e5bb7ef7e961b0e4fa2a9c12941d003c7d1c7078"} May 27 20:13:20.650269 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:20.650153 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-695dccb598-f2nkp" event={"ID":"380cb38a-1b72-4611-abcf-d6ecf0e42167","Type":"ContainerStarted","Data":"ce5d621c196cb80903384ce60f986fb9d1fcb77e63c94485e518763c4cb6a303"} May 27 20:13:20.681838 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:20.681784 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-695dccb598-f2nkp" podStartSLOduration=1.68176671 podStartE2EDuration="1.68176671s" podCreationTimestamp="2026-05-27 20:13:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:13:20.679400363 +0000 UTC m=+110.207469007" watchObservedRunningTime="2026-05-27 20:13:20.68176671 +0000 UTC m=+110.209835353" May 27 20:13:21.873544 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:21.873510 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:21.873544 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:21.873546 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:26.586260 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:26.586191 2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-64f6bb5d44-kwv66" podUID="a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17" containerName="console" containerID="cri-o://f363f27145c93e228669fbf813f4f4729cf35fa891613cea1653ae51f819672a" gracePeriod=15 May 27 20:13:26.855103 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:26.855081 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64f6bb5d44-kwv66_a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17/console/0.log" May 27 20:13:26.855212 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:26.855140 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:13:27.026857 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.026821 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-oauth-serving-cert\") pod \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\" (UID: \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\") " May 27 20:13:27.026857 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.026865 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-console-config\") pod \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\" (UID: \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\") " May 27 20:13:27.027076 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.026886 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-console-oauth-config\") pod \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\" (UID: \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\") " May 27 20:13:27.027076 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.026907 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-service-ca\") pod \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\" (UID: \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\") " May 27 20:13:27.027156 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.027068 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwjmt\" (UniqueName: \"kubernetes.io/projected/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-kube-api-access-mwjmt\") pod \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\" (UID: \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\") " May 27 20:13:27.027156 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.027146 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-console-serving-cert\") pod \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\" (UID: \"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17\") " May 27 20:13:27.027301 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.027278 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-service-ca" (OuterVolumeSpecName: "service-ca") pod "a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17" (UID: "a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 20:13:27.027364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.027301 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-console-config" (OuterVolumeSpecName: "console-config") pod "a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17" (UID: "a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 20:13:27.027364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.027330 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17" (UID: "a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 20:13:27.027498 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.027478 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-oauth-serving-cert\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:13:27.027551 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.027504 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-console-config\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:13:27.027551 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.027521 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-service-ca\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:13:27.029214 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.029188 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17" (UID: "a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 20:13:27.029214 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.029209 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17" (UID: "a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 20:13:27.029357 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.029340 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-kube-api-access-mwjmt" (OuterVolumeSpecName: "kube-api-access-mwjmt") pod "a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17" (UID: "a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17"). InnerVolumeSpecName "kube-api-access-mwjmt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:13:27.129044 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.128966 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwjmt\" (UniqueName: \"kubernetes.io/projected/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-kube-api-access-mwjmt\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:13:27.129044 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.128999 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-console-serving-cert\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:13:27.129044 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.129009 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17-console-oauth-config\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:13:27.673789 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.673763 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64f6bb5d44-kwv66_a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17/console/0.log" May 27 20:13:27.674274 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.673802 2554 generic.go:358] "Generic (PLEG): container finished" podID="a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17" containerID="f363f27145c93e228669fbf813f4f4729cf35fa891613cea1653ae51f819672a" exitCode=2 May 27 20:13:27.674274 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.673852 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64f6bb5d44-kwv66" event={"ID":"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17","Type":"ContainerDied","Data":"f363f27145c93e228669fbf813f4f4729cf35fa891613cea1653ae51f819672a"} May 27 20:13:27.674274 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.673868 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64f6bb5d44-kwv66" May 27 20:13:27.674274 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.673882 2554 scope.go:117] "RemoveContainer" containerID="f363f27145c93e228669fbf813f4f4729cf35fa891613cea1653ae51f819672a" May 27 20:13:27.674274 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.673873 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64f6bb5d44-kwv66" event={"ID":"a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17","Type":"ContainerDied","Data":"d134eede63d57c36c9385ab898cd03c7c822d2e61469351b42d21dcaadc68353"} May 27 20:13:27.686477 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.686460 2554 scope.go:117] "RemoveContainer" containerID="f363f27145c93e228669fbf813f4f4729cf35fa891613cea1653ae51f819672a" May 27 20:13:27.686784 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:13:27.686761 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f363f27145c93e228669fbf813f4f4729cf35fa891613cea1653ae51f819672a\": container with ID starting with f363f27145c93e228669fbf813f4f4729cf35fa891613cea1653ae51f819672a not found: ID does not exist" containerID="f363f27145c93e228669fbf813f4f4729cf35fa891613cea1653ae51f819672a" May 27 20:13:27.686857 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.686796 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f363f27145c93e228669fbf813f4f4729cf35fa891613cea1653ae51f819672a"} err="failed to get container status \"f363f27145c93e228669fbf813f4f4729cf35fa891613cea1653ae51f819672a\": rpc error: code = NotFound desc = could not find container \"f363f27145c93e228669fbf813f4f4729cf35fa891613cea1653ae51f819672a\": container with ID starting with f363f27145c93e228669fbf813f4f4729cf35fa891613cea1653ae51f819672a not found: ID does not exist" May 27 20:13:27.692286 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.692264 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64f6bb5d44-kwv66"] May 27 20:13:27.698494 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:27.698474 2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64f6bb5d44-kwv66"] May 27 20:13:29.055032 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:29.054999 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17" path="/var/lib/kubelet/pods/a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17/volumes" May 27 20:13:29.896302 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:29.896264 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:29.896302 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:29.896303 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:29.900991 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:29.900966 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:30.684473 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:30.684441 2554 generic.go:358] "Generic (PLEG): container finished" podID="f237de37-4fce-4257-af56-52a222da551a" containerID="bcbed587d071d4407cafae331bf96fe3edfcfcb4f8ab96918c169572ea6bdf18" exitCode=0 May 27 20:13:30.684882 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:30.684516 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" event={"ID":"f237de37-4fce-4257-af56-52a222da551a","Type":"ContainerDied","Data":"bcbed587d071d4407cafae331bf96fe3edfcfcb4f8ab96918c169572ea6bdf18"} May 27 20:13:30.684949 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:30.684899 2554 scope.go:117] "RemoveContainer" containerID="bcbed587d071d4407cafae331bf96fe3edfcfcb4f8ab96918c169572ea6bdf18" May 27 20:13:30.685967 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:30.685945 2554 generic.go:358] "Generic (PLEG): container finished" podID="42327801-84b0-458e-9515-67ebe5684ff6" containerID="4457994eeac170fd834fb4afa220fdc9ae2cab41738f35c0cf4ff40875b469f7" exitCode=0 May 27 20:13:30.686095 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:30.686014 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kfvgn" event={"ID":"42327801-84b0-458e-9515-67ebe5684ff6","Type":"ContainerDied","Data":"4457994eeac170fd834fb4afa220fdc9ae2cab41738f35c0cf4ff40875b469f7"} May 27 20:13:30.686452 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:30.686432 2554 scope.go:117] "RemoveContainer" containerID="4457994eeac170fd834fb4afa220fdc9ae2cab41738f35c0cf4ff40875b469f7" May 27 20:13:30.689980 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:30.689962 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-695dccb598-f2nkp" May 27 20:13:30.748091 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:30.748060 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dd8568cdd-7g6v9"] May 27 20:13:31.439927 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:31.439895 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pwnms_db22aafa-06fa-48ee-b31f-69581a977745/dns/0.log" May 27 20:13:31.445584 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:31.445560 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pwnms_db22aafa-06fa-48ee-b31f-69581a977745/kube-rbac-proxy/0.log" May 27 20:13:31.605346 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:31.605322 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-57cz2_4def15c9-ddcd-4d42-a061-ef4f279c7f63/dns-node-resolver/0.log" May 27 20:13:31.690752 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:31.690663 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kfvgn" event={"ID":"42327801-84b0-458e-9515-67ebe5684ff6","Type":"ContainerStarted","Data":"849fc7f455e70814b9c3c0fb8efa5bff1a9bd4fa0de2ce69077ff0b1e0d5606c"} May 27 20:13:31.692260 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:31.692239 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-pcwwj" event={"ID":"f237de37-4fce-4257-af56-52a222da551a","Type":"ContainerStarted","Data":"7ba81eb1a8b57890abfe83a1eb6749829260a8f50f228696c4b21121f274f308"} May 27 20:13:41.879451 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:41.879418 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:41.883683 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:41.883661 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5bc8c4b5c-vbsp8" May 27 20:13:55.772515 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:55.772457 2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7dd8568cdd-7g6v9" podUID="f970ad2f-d529-4e13-86a5-44e4cc962586" containerName="console" containerID="cri-o://302e9a398bf2bb8303e48a1f1b8f2f5eb1a569137e2cb65d8f5bce44df50bb1d" gracePeriod=15 May 27 20:13:56.053301 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.053280 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7dd8568cdd-7g6v9_f970ad2f-d529-4e13-86a5-44e4cc962586/console/0.log" May 27 20:13:56.053415 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.053334 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:13:56.174711 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.174684 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f970ad2f-d529-4e13-86a5-44e4cc962586-oauth-serving-cert\") pod \"f970ad2f-d529-4e13-86a5-44e4cc962586\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " May 27 20:13:56.174890 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.174735 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f970ad2f-d529-4e13-86a5-44e4cc962586-console-config\") pod \"f970ad2f-d529-4e13-86a5-44e4cc962586\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " May 27 20:13:56.174890 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.174779 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f970ad2f-d529-4e13-86a5-44e4cc962586-console-serving-cert\") pod \"f970ad2f-d529-4e13-86a5-44e4cc962586\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " May 27 20:13:56.174890 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.174808 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zk2tm\" (UniqueName: \"kubernetes.io/projected/f970ad2f-d529-4e13-86a5-44e4cc962586-kube-api-access-zk2tm\") pod \"f970ad2f-d529-4e13-86a5-44e4cc962586\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " May 27 20:13:56.174890 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.174836 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f970ad2f-d529-4e13-86a5-44e4cc962586-trusted-ca-bundle\") pod \"f970ad2f-d529-4e13-86a5-44e4cc962586\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " May 27 20:13:56.175101 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.174899 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f970ad2f-d529-4e13-86a5-44e4cc962586-console-oauth-config\") pod \"f970ad2f-d529-4e13-86a5-44e4cc962586\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " May 27 20:13:56.175101 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.174926 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f970ad2f-d529-4e13-86a5-44e4cc962586-service-ca\") pod \"f970ad2f-d529-4e13-86a5-44e4cc962586\" (UID: \"f970ad2f-d529-4e13-86a5-44e4cc962586\") " May 27 20:13:56.175101 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.175069 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f970ad2f-d529-4e13-86a5-44e4cc962586-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f970ad2f-d529-4e13-86a5-44e4cc962586" (UID: "f970ad2f-d529-4e13-86a5-44e4cc962586"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 20:13:56.175283 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.175260 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f970ad2f-d529-4e13-86a5-44e4cc962586-console-config" (OuterVolumeSpecName: "console-config") pod "f970ad2f-d529-4e13-86a5-44e4cc962586" (UID: "f970ad2f-d529-4e13-86a5-44e4cc962586"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 20:13:56.175654 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.175349 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f970ad2f-d529-4e13-86a5-44e4cc962586-console-config\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:13:56.175654 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.175373 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f970ad2f-d529-4e13-86a5-44e4cc962586-oauth-serving-cert\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:13:56.175654 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.175403 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f970ad2f-d529-4e13-86a5-44e4cc962586-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f970ad2f-d529-4e13-86a5-44e4cc962586" (UID: "f970ad2f-d529-4e13-86a5-44e4cc962586"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 20:13:56.175654 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.175492 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f970ad2f-d529-4e13-86a5-44e4cc962586-service-ca" (OuterVolumeSpecName: "service-ca") pod "f970ad2f-d529-4e13-86a5-44e4cc962586" (UID: "f970ad2f-d529-4e13-86a5-44e4cc962586"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 20:13:56.177180 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.177159 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f970ad2f-d529-4e13-86a5-44e4cc962586-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f970ad2f-d529-4e13-86a5-44e4cc962586" (UID: "f970ad2f-d529-4e13-86a5-44e4cc962586"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 20:13:56.177581 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.177561 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f970ad2f-d529-4e13-86a5-44e4cc962586-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f970ad2f-d529-4e13-86a5-44e4cc962586" (UID: "f970ad2f-d529-4e13-86a5-44e4cc962586"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 20:13:56.177675 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.177555 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f970ad2f-d529-4e13-86a5-44e4cc962586-kube-api-access-zk2tm" (OuterVolumeSpecName: "kube-api-access-zk2tm") pod "f970ad2f-d529-4e13-86a5-44e4cc962586" (UID: "f970ad2f-d529-4e13-86a5-44e4cc962586"). InnerVolumeSpecName "kube-api-access-zk2tm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:13:56.276739 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.276710 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f970ad2f-d529-4e13-86a5-44e4cc962586-console-serving-cert\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:13:56.276739 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.276735 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zk2tm\" (UniqueName: \"kubernetes.io/projected/f970ad2f-d529-4e13-86a5-44e4cc962586-kube-api-access-zk2tm\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:13:56.276739 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.276744 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f970ad2f-d529-4e13-86a5-44e4cc962586-trusted-ca-bundle\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:13:56.276932 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.276752 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f970ad2f-d529-4e13-86a5-44e4cc962586-console-oauth-config\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:13:56.276932 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.276762 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f970ad2f-d529-4e13-86a5-44e4cc962586-service-ca\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:13:56.774606 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.774581 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7dd8568cdd-7g6v9_f970ad2f-d529-4e13-86a5-44e4cc962586/console/0.log" May 27 20:13:56.774996 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.774636 2554 generic.go:358] "Generic (PLEG): container finished" podID="f970ad2f-d529-4e13-86a5-44e4cc962586" containerID="302e9a398bf2bb8303e48a1f1b8f2f5eb1a569137e2cb65d8f5bce44df50bb1d" exitCode=2 May 27 20:13:56.774996 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.774703 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd8568cdd-7g6v9" May 27 20:13:56.774996 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.774717 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd8568cdd-7g6v9" event={"ID":"f970ad2f-d529-4e13-86a5-44e4cc962586","Type":"ContainerDied","Data":"302e9a398bf2bb8303e48a1f1b8f2f5eb1a569137e2cb65d8f5bce44df50bb1d"} May 27 20:13:56.774996 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.774754 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd8568cdd-7g6v9" event={"ID":"f970ad2f-d529-4e13-86a5-44e4cc962586","Type":"ContainerDied","Data":"7760d71ad57674513619810eb55cc8a2edde4b8baf015568d62b8a85e92a706b"} May 27 20:13:56.774996 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.774770 2554 scope.go:117] "RemoveContainer" containerID="302e9a398bf2bb8303e48a1f1b8f2f5eb1a569137e2cb65d8f5bce44df50bb1d" May 27 20:13:56.783078 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.783059 2554 scope.go:117] "RemoveContainer" containerID="302e9a398bf2bb8303e48a1f1b8f2f5eb1a569137e2cb65d8f5bce44df50bb1d" May 27 20:13:56.783328 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:13:56.783309 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"302e9a398bf2bb8303e48a1f1b8f2f5eb1a569137e2cb65d8f5bce44df50bb1d\": container with ID starting with 302e9a398bf2bb8303e48a1f1b8f2f5eb1a569137e2cb65d8f5bce44df50bb1d not found: ID does not exist" containerID="302e9a398bf2bb8303e48a1f1b8f2f5eb1a569137e2cb65d8f5bce44df50bb1d" May 27 20:13:56.783385 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.783341 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"302e9a398bf2bb8303e48a1f1b8f2f5eb1a569137e2cb65d8f5bce44df50bb1d"} err="failed to get container status \"302e9a398bf2bb8303e48a1f1b8f2f5eb1a569137e2cb65d8f5bce44df50bb1d\": rpc error: code = NotFound desc = could not find container \"302e9a398bf2bb8303e48a1f1b8f2f5eb1a569137e2cb65d8f5bce44df50bb1d\": container with ID starting with 302e9a398bf2bb8303e48a1f1b8f2f5eb1a569137e2cb65d8f5bce44df50bb1d not found: ID does not exist" May 27 20:13:56.795047 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.795023 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dd8568cdd-7g6v9"] May 27 20:13:56.800184 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:56.800166 2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dd8568cdd-7g6v9"] May 27 20:13:57.054252 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:13:57.054181 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f970ad2f-d529-4e13-86a5-44e4cc962586" path="/var/lib/kubelet/pods/f970ad2f-d529-4e13-86a5-44e4cc962586/volumes" May 27 20:14:14.501667 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.501563 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b8546cb84-p5mvd"] May 27 20:14:14.502125 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.501972 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17" containerName="console" May 27 20:14:14.502125 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.501991 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17" containerName="console" May 27 20:14:14.502125 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.501999 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f970ad2f-d529-4e13-86a5-44e4cc962586" containerName="console" May 27 20:14:14.502125 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.502006 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f970ad2f-d529-4e13-86a5-44e4cc962586" containerName="console" May 27 20:14:14.502125 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.502092 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="f970ad2f-d529-4e13-86a5-44e4cc962586" containerName="console" May 27 20:14:14.502125 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.502107 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="a9f5dc3f-6d63-489b-af5c-a2e7e55f8f17" containerName="console" May 27 20:14:14.504353 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.504338 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:14.513043 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.513018 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b8546cb84-p5mvd"] May 27 20:14:14.627717 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.623503 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8535ffe4-4599-4d5b-9f19-4109380b5f7f-console-oauth-config\") pod \"console-5b8546cb84-p5mvd\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:14.627717 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.623566 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8535ffe4-4599-4d5b-9f19-4109380b5f7f-trusted-ca-bundle\") pod \"console-5b8546cb84-p5mvd\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:14.627717 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.623615 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8535ffe4-4599-4d5b-9f19-4109380b5f7f-console-config\") pod \"console-5b8546cb84-p5mvd\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:14.627717 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.623676 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8535ffe4-4599-4d5b-9f19-4109380b5f7f-console-serving-cert\") pod \"console-5b8546cb84-p5mvd\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:14.627717 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.623711 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8535ffe4-4599-4d5b-9f19-4109380b5f7f-oauth-serving-cert\") pod \"console-5b8546cb84-p5mvd\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:14.627717 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.623763 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fvzl\" (UniqueName: \"kubernetes.io/projected/8535ffe4-4599-4d5b-9f19-4109380b5f7f-kube-api-access-9fvzl\") pod \"console-5b8546cb84-p5mvd\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:14.627717 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.623839 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8535ffe4-4599-4d5b-9f19-4109380b5f7f-service-ca\") pod \"console-5b8546cb84-p5mvd\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:14.725184 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.725139 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8535ffe4-4599-4d5b-9f19-4109380b5f7f-console-config\") pod \"console-5b8546cb84-p5mvd\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:14.725184 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.725187 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8535ffe4-4599-4d5b-9f19-4109380b5f7f-console-serving-cert\") pod \"console-5b8546cb84-p5mvd\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:14.725429 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.725235 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8535ffe4-4599-4d5b-9f19-4109380b5f7f-oauth-serving-cert\") pod \"console-5b8546cb84-p5mvd\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:14.725429 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.725275 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9fvzl\" (UniqueName: \"kubernetes.io/projected/8535ffe4-4599-4d5b-9f19-4109380b5f7f-kube-api-access-9fvzl\") pod \"console-5b8546cb84-p5mvd\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:14.725429 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.725339 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8535ffe4-4599-4d5b-9f19-4109380b5f7f-service-ca\") pod \"console-5b8546cb84-p5mvd\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:14.725429 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.725393 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8535ffe4-4599-4d5b-9f19-4109380b5f7f-console-oauth-config\") pod \"console-5b8546cb84-p5mvd\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:14.725429 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.725419 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8535ffe4-4599-4d5b-9f19-4109380b5f7f-trusted-ca-bundle\") pod \"console-5b8546cb84-p5mvd\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:14.726008 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.725978 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8535ffe4-4599-4d5b-9f19-4109380b5f7f-console-config\") pod \"console-5b8546cb84-p5mvd\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:14.726136 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.726051 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8535ffe4-4599-4d5b-9f19-4109380b5f7f-oauth-serving-cert\") pod \"console-5b8546cb84-p5mvd\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:14.726136 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.726110 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8535ffe4-4599-4d5b-9f19-4109380b5f7f-service-ca\") pod \"console-5b8546cb84-p5mvd\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:14.726262 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.726236 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8535ffe4-4599-4d5b-9f19-4109380b5f7f-trusted-ca-bundle\") pod \"console-5b8546cb84-p5mvd\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:14.727795 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.727770 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8535ffe4-4599-4d5b-9f19-4109380b5f7f-console-serving-cert\") pod \"console-5b8546cb84-p5mvd\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:14.727910 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.727873 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8535ffe4-4599-4d5b-9f19-4109380b5f7f-console-oauth-config\") pod \"console-5b8546cb84-p5mvd\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:14.733703 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.733684 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fvzl\" (UniqueName: \"kubernetes.io/projected/8535ffe4-4599-4d5b-9f19-4109380b5f7f-kube-api-access-9fvzl\") pod \"console-5b8546cb84-p5mvd\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:14.815460 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.815383 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:14.947220 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:14.947178 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b8546cb84-p5mvd"] May 27 20:14:14.950299 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:14:14.950268 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8535ffe4_4599_4d5b_9f19_4109380b5f7f.slice/crio-6cd5d50bbd434f49a0052a61d9437dd4b13b8f6aea878a621874cc50d3031837 WatchSource:0}: Error finding container 6cd5d50bbd434f49a0052a61d9437dd4b13b8f6aea878a621874cc50d3031837: Status 404 returned error can't find the container with id 6cd5d50bbd434f49a0052a61d9437dd4b13b8f6aea878a621874cc50d3031837 May 27 20:14:15.832339 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:15.832300 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8546cb84-p5mvd" event={"ID":"8535ffe4-4599-4d5b-9f19-4109380b5f7f","Type":"ContainerStarted","Data":"b475d9afd927383f5c12732818bafd4755a4766beea3de22e452903ce1e326e0"} May 27 20:14:15.832339 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:15.832342 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8546cb84-p5mvd" event={"ID":"8535ffe4-4599-4d5b-9f19-4109380b5f7f","Type":"ContainerStarted","Data":"6cd5d50bbd434f49a0052a61d9437dd4b13b8f6aea878a621874cc50d3031837"} May 27 20:14:15.850763 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:15.850719 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5b8546cb84-p5mvd" podStartSLOduration=1.850705109 podStartE2EDuration="1.850705109s" podCreationTimestamp="2026-05-27 20:14:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:14:15.848804666 +0000 UTC m=+165.376873308" watchObservedRunningTime="2026-05-27 20:14:15.850705109 +0000 UTC m=+165.378773751" May 27 20:14:24.815679 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:24.815644 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:24.816138 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:24.815733 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:24.820650 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:24.820611 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:24.861529 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:24.861492 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:14:24.902070 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:24.902036 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-695dccb598-f2nkp"] May 27 20:14:45.440033 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:45.439998 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-9jjmw"] May 27 20:14:45.442212 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:45.442191 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jjmw" May 27 20:14:45.444472 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:45.444450 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 27 20:14:45.450507 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:45.450485 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9jjmw"] May 27 20:14:45.585312 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:45.585282 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60bae188-0649-4acd-a4dc-c6444d76cd73-original-pull-secret\") pod \"global-pull-secret-syncer-9jjmw\" (UID: \"60bae188-0649-4acd-a4dc-c6444d76cd73\") " pod="kube-system/global-pull-secret-syncer-9jjmw" May 27 20:14:45.585472 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:45.585332 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/60bae188-0649-4acd-a4dc-c6444d76cd73-kubelet-config\") pod \"global-pull-secret-syncer-9jjmw\" (UID: \"60bae188-0649-4acd-a4dc-c6444d76cd73\") " pod="kube-system/global-pull-secret-syncer-9jjmw" May 27 20:14:45.585472 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:45.585426 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/60bae188-0649-4acd-a4dc-c6444d76cd73-dbus\") pod \"global-pull-secret-syncer-9jjmw\" (UID: \"60bae188-0649-4acd-a4dc-c6444d76cd73\") " pod="kube-system/global-pull-secret-syncer-9jjmw" May 27 20:14:45.685962 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:45.685920 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/60bae188-0649-4acd-a4dc-c6444d76cd73-dbus\") pod \"global-pull-secret-syncer-9jjmw\" (UID: \"60bae188-0649-4acd-a4dc-c6444d76cd73\") " pod="kube-system/global-pull-secret-syncer-9jjmw" May 27 20:14:45.686104 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:45.685970 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60bae188-0649-4acd-a4dc-c6444d76cd73-original-pull-secret\") pod \"global-pull-secret-syncer-9jjmw\" (UID: \"60bae188-0649-4acd-a4dc-c6444d76cd73\") " pod="kube-system/global-pull-secret-syncer-9jjmw" May 27 20:14:45.686104 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:45.686002 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/60bae188-0649-4acd-a4dc-c6444d76cd73-kubelet-config\") pod \"global-pull-secret-syncer-9jjmw\" (UID: \"60bae188-0649-4acd-a4dc-c6444d76cd73\") " pod="kube-system/global-pull-secret-syncer-9jjmw" May 27 20:14:45.686104 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:45.686080 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/60bae188-0649-4acd-a4dc-c6444d76cd73-kubelet-config\") pod \"global-pull-secret-syncer-9jjmw\" (UID: \"60bae188-0649-4acd-a4dc-c6444d76cd73\") " pod="kube-system/global-pull-secret-syncer-9jjmw" May 27 20:14:45.686248 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:45.686100 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/60bae188-0649-4acd-a4dc-c6444d76cd73-dbus\") pod \"global-pull-secret-syncer-9jjmw\" (UID: \"60bae188-0649-4acd-a4dc-c6444d76cd73\") " pod="kube-system/global-pull-secret-syncer-9jjmw" May 27 20:14:45.688319 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:45.688300 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60bae188-0649-4acd-a4dc-c6444d76cd73-original-pull-secret\") pod \"global-pull-secret-syncer-9jjmw\" (UID: \"60bae188-0649-4acd-a4dc-c6444d76cd73\") " pod="kube-system/global-pull-secret-syncer-9jjmw" May 27 20:14:45.752506 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:45.752428 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jjmw" May 27 20:14:45.874283 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:45.874258 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9jjmw"] May 27 20:14:45.875684 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:14:45.875658 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60bae188_0649_4acd_a4dc_c6444d76cd73.slice/crio-45e76737ad52ec3e685b7777011aa7d903c84643165ff6103b5922a8fdd0380d WatchSource:0}: Error finding container 45e76737ad52ec3e685b7777011aa7d903c84643165ff6103b5922a8fdd0380d: Status 404 returned error can't find the container with id 45e76737ad52ec3e685b7777011aa7d903c84643165ff6103b5922a8fdd0380d May 27 20:14:45.922772 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:45.922742 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9jjmw" event={"ID":"60bae188-0649-4acd-a4dc-c6444d76cd73","Type":"ContainerStarted","Data":"45e76737ad52ec3e685b7777011aa7d903c84643165ff6103b5922a8fdd0380d"} May 27 20:14:49.924766 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:49.924719 2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-695dccb598-f2nkp" podUID="380cb38a-1b72-4611-abcf-d6ecf0e42167" containerName="console" containerID="cri-o://508709ff0c7255c1c79d4028e5bb7ef7e961b0e4fa2a9c12941d003c7d1c7078" gracePeriod=15 May 27 20:14:50.313696 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.313532 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-695dccb598-f2nkp_380cb38a-1b72-4611-abcf-d6ecf0e42167/console/0.log" May 27 20:14:50.313696 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.313589 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-695dccb598-f2nkp" May 27 20:14:50.429552 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.429517 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/380cb38a-1b72-4611-abcf-d6ecf0e42167-oauth-serving-cert\") pod \"380cb38a-1b72-4611-abcf-d6ecf0e42167\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " May 27 20:14:50.429765 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.429587 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/380cb38a-1b72-4611-abcf-d6ecf0e42167-console-config\") pod \"380cb38a-1b72-4611-abcf-d6ecf0e42167\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " May 27 20:14:50.429765 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.429612 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/380cb38a-1b72-4611-abcf-d6ecf0e42167-console-serving-cert\") pod \"380cb38a-1b72-4611-abcf-d6ecf0e42167\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " May 27 20:14:50.429765 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.429706 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrbnk\" (UniqueName: \"kubernetes.io/projected/380cb38a-1b72-4611-abcf-d6ecf0e42167-kube-api-access-wrbnk\") pod \"380cb38a-1b72-4611-abcf-d6ecf0e42167\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " May 27 20:14:50.429765 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.429735 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/380cb38a-1b72-4611-abcf-d6ecf0e42167-console-oauth-config\") pod \"380cb38a-1b72-4611-abcf-d6ecf0e42167\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " May 27 20:14:50.429969 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.429775 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/380cb38a-1b72-4611-abcf-d6ecf0e42167-service-ca\") pod \"380cb38a-1b72-4611-abcf-d6ecf0e42167\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " May 27 20:14:50.429969 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.429814 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/380cb38a-1b72-4611-abcf-d6ecf0e42167-trusted-ca-bundle\") pod \"380cb38a-1b72-4611-abcf-d6ecf0e42167\" (UID: \"380cb38a-1b72-4611-abcf-d6ecf0e42167\") " May 27 20:14:50.429969 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.429914 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/380cb38a-1b72-4611-abcf-d6ecf0e42167-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "380cb38a-1b72-4611-abcf-d6ecf0e42167" (UID: "380cb38a-1b72-4611-abcf-d6ecf0e42167"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 20:14:50.430121 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.430025 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/380cb38a-1b72-4611-abcf-d6ecf0e42167-console-config" (OuterVolumeSpecName: "console-config") pod "380cb38a-1b72-4611-abcf-d6ecf0e42167" (UID: "380cb38a-1b72-4611-abcf-d6ecf0e42167"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 20:14:50.430179 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.430125 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/380cb38a-1b72-4611-abcf-d6ecf0e42167-oauth-serving-cert\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:14:50.430179 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.430145 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/380cb38a-1b72-4611-abcf-d6ecf0e42167-console-config\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:14:50.430297 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.430272 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/380cb38a-1b72-4611-abcf-d6ecf0e42167-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "380cb38a-1b72-4611-abcf-d6ecf0e42167" (UID: "380cb38a-1b72-4611-abcf-d6ecf0e42167"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 20:14:50.430297 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.430266 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/380cb38a-1b72-4611-abcf-d6ecf0e42167-service-ca" (OuterVolumeSpecName: "service-ca") pod "380cb38a-1b72-4611-abcf-d6ecf0e42167" (UID: "380cb38a-1b72-4611-abcf-d6ecf0e42167"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 20:14:50.432077 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.432045 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/380cb38a-1b72-4611-abcf-d6ecf0e42167-kube-api-access-wrbnk" (OuterVolumeSpecName: "kube-api-access-wrbnk") pod "380cb38a-1b72-4611-abcf-d6ecf0e42167" (UID: "380cb38a-1b72-4611-abcf-d6ecf0e42167"). InnerVolumeSpecName "kube-api-access-wrbnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:14:50.432077 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.432062 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/380cb38a-1b72-4611-abcf-d6ecf0e42167-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "380cb38a-1b72-4611-abcf-d6ecf0e42167" (UID: "380cb38a-1b72-4611-abcf-d6ecf0e42167"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 20:14:50.432220 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.432103 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/380cb38a-1b72-4611-abcf-d6ecf0e42167-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "380cb38a-1b72-4611-abcf-d6ecf0e42167" (UID: "380cb38a-1b72-4611-abcf-d6ecf0e42167"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 20:14:50.531035 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.531004 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrbnk\" (UniqueName: \"kubernetes.io/projected/380cb38a-1b72-4611-abcf-d6ecf0e42167-kube-api-access-wrbnk\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:14:50.531035 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.531030 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/380cb38a-1b72-4611-abcf-d6ecf0e42167-console-oauth-config\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:14:50.531196 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.531051 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/380cb38a-1b72-4611-abcf-d6ecf0e42167-service-ca\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:14:50.531196 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.531060 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/380cb38a-1b72-4611-abcf-d6ecf0e42167-trusted-ca-bundle\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:14:50.531196 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.531069 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/380cb38a-1b72-4611-abcf-d6ecf0e42167-console-serving-cert\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:14:50.941278 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.941245 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9jjmw" event={"ID":"60bae188-0649-4acd-a4dc-c6444d76cd73","Type":"ContainerStarted","Data":"4f03b18490e3fbb66ef9e5138fc190123bb73627be9899d297c4f380c6bcfd02"} May 27 20:14:50.942409 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.942393 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-695dccb598-f2nkp_380cb38a-1b72-4611-abcf-d6ecf0e42167/console/0.log" May 27 20:14:50.942472 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.942430 2554 generic.go:358] "Generic (PLEG): container finished" podID="380cb38a-1b72-4611-abcf-d6ecf0e42167" containerID="508709ff0c7255c1c79d4028e5bb7ef7e961b0e4fa2a9c12941d003c7d1c7078" exitCode=2 May 27 20:14:50.942472 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.942460 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-695dccb598-f2nkp" event={"ID":"380cb38a-1b72-4611-abcf-d6ecf0e42167","Type":"ContainerDied","Data":"508709ff0c7255c1c79d4028e5bb7ef7e961b0e4fa2a9c12941d003c7d1c7078"} May 27 20:14:50.942536 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.942490 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-695dccb598-f2nkp" May 27 20:14:50.942536 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.942505 2554 scope.go:117] "RemoveContainer" containerID="508709ff0c7255c1c79d4028e5bb7ef7e961b0e4fa2a9c12941d003c7d1c7078" May 27 20:14:50.942605 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.942495 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-695dccb598-f2nkp" event={"ID":"380cb38a-1b72-4611-abcf-d6ecf0e42167","Type":"ContainerDied","Data":"ce5d621c196cb80903384ce60f986fb9d1fcb77e63c94485e518763c4cb6a303"} May 27 20:14:50.951226 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.951209 2554 scope.go:117] "RemoveContainer" containerID="508709ff0c7255c1c79d4028e5bb7ef7e961b0e4fa2a9c12941d003c7d1c7078" May 27 20:14:50.951451 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:14:50.951434 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"508709ff0c7255c1c79d4028e5bb7ef7e961b0e4fa2a9c12941d003c7d1c7078\": container with ID starting with 508709ff0c7255c1c79d4028e5bb7ef7e961b0e4fa2a9c12941d003c7d1c7078 not found: ID does not exist" containerID="508709ff0c7255c1c79d4028e5bb7ef7e961b0e4fa2a9c12941d003c7d1c7078" May 27 20:14:50.951503 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.951457 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"508709ff0c7255c1c79d4028e5bb7ef7e961b0e4fa2a9c12941d003c7d1c7078"} err="failed to get container status \"508709ff0c7255c1c79d4028e5bb7ef7e961b0e4fa2a9c12941d003c7d1c7078\": rpc error: code = NotFound desc = could not find container \"508709ff0c7255c1c79d4028e5bb7ef7e961b0e4fa2a9c12941d003c7d1c7078\": container with ID starting with 508709ff0c7255c1c79d4028e5bb7ef7e961b0e4fa2a9c12941d003c7d1c7078 not found: ID does not exist" May 27 20:14:50.955744 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.955708 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9jjmw" podStartSLOduration=1.642618795 podStartE2EDuration="5.955696994s" podCreationTimestamp="2026-05-27 20:14:45 +0000 UTC" firstStartedPulling="2026-05-27 20:14:45.877479769 +0000 UTC m=+195.405548392" lastFinishedPulling="2026-05-27 20:14:50.190557971 +0000 UTC m=+199.718626591" observedRunningTime="2026-05-27 20:14:50.955374197 +0000 UTC m=+200.483442835" watchObservedRunningTime="2026-05-27 20:14:50.955696994 +0000 UTC m=+200.483765635" May 27 20:14:50.969124 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.969100 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-695dccb598-f2nkp"] May 27 20:14:50.972117 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:50.972096 2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-695dccb598-f2nkp"] May 27 20:14:51.054472 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:14:51.054442 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="380cb38a-1b72-4611-abcf-d6ecf0e42167" path="/var/lib/kubelet/pods/380cb38a-1b72-4611-abcf-d6ecf0e42167/volumes" May 27 20:15:18.991828 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:18.991789 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r"] May 27 20:15:18.992207 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:18.992160 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="380cb38a-1b72-4611-abcf-d6ecf0e42167" containerName="console" May 27 20:15:18.992207 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:18.992173 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="380cb38a-1b72-4611-abcf-d6ecf0e42167" containerName="console" May 27 20:15:18.992281 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:18.992230 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="380cb38a-1b72-4611-abcf-d6ecf0e42167" containerName="console" May 27 20:15:18.994081 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:18.994064 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r" May 27 20:15:18.996571 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:18.996552 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 20:15:18.996649 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:18.996569 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r2gl6\"" May 27 20:15:18.997432 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:18.997417 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 20:15:19.007479 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:19.007458 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r"] May 27 20:15:19.061355 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:19.061326 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r\" (UID: \"38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r" May 27 20:15:19.061484 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:19.061358 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r\" (UID: \"38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r" May 27 20:15:19.061484 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:19.061399 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvdtl\" (UniqueName: \"kubernetes.io/projected/38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6-kube-api-access-mvdtl\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r\" (UID: \"38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r" May 27 20:15:19.161806 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:19.161778 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mvdtl\" (UniqueName: \"kubernetes.io/projected/38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6-kube-api-access-mvdtl\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r\" (UID: \"38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r" May 27 20:15:19.161918 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:19.161852 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r\" (UID: \"38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r" May 27 20:15:19.162059 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:19.161978 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r\" (UID: \"38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r" May 27 20:15:19.162316 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:19.162293 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r\" (UID: \"38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r" May 27 20:15:19.162359 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:19.162318 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r\" (UID: \"38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r" May 27 20:15:19.170911 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:19.170881 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvdtl\" (UniqueName: \"kubernetes.io/projected/38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6-kube-api-access-mvdtl\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r\" (UID: \"38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r" May 27 20:15:19.302953 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:19.302882 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r" May 27 20:15:19.444122 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:19.444097 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r"] May 27 20:15:19.446204 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:15:19.446167 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38c1d8c2_cbdd_4ae7_8dff_ec47f1dc4cb6.slice/crio-feeeb7ebe5d9c98ac8c9e64c3f0eb3430c3f6019cc9fdca6c2ebe7d7dc36a776 WatchSource:0}: Error finding container feeeb7ebe5d9c98ac8c9e64c3f0eb3430c3f6019cc9fdca6c2ebe7d7dc36a776: Status 404 returned error can't find the container with id feeeb7ebe5d9c98ac8c9e64c3f0eb3430c3f6019cc9fdca6c2ebe7d7dc36a776 May 27 20:15:20.036892 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:20.036853 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r" event={"ID":"38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6","Type":"ContainerStarted","Data":"feeeb7ebe5d9c98ac8c9e64c3f0eb3430c3f6019cc9fdca6c2ebe7d7dc36a776"} May 27 20:15:25.055672 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:25.055640 2554 generic.go:358] "Generic (PLEG): container finished" podID="38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6" containerID="c4c3f556a87c2477932c30ec2a1694711b359aca5d27ca10a2a05c1412e4a763" exitCode=0 May 27 20:15:25.056008 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:25.055689 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r" event={"ID":"38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6","Type":"ContainerDied","Data":"c4c3f556a87c2477932c30ec2a1694711b359aca5d27ca10a2a05c1412e4a763"} May 27 20:15:28.065901 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:28.065871 2554 generic.go:358] "Generic (PLEG): container finished" podID="38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6" containerID="77e7316b6b34ebe1823e66b3187352ebd9de4435a8a6bedca312538b8d2f167d" exitCode=0 May 27 20:15:28.066287 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:28.065920 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r" event={"ID":"38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6","Type":"ContainerDied","Data":"77e7316b6b34ebe1823e66b3187352ebd9de4435a8a6bedca312538b8d2f167d"} May 27 20:15:34.087591 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:34.087557 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r" event={"ID":"38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6","Type":"ContainerStarted","Data":"6791c644a7692046541b7117da41d51f421581fb743636a4ade6bbe9e15a1eb5"} May 27 20:15:34.105323 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:34.105280 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r" podStartSLOduration=1.62665094 podStartE2EDuration="16.105261713s" podCreationTimestamp="2026-05-27 20:15:18 +0000 UTC" firstStartedPulling="2026-05-27 20:15:19.448131579 +0000 UTC m=+228.976200200" lastFinishedPulling="2026-05-27 20:15:33.926742353 +0000 UTC m=+243.454810973" observedRunningTime="2026-05-27 20:15:34.104723877 +0000 UTC m=+243.632792519" watchObservedRunningTime="2026-05-27 20:15:34.105261713 +0000 UTC m=+243.633330354" May 27 20:15:35.091986 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:35.091950 2554 generic.go:358] "Generic (PLEG): container finished" podID="38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6" containerID="6791c644a7692046541b7117da41d51f421581fb743636a4ade6bbe9e15a1eb5" exitCode=0 May 27 20:15:35.091986 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:35.091980 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r" event={"ID":"38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6","Type":"ContainerDied","Data":"6791c644a7692046541b7117da41d51f421581fb743636a4ade6bbe9e15a1eb5"} May 27 20:15:36.226727 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:36.226701 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r" May 27 20:15:36.315149 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:36.315116 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6-bundle\") pod \"38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6\" (UID: \"38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6\") " May 27 20:15:36.315289 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:36.315156 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvdtl\" (UniqueName: \"kubernetes.io/projected/38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6-kube-api-access-mvdtl\") pod \"38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6\" (UID: \"38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6\") " May 27 20:15:36.315289 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:36.315203 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6-util\") pod \"38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6\" (UID: \"38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6\") " May 27 20:15:36.315981 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:36.315956 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6-bundle" (OuterVolumeSpecName: "bundle") pod "38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6" (UID: "38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 20:15:36.317315 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:36.317291 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6-kube-api-access-mvdtl" (OuterVolumeSpecName: "kube-api-access-mvdtl") pod "38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6" (UID: "38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6"). InnerVolumeSpecName "kube-api-access-mvdtl". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:15:36.320096 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:36.320070 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6-util" (OuterVolumeSpecName: "util") pod "38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6" (UID: "38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 20:15:36.417154 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:36.416830 2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6-bundle\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:15:36.417154 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:36.416892 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvdtl\" (UniqueName: \"kubernetes.io/projected/38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6-kube-api-access-mvdtl\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:15:36.417154 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:36.416917 2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6-util\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:15:37.098808 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:37.098776 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r" event={"ID":"38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6","Type":"ContainerDied","Data":"feeeb7ebe5d9c98ac8c9e64c3f0eb3430c3f6019cc9fdca6c2ebe7d7dc36a776"} May 27 20:15:37.098808 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:37.098808 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="feeeb7ebe5d9c98ac8c9e64c3f0eb3430c3f6019cc9fdca6c2ebe7d7dc36a776" May 27 20:15:37.098973 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:37.098806 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dn8x7r" May 27 20:15:41.750776 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:41.750743 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-v4lb4"] May 27 20:15:41.751156 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:41.751053 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6" containerName="pull" May 27 20:15:41.751156 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:41.751064 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6" containerName="pull" May 27 20:15:41.751156 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:41.751081 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6" containerName="util" May 27 20:15:41.751156 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:41.751086 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6" containerName="util" May 27 20:15:41.751156 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:41.751095 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6" containerName="extract" May 27 20:15:41.751156 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:41.751101 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6" containerName="extract" May 27 20:15:41.751156 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:41.751146 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="38c1d8c2-cbdd-4ae7-8dff-ec47f1dc4cb6" containerName="extract" May 27 20:15:41.761139 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:41.761107 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-v4lb4" May 27 20:15:41.765227 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:41.765204 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 27 20:15:41.765449 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:41.765411 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-v4lb4"] May 27 20:15:41.765584 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:41.765464 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 27 20:15:41.765948 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:41.765929 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-b7lsd\"" May 27 20:15:41.862824 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:41.862797 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0df42bc1-609f-42e0-992b-45cea7308f24-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-v4lb4\" (UID: \"0df42bc1-609f-42e0-992b-45cea7308f24\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-v4lb4" May 27 20:15:41.862977 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:41.862865 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5frv\" (UniqueName: \"kubernetes.io/projected/0df42bc1-609f-42e0-992b-45cea7308f24-kube-api-access-v5frv\") pod \"cert-manager-operator-controller-manager-54b9655956-v4lb4\" (UID: \"0df42bc1-609f-42e0-992b-45cea7308f24\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-v4lb4" May 27 20:15:41.963427 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:41.963402 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0df42bc1-609f-42e0-992b-45cea7308f24-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-v4lb4\" (UID: \"0df42bc1-609f-42e0-992b-45cea7308f24\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-v4lb4" May 27 20:15:41.963566 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:41.963461 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v5frv\" (UniqueName: \"kubernetes.io/projected/0df42bc1-609f-42e0-992b-45cea7308f24-kube-api-access-v5frv\") pod \"cert-manager-operator-controller-manager-54b9655956-v4lb4\" (UID: \"0df42bc1-609f-42e0-992b-45cea7308f24\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-v4lb4" May 27 20:15:41.963821 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:41.963797 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0df42bc1-609f-42e0-992b-45cea7308f24-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-v4lb4\" (UID: \"0df42bc1-609f-42e0-992b-45cea7308f24\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-v4lb4" May 27 20:15:41.975821 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:41.975799 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5frv\" (UniqueName: \"kubernetes.io/projected/0df42bc1-609f-42e0-992b-45cea7308f24-kube-api-access-v5frv\") pod \"cert-manager-operator-controller-manager-54b9655956-v4lb4\" (UID: \"0df42bc1-609f-42e0-992b-45cea7308f24\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-v4lb4" May 27 20:15:42.070830 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:42.070776 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-v4lb4" May 27 20:15:42.208405 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:42.208379 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-v4lb4"] May 27 20:15:42.210264 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:15:42.210235 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0df42bc1_609f_42e0_992b_45cea7308f24.slice/crio-6e6eb58be14e66bfe02c89a8a5f48f49461d8f8921e4e3d6a2850801825720d3 WatchSource:0}: Error finding container 6e6eb58be14e66bfe02c89a8a5f48f49461d8f8921e4e3d6a2850801825720d3: Status 404 returned error can't find the container with id 6e6eb58be14e66bfe02c89a8a5f48f49461d8f8921e4e3d6a2850801825720d3 May 27 20:15:43.117337 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:43.117302 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-v4lb4" event={"ID":"0df42bc1-609f-42e0-992b-45cea7308f24","Type":"ContainerStarted","Data":"6e6eb58be14e66bfe02c89a8a5f48f49461d8f8921e4e3d6a2850801825720d3"} May 27 20:15:45.125056 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:45.125018 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-v4lb4" event={"ID":"0df42bc1-609f-42e0-992b-45cea7308f24","Type":"ContainerStarted","Data":"4c86a4d9952ebada974a948d78912a5bb46c56909f846d71bb2ff4f6151b88a1"} May 27 20:15:45.148369 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:45.148326 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-v4lb4" podStartSLOduration=1.902844846 podStartE2EDuration="4.148310341s" podCreationTimestamp="2026-05-27 20:15:41 +0000 UTC" firstStartedPulling="2026-05-27 20:15:42.212752071 +0000 UTC m=+251.740820691" lastFinishedPulling="2026-05-27 20:15:44.458217559 +0000 UTC m=+253.986286186" observedRunningTime="2026-05-27 20:15:45.14671541 +0000 UTC m=+254.674784073" watchObservedRunningTime="2026-05-27 20:15:45.148310341 +0000 UTC m=+254.676378982" May 27 20:15:46.196741 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:46.196705 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc"] May 27 20:15:46.218274 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:46.218232 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc"] May 27 20:15:46.218274 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:46.218268 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc" May 27 20:15:46.220698 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:46.220678 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 20:15:46.221740 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:46.221720 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 20:15:46.221740 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:46.221725 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r2gl6\"" May 27 20:15:46.297706 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:46.297671 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d36620a1-3bb2-438f-868f-581ce496e542-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc\" (UID: \"d36620a1-3bb2-438f-868f-581ce496e542\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc" May 27 20:15:46.297866 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:46.297729 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxxkx\" (UniqueName: \"kubernetes.io/projected/d36620a1-3bb2-438f-868f-581ce496e542-kube-api-access-qxxkx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc\" (UID: \"d36620a1-3bb2-438f-868f-581ce496e542\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc" May 27 20:15:46.297866 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:46.297813 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d36620a1-3bb2-438f-868f-581ce496e542-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc\" (UID: \"d36620a1-3bb2-438f-868f-581ce496e542\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc" May 27 20:15:46.398682 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:46.398610 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d36620a1-3bb2-438f-868f-581ce496e542-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc\" (UID: \"d36620a1-3bb2-438f-868f-581ce496e542\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc" May 27 20:15:46.398808 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:46.398722 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qxxkx\" (UniqueName: \"kubernetes.io/projected/d36620a1-3bb2-438f-868f-581ce496e542-kube-api-access-qxxkx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc\" (UID: \"d36620a1-3bb2-438f-868f-581ce496e542\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc" May 27 20:15:46.398808 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:46.398770 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d36620a1-3bb2-438f-868f-581ce496e542-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc\" (UID: \"d36620a1-3bb2-438f-868f-581ce496e542\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc" May 27 20:15:46.398986 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:46.398966 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d36620a1-3bb2-438f-868f-581ce496e542-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc\" (UID: \"d36620a1-3bb2-438f-868f-581ce496e542\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc" May 27 20:15:46.399144 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:46.399123 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d36620a1-3bb2-438f-868f-581ce496e542-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc\" (UID: \"d36620a1-3bb2-438f-868f-581ce496e542\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc" May 27 20:15:46.408427 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:46.408401 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxxkx\" (UniqueName: \"kubernetes.io/projected/d36620a1-3bb2-438f-868f-581ce496e542-kube-api-access-qxxkx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc\" (UID: \"d36620a1-3bb2-438f-868f-581ce496e542\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc" May 27 20:15:46.527380 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:46.527321 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc" May 27 20:15:46.659012 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:46.658989 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc"] May 27 20:15:46.661252 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:15:46.661220 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd36620a1_3bb2_438f_868f_581ce496e542.slice/crio-4b4f4f6e47975cef7bfccc6304cd945b0645c170088495972baa4f3cb690052a WatchSource:0}: Error finding container 4b4f4f6e47975cef7bfccc6304cd945b0645c170088495972baa4f3cb690052a: Status 404 returned error can't find the container with id 4b4f4f6e47975cef7bfccc6304cd945b0645c170088495972baa4f3cb690052a May 27 20:15:47.133093 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:47.133008 2554 generic.go:358] "Generic (PLEG): container finished" podID="d36620a1-3bb2-438f-868f-581ce496e542" containerID="54f7d3329c2981f449d58bb64f5462246a0f8df3cc37f7d6978d66e74ed57c4b" exitCode=0 May 27 20:15:47.133093 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:47.133083 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc" event={"ID":"d36620a1-3bb2-438f-868f-581ce496e542","Type":"ContainerDied","Data":"54f7d3329c2981f449d58bb64f5462246a0f8df3cc37f7d6978d66e74ed57c4b"} May 27 20:15:47.133259 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:47.133110 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc" event={"ID":"d36620a1-3bb2-438f-868f-581ce496e542","Type":"ContainerStarted","Data":"4b4f4f6e47975cef7bfccc6304cd945b0645c170088495972baa4f3cb690052a"} May 27 20:15:48.070071 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.070036 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-jbcrh"] May 27 20:15:48.077016 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.076989 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-jbcrh" May 27 20:15:48.079436 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.079400 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 27 20:15:48.080228 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.080210 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 27 20:15:48.080360 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.080214 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-2wq9w\"" May 27 20:15:48.083960 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.083941 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-jbcrh"] May 27 20:15:48.111870 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.111842 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8f2p\" (UniqueName: \"kubernetes.io/projected/f95cda19-b8f9-492d-9f0a-6c0e9161ff9e-kube-api-access-t8f2p\") pod \"cert-manager-webhook-587ccfb98-jbcrh\" (UID: \"f95cda19-b8f9-492d-9f0a-6c0e9161ff9e\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jbcrh" May 27 20:15:48.112008 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.111957 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f95cda19-b8f9-492d-9f0a-6c0e9161ff9e-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-jbcrh\" (UID: \"f95cda19-b8f9-492d-9f0a-6c0e9161ff9e\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jbcrh" May 27 20:15:48.213201 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.213166 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f95cda19-b8f9-492d-9f0a-6c0e9161ff9e-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-jbcrh\" (UID: \"f95cda19-b8f9-492d-9f0a-6c0e9161ff9e\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jbcrh" May 27 20:15:48.213419 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.213265 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t8f2p\" (UniqueName: \"kubernetes.io/projected/f95cda19-b8f9-492d-9f0a-6c0e9161ff9e-kube-api-access-t8f2p\") pod \"cert-manager-webhook-587ccfb98-jbcrh\" (UID: \"f95cda19-b8f9-492d-9f0a-6c0e9161ff9e\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jbcrh" May 27 20:15:48.221772 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.221749 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f95cda19-b8f9-492d-9f0a-6c0e9161ff9e-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-jbcrh\" (UID: \"f95cda19-b8f9-492d-9f0a-6c0e9161ff9e\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jbcrh" May 27 20:15:48.221902 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.221879 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8f2p\" (UniqueName: \"kubernetes.io/projected/f95cda19-b8f9-492d-9f0a-6c0e9161ff9e-kube-api-access-t8f2p\") pod \"cert-manager-webhook-587ccfb98-jbcrh\" (UID: \"f95cda19-b8f9-492d-9f0a-6c0e9161ff9e\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jbcrh" May 27 20:15:48.395189 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.395094 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-jbcrh" May 27 20:15:48.503327 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.503292 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-nlskx"] May 27 20:15:48.506690 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.506668 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-nlskx" May 27 20:15:48.509145 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.509121 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-x59hm\"" May 27 20:15:48.513501 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.513478 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-nlskx"] May 27 20:15:48.516345 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.515914 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c6tm\" (UniqueName: \"kubernetes.io/projected/12334cb5-d950-4ceb-ad37-0a43470505bb-kube-api-access-2c6tm\") pod \"cert-manager-cainjector-68b757865b-nlskx\" (UID: \"12334cb5-d950-4ceb-ad37-0a43470505bb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-nlskx" May 27 20:15:48.516345 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.515979 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12334cb5-d950-4ceb-ad37-0a43470505bb-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-nlskx\" (UID: \"12334cb5-d950-4ceb-ad37-0a43470505bb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-nlskx" May 27 20:15:48.547496 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.547465 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-jbcrh"] May 27 20:15:48.551293 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:15:48.551269 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf95cda19_b8f9_492d_9f0a_6c0e9161ff9e.slice/crio-ddbb6caa61bca03eb06d4c38d7514d11ee410bf9bab2e0f259404fc4b6e2711d WatchSource:0}: Error finding container ddbb6caa61bca03eb06d4c38d7514d11ee410bf9bab2e0f259404fc4b6e2711d: Status 404 returned error can't find the container with id ddbb6caa61bca03eb06d4c38d7514d11ee410bf9bab2e0f259404fc4b6e2711d May 27 20:15:48.616886 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.616856 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2c6tm\" (UniqueName: \"kubernetes.io/projected/12334cb5-d950-4ceb-ad37-0a43470505bb-kube-api-access-2c6tm\") pod \"cert-manager-cainjector-68b757865b-nlskx\" (UID: \"12334cb5-d950-4ceb-ad37-0a43470505bb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-nlskx" May 27 20:15:48.617026 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.616921 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12334cb5-d950-4ceb-ad37-0a43470505bb-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-nlskx\" (UID: \"12334cb5-d950-4ceb-ad37-0a43470505bb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-nlskx" May 27 20:15:48.624919 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.624893 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12334cb5-d950-4ceb-ad37-0a43470505bb-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-nlskx\" (UID: \"12334cb5-d950-4ceb-ad37-0a43470505bb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-nlskx" May 27 20:15:48.625034 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.624958 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c6tm\" (UniqueName: \"kubernetes.io/projected/12334cb5-d950-4ceb-ad37-0a43470505bb-kube-api-access-2c6tm\") pod \"cert-manager-cainjector-68b757865b-nlskx\" (UID: \"12334cb5-d950-4ceb-ad37-0a43470505bb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-nlskx" May 27 20:15:48.820608 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:48.820570 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-nlskx" May 27 20:15:49.140935 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:49.140854 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-jbcrh" event={"ID":"f95cda19-b8f9-492d-9f0a-6c0e9161ff9e","Type":"ContainerStarted","Data":"ddbb6caa61bca03eb06d4c38d7514d11ee410bf9bab2e0f259404fc4b6e2711d"} May 27 20:15:49.416701 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:49.416673 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-nlskx"] May 27 20:15:49.419212 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:15:49.419183 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12334cb5_d950_4ceb_ad37_0a43470505bb.slice/crio-e57d7c538f3de1fab13989228412c79ddef1912c72ae4bc1047965c1624933d5 WatchSource:0}: Error finding container e57d7c538f3de1fab13989228412c79ddef1912c72ae4bc1047965c1624933d5: Status 404 returned error can't find the container with id e57d7c538f3de1fab13989228412c79ddef1912c72ae4bc1047965c1624933d5 May 27 20:15:50.146735 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:50.146679 2554 generic.go:358] "Generic (PLEG): container finished" podID="d36620a1-3bb2-438f-868f-581ce496e542" containerID="87b2a4ab6275d62cf5d78ed45e257f930ffbf5550e74464e0dfd48a55d08913f" exitCode=0 May 27 20:15:50.147245 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:50.146773 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc" event={"ID":"d36620a1-3bb2-438f-868f-581ce496e542","Type":"ContainerDied","Data":"87b2a4ab6275d62cf5d78ed45e257f930ffbf5550e74464e0dfd48a55d08913f"} May 27 20:15:50.148055 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:50.148029 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-nlskx" event={"ID":"12334cb5-d950-4ceb-ad37-0a43470505bb","Type":"ContainerStarted","Data":"e57d7c538f3de1fab13989228412c79ddef1912c72ae4bc1047965c1624933d5"} May 27 20:15:51.154426 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:51.154381 2554 generic.go:358] "Generic (PLEG): container finished" podID="d36620a1-3bb2-438f-868f-581ce496e542" containerID="4230be0353681925c635a6fcecd496de54d154e1edab57df8a11d15303e2012f" exitCode=0 May 27 20:15:51.155023 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:51.154446 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc" event={"ID":"d36620a1-3bb2-438f-868f-581ce496e542","Type":"ContainerDied","Data":"4230be0353681925c635a6fcecd496de54d154e1edab57df8a11d15303e2012f"} May 27 20:15:52.159789 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:52.159702 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-jbcrh" event={"ID":"f95cda19-b8f9-492d-9f0a-6c0e9161ff9e","Type":"ContainerStarted","Data":"4708f09b148ab287a3773adf9345632fd6f067eae68ae72c92154958a73afa01"} May 27 20:15:52.160177 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:52.159855 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-jbcrh" May 27 20:15:52.161162 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:52.161136 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-nlskx" event={"ID":"12334cb5-d950-4ceb-ad37-0a43470505bb","Type":"ContainerStarted","Data":"74e6525300db52ec8881e3977428908d94c57962315e49c8aecde62cfe9d7069"} May 27 20:15:52.179355 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:52.179314 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-jbcrh" podStartSLOduration=1.038638597 podStartE2EDuration="4.179301597s" podCreationTimestamp="2026-05-27 20:15:48 +0000 UTC" firstStartedPulling="2026-05-27 20:15:48.553642124 +0000 UTC m=+258.081710748" lastFinishedPulling="2026-05-27 20:15:51.694305125 +0000 UTC m=+261.222373748" observedRunningTime="2026-05-27 20:15:52.177148251 +0000 UTC m=+261.705216895" watchObservedRunningTime="2026-05-27 20:15:52.179301597 +0000 UTC m=+261.707370239" May 27 20:15:52.192274 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:52.192097 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-nlskx" podStartSLOduration=1.908279094 podStartE2EDuration="4.192081508s" podCreationTimestamp="2026-05-27 20:15:48 +0000 UTC" firstStartedPulling="2026-05-27 20:15:49.421183987 +0000 UTC m=+258.949252609" lastFinishedPulling="2026-05-27 20:15:51.704986385 +0000 UTC m=+261.233055023" observedRunningTime="2026-05-27 20:15:52.19171081 +0000 UTC m=+261.719779451" watchObservedRunningTime="2026-05-27 20:15:52.192081508 +0000 UTC m=+261.720150151" May 27 20:15:52.289702 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:52.289680 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc" May 27 20:15:52.352978 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:52.352948 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d36620a1-3bb2-438f-868f-581ce496e542-util\") pod \"d36620a1-3bb2-438f-868f-581ce496e542\" (UID: \"d36620a1-3bb2-438f-868f-581ce496e542\") " May 27 20:15:52.353115 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:52.353006 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d36620a1-3bb2-438f-868f-581ce496e542-bundle\") pod \"d36620a1-3bb2-438f-868f-581ce496e542\" (UID: \"d36620a1-3bb2-438f-868f-581ce496e542\") " May 27 20:15:52.353115 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:52.353060 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxxkx\" (UniqueName: \"kubernetes.io/projected/d36620a1-3bb2-438f-868f-581ce496e542-kube-api-access-qxxkx\") pod \"d36620a1-3bb2-438f-868f-581ce496e542\" (UID: \"d36620a1-3bb2-438f-868f-581ce496e542\") " May 27 20:15:52.353411 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:52.353369 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d36620a1-3bb2-438f-868f-581ce496e542-bundle" (OuterVolumeSpecName: "bundle") pod "d36620a1-3bb2-438f-868f-581ce496e542" (UID: "d36620a1-3bb2-438f-868f-581ce496e542"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 20:15:52.355017 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:52.354997 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d36620a1-3bb2-438f-868f-581ce496e542-kube-api-access-qxxkx" (OuterVolumeSpecName: "kube-api-access-qxxkx") pod "d36620a1-3bb2-438f-868f-581ce496e542" (UID: "d36620a1-3bb2-438f-868f-581ce496e542"). InnerVolumeSpecName "kube-api-access-qxxkx". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:15:52.356894 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:52.356851 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d36620a1-3bb2-438f-868f-581ce496e542-util" (OuterVolumeSpecName: "util") pod "d36620a1-3bb2-438f-868f-581ce496e542" (UID: "d36620a1-3bb2-438f-868f-581ce496e542"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 20:15:52.453928 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:52.453908 2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d36620a1-3bb2-438f-868f-581ce496e542-bundle\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:15:52.454023 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:52.453930 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxxkx\" (UniqueName: \"kubernetes.io/projected/d36620a1-3bb2-438f-868f-581ce496e542-kube-api-access-qxxkx\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:15:52.454023 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:52.453940 2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d36620a1-3bb2-438f-868f-581ce496e542-util\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:15:53.166887 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:53.166859 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc" May 27 20:15:53.166887 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:53.166872 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fj4frc" event={"ID":"d36620a1-3bb2-438f-868f-581ce496e542","Type":"ContainerDied","Data":"4b4f4f6e47975cef7bfccc6304cd945b0645c170088495972baa4f3cb690052a"} May 27 20:15:53.167391 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:53.166905 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b4f4f6e47975cef7bfccc6304cd945b0645c170088495972baa4f3cb690052a" May 27 20:15:58.169508 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:15:58.169476 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-jbcrh" May 27 20:16:07.414313 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:07.414278 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d"] May 27 20:16:07.414723 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:07.414659 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d36620a1-3bb2-438f-868f-581ce496e542" containerName="extract" May 27 20:16:07.414723 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:07.414672 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d36620a1-3bb2-438f-868f-581ce496e542" containerName="extract" May 27 20:16:07.414723 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:07.414684 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d36620a1-3bb2-438f-868f-581ce496e542" containerName="pull" May 27 20:16:07.414723 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:07.414689 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d36620a1-3bb2-438f-868f-581ce496e542" containerName="pull" May 27 20:16:07.414723 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:07.414700 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d36620a1-3bb2-438f-868f-581ce496e542" containerName="util" May 27 20:16:07.414723 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:07.414706 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d36620a1-3bb2-438f-868f-581ce496e542" containerName="util" May 27 20:16:07.414913 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:07.414763 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="d36620a1-3bb2-438f-868f-581ce496e542" containerName="extract" May 27 20:16:07.419601 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:07.419580 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d" May 27 20:16:07.422227 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:07.422201 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 20:16:07.422343 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:07.422250 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 20:16:07.422343 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:07.422291 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r2gl6\"" May 27 20:16:07.425349 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:07.425326 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d"] May 27 20:16:07.472015 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:07.471985 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33270602-5571-4227-87ab-95b03dcf8d47-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d\" (UID: \"33270602-5571-4227-87ab-95b03dcf8d47\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d" May 27 20:16:07.472139 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:07.472021 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2dnm\" (UniqueName: \"kubernetes.io/projected/33270602-5571-4227-87ab-95b03dcf8d47-kube-api-access-v2dnm\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d\" (UID: \"33270602-5571-4227-87ab-95b03dcf8d47\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d" May 27 20:16:07.472139 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:07.472045 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33270602-5571-4227-87ab-95b03dcf8d47-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d\" (UID: \"33270602-5571-4227-87ab-95b03dcf8d47\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d" May 27 20:16:07.573369 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:07.573343 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33270602-5571-4227-87ab-95b03dcf8d47-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d\" (UID: \"33270602-5571-4227-87ab-95b03dcf8d47\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d" May 27 20:16:07.573474 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:07.573378 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v2dnm\" (UniqueName: \"kubernetes.io/projected/33270602-5571-4227-87ab-95b03dcf8d47-kube-api-access-v2dnm\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d\" (UID: \"33270602-5571-4227-87ab-95b03dcf8d47\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d" May 27 20:16:07.573474 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:07.573403 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33270602-5571-4227-87ab-95b03dcf8d47-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d\" (UID: \"33270602-5571-4227-87ab-95b03dcf8d47\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d" May 27 20:16:07.573727 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:07.573709 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33270602-5571-4227-87ab-95b03dcf8d47-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d\" (UID: \"33270602-5571-4227-87ab-95b03dcf8d47\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d" May 27 20:16:07.573790 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:07.573774 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33270602-5571-4227-87ab-95b03dcf8d47-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d\" (UID: \"33270602-5571-4227-87ab-95b03dcf8d47\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d" May 27 20:16:07.581370 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:07.581348 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2dnm\" (UniqueName: \"kubernetes.io/projected/33270602-5571-4227-87ab-95b03dcf8d47-kube-api-access-v2dnm\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d\" (UID: \"33270602-5571-4227-87ab-95b03dcf8d47\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d" May 27 20:16:07.729618 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:07.729582 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d" May 27 20:16:07.856366 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:07.856336 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d"] May 27 20:16:07.859702 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:16:07.859671 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33270602_5571_4227_87ab_95b03dcf8d47.slice/crio-90bf1870e4b49c461e1979fe9feddf79d0daf55629f2274196af89ed4866550f WatchSource:0}: Error finding container 90bf1870e4b49c461e1979fe9feddf79d0daf55629f2274196af89ed4866550f: Status 404 returned error can't find the container with id 90bf1870e4b49c461e1979fe9feddf79d0daf55629f2274196af89ed4866550f May 27 20:16:08.217852 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:08.217817 2554 generic.go:358] "Generic (PLEG): container finished" podID="33270602-5571-4227-87ab-95b03dcf8d47" containerID="9e99386a9526d471869a9a6d7d57d116ecac2fab13f73d08d893ad97ee2e06be" exitCode=0 May 27 20:16:08.218033 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:08.217855 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d" event={"ID":"33270602-5571-4227-87ab-95b03dcf8d47","Type":"ContainerDied","Data":"9e99386a9526d471869a9a6d7d57d116ecac2fab13f73d08d893ad97ee2e06be"} May 27 20:16:08.218033 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:08.217894 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d" event={"ID":"33270602-5571-4227-87ab-95b03dcf8d47","Type":"ContainerStarted","Data":"90bf1870e4b49c461e1979fe9feddf79d0daf55629f2274196af89ed4866550f"} May 27 20:16:09.222359 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:09.222327 2554 generic.go:358] "Generic (PLEG): container finished" podID="33270602-5571-4227-87ab-95b03dcf8d47" containerID="342cc6f7be956ae058e2d3dda812c0da373f9c3c1f727d6991e0093404e32d21" exitCode=0 May 27 20:16:09.222743 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:09.222373 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d" event={"ID":"33270602-5571-4227-87ab-95b03dcf8d47","Type":"ContainerDied","Data":"342cc6f7be956ae058e2d3dda812c0da373f9c3c1f727d6991e0093404e32d21"} May 27 20:16:10.227581 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:10.227547 2554 generic.go:358] "Generic (PLEG): container finished" podID="33270602-5571-4227-87ab-95b03dcf8d47" containerID="8ebe71c48cb2c33635808ae9e2ea30225296d50054b2a69394e51ca0d5b47eed" exitCode=0 May 27 20:16:10.227960 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:10.227651 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d" event={"ID":"33270602-5571-4227-87ab-95b03dcf8d47","Type":"ContainerDied","Data":"8ebe71c48cb2c33635808ae9e2ea30225296d50054b2a69394e51ca0d5b47eed"} May 27 20:16:11.354450 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:11.354429 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d" May 27 20:16:11.409206 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:11.409176 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33270602-5571-4227-87ab-95b03dcf8d47-bundle\") pod \"33270602-5571-4227-87ab-95b03dcf8d47\" (UID: \"33270602-5571-4227-87ab-95b03dcf8d47\") " May 27 20:16:11.409353 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:11.409250 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33270602-5571-4227-87ab-95b03dcf8d47-util\") pod \"33270602-5571-4227-87ab-95b03dcf8d47\" (UID: \"33270602-5571-4227-87ab-95b03dcf8d47\") " May 27 20:16:11.409353 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:11.409281 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2dnm\" (UniqueName: \"kubernetes.io/projected/33270602-5571-4227-87ab-95b03dcf8d47-kube-api-access-v2dnm\") pod \"33270602-5571-4227-87ab-95b03dcf8d47\" (UID: \"33270602-5571-4227-87ab-95b03dcf8d47\") " May 27 20:16:11.410058 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:11.410027 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33270602-5571-4227-87ab-95b03dcf8d47-bundle" (OuterVolumeSpecName: "bundle") pod "33270602-5571-4227-87ab-95b03dcf8d47" (UID: "33270602-5571-4227-87ab-95b03dcf8d47"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 20:16:11.411299 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:11.411271 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33270602-5571-4227-87ab-95b03dcf8d47-kube-api-access-v2dnm" (OuterVolumeSpecName: "kube-api-access-v2dnm") pod "33270602-5571-4227-87ab-95b03dcf8d47" (UID: "33270602-5571-4227-87ab-95b03dcf8d47"). InnerVolumeSpecName "kube-api-access-v2dnm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:16:11.415209 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:11.415178 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33270602-5571-4227-87ab-95b03dcf8d47-util" (OuterVolumeSpecName: "util") pod "33270602-5571-4227-87ab-95b03dcf8d47" (UID: "33270602-5571-4227-87ab-95b03dcf8d47"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 20:16:11.509863 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:11.509798 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2dnm\" (UniqueName: \"kubernetes.io/projected/33270602-5571-4227-87ab-95b03dcf8d47-kube-api-access-v2dnm\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:16:11.509863 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:11.509823 2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33270602-5571-4227-87ab-95b03dcf8d47-bundle\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:16:11.509863 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:11.509836 2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33270602-5571-4227-87ab-95b03dcf8d47-util\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:16:12.237414 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:12.237380 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d" event={"ID":"33270602-5571-4227-87ab-95b03dcf8d47","Type":"ContainerDied","Data":"90bf1870e4b49c461e1979fe9feddf79d0daf55629f2274196af89ed4866550f"} May 27 20:16:12.237414 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:12.237413 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90bf1870e4b49c461e1979fe9feddf79d0daf55629f2274196af89ed4866550f" May 27 20:16:12.237652 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:12.237425 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58876d" May 27 20:16:21.432503 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:21.432468 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x"] May 27 20:16:21.433016 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:21.432964 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33270602-5571-4227-87ab-95b03dcf8d47" containerName="util" May 27 20:16:21.433016 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:21.432984 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="33270602-5571-4227-87ab-95b03dcf8d47" containerName="util" May 27 20:16:21.433016 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:21.433008 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33270602-5571-4227-87ab-95b03dcf8d47" containerName="pull" May 27 20:16:21.433016 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:21.433017 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="33270602-5571-4227-87ab-95b03dcf8d47" containerName="pull" May 27 20:16:21.433225 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:21.433027 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33270602-5571-4227-87ab-95b03dcf8d47" containerName="extract" May 27 20:16:21.433225 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:21.433035 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="33270602-5571-4227-87ab-95b03dcf8d47" containerName="extract" May 27 20:16:21.433225 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:21.433122 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="33270602-5571-4227-87ab-95b03dcf8d47" containerName="extract" May 27 20:16:21.437706 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:21.437686 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x" May 27 20:16:21.440157 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:21.440136 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 20:16:21.440157 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:21.440144 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 20:16:21.440969 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:21.440954 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r2gl6\"" May 27 20:16:21.444605 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:21.444589 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x"] May 27 20:16:21.594642 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:21.594594 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqzls\" (UniqueName: \"kubernetes.io/projected/7ec2fe69-a3d5-4aaf-98db-d651637aa7fa-kube-api-access-qqzls\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x\" (UID: \"7ec2fe69-a3d5-4aaf-98db-d651637aa7fa\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x" May 27 20:16:21.594771 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:21.594678 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ec2fe69-a3d5-4aaf-98db-d651637aa7fa-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x\" (UID: \"7ec2fe69-a3d5-4aaf-98db-d651637aa7fa\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x" May 27 20:16:21.594771 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:21.594701 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ec2fe69-a3d5-4aaf-98db-d651637aa7fa-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x\" (UID: \"7ec2fe69-a3d5-4aaf-98db-d651637aa7fa\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x" May 27 20:16:21.695325 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:21.695247 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qqzls\" (UniqueName: \"kubernetes.io/projected/7ec2fe69-a3d5-4aaf-98db-d651637aa7fa-kube-api-access-qqzls\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x\" (UID: \"7ec2fe69-a3d5-4aaf-98db-d651637aa7fa\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x" May 27 20:16:21.695325 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:21.695298 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ec2fe69-a3d5-4aaf-98db-d651637aa7fa-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x\" (UID: \"7ec2fe69-a3d5-4aaf-98db-d651637aa7fa\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x" May 27 20:16:21.695516 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:21.695432 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ec2fe69-a3d5-4aaf-98db-d651637aa7fa-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x\" (UID: \"7ec2fe69-a3d5-4aaf-98db-d651637aa7fa\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x" May 27 20:16:21.695575 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:21.695562 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ec2fe69-a3d5-4aaf-98db-d651637aa7fa-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x\" (UID: \"7ec2fe69-a3d5-4aaf-98db-d651637aa7fa\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x" May 27 20:16:21.695730 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:21.695713 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ec2fe69-a3d5-4aaf-98db-d651637aa7fa-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x\" (UID: \"7ec2fe69-a3d5-4aaf-98db-d651637aa7fa\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x" May 27 20:16:21.703378 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:21.703355 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqzls\" (UniqueName: \"kubernetes.io/projected/7ec2fe69-a3d5-4aaf-98db-d651637aa7fa-kube-api-access-qqzls\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x\" (UID: \"7ec2fe69-a3d5-4aaf-98db-d651637aa7fa\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x" May 27 20:16:21.747725 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:21.747703 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x" May 27 20:16:21.875618 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:21.875594 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x"] May 27 20:16:21.878304 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:16:21.878272 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ec2fe69_a3d5_4aaf_98db_d651637aa7fa.slice/crio-64adc5e1ac92d7313bb069d44177a6a19f112fd3647e7571a341463e02048345 WatchSource:0}: Error finding container 64adc5e1ac92d7313bb069d44177a6a19f112fd3647e7571a341463e02048345: Status 404 returned error can't find the container with id 64adc5e1ac92d7313bb069d44177a6a19f112fd3647e7571a341463e02048345 May 27 20:16:22.171887 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:22.171857 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b59bfd74-gmffn"] May 27 20:16:22.174214 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:22.174197 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b59bfd74-gmffn" May 27 20:16:22.178182 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:22.178159 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-52xz7\"" May 27 20:16:22.178290 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:22.178197 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 27 20:16:22.178344 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:22.178317 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 27 20:16:22.180475 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:22.180455 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 27 20:16:22.181588 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:22.181569 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 27 20:16:22.189037 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:22.189017 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b59bfd74-gmffn"] May 27 20:16:22.271196 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:22.271131 2554 generic.go:358] "Generic (PLEG): container finished" podID="7ec2fe69-a3d5-4aaf-98db-d651637aa7fa" containerID="737eded2997af72d04b74244c88be8e67c35e9776fd4ccd5ade2ccd70f985076" exitCode=0 May 27 20:16:22.271196 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:22.271163 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x" event={"ID":"7ec2fe69-a3d5-4aaf-98db-d651637aa7fa","Type":"ContainerDied","Data":"737eded2997af72d04b74244c88be8e67c35e9776fd4ccd5ade2ccd70f985076"} May 27 20:16:22.271333 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:22.271195 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x" event={"ID":"7ec2fe69-a3d5-4aaf-98db-d651637aa7fa","Type":"ContainerStarted","Data":"64adc5e1ac92d7313bb069d44177a6a19f112fd3647e7571a341463e02048345"} May 27 20:16:22.300684 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:22.300661 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/310feb14-5593-4e11-9109-c53086141a9c-webhook-cert\") pod \"opendatahub-operator-controller-manager-b59bfd74-gmffn\" (UID: \"310feb14-5593-4e11-9109-c53086141a9c\") " pod="opendatahub/opendatahub-operator-controller-manager-b59bfd74-gmffn" May 27 20:16:22.300792 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:22.300765 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/310feb14-5593-4e11-9109-c53086141a9c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b59bfd74-gmffn\" (UID: \"310feb14-5593-4e11-9109-c53086141a9c\") " pod="opendatahub/opendatahub-operator-controller-manager-b59bfd74-gmffn" May 27 20:16:22.300792 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:22.300787 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n5ld\" (UniqueName: \"kubernetes.io/projected/310feb14-5593-4e11-9109-c53086141a9c-kube-api-access-9n5ld\") pod \"opendatahub-operator-controller-manager-b59bfd74-gmffn\" (UID: \"310feb14-5593-4e11-9109-c53086141a9c\") " pod="opendatahub/opendatahub-operator-controller-manager-b59bfd74-gmffn" May 27 20:16:22.402001 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:22.401966 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/310feb14-5593-4e11-9109-c53086141a9c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b59bfd74-gmffn\" (UID: \"310feb14-5593-4e11-9109-c53086141a9c\") " pod="opendatahub/opendatahub-operator-controller-manager-b59bfd74-gmffn" May 27 20:16:22.402001 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:22.402001 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9n5ld\" (UniqueName: \"kubernetes.io/projected/310feb14-5593-4e11-9109-c53086141a9c-kube-api-access-9n5ld\") pod \"opendatahub-operator-controller-manager-b59bfd74-gmffn\" (UID: \"310feb14-5593-4e11-9109-c53086141a9c\") " pod="opendatahub/opendatahub-operator-controller-manager-b59bfd74-gmffn" May 27 20:16:22.402240 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:22.402143 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/310feb14-5593-4e11-9109-c53086141a9c-webhook-cert\") pod \"opendatahub-operator-controller-manager-b59bfd74-gmffn\" (UID: \"310feb14-5593-4e11-9109-c53086141a9c\") " pod="opendatahub/opendatahub-operator-controller-manager-b59bfd74-gmffn" May 27 20:16:22.404545 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:22.404519 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/310feb14-5593-4e11-9109-c53086141a9c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b59bfd74-gmffn\" (UID: \"310feb14-5593-4e11-9109-c53086141a9c\") " pod="opendatahub/opendatahub-operator-controller-manager-b59bfd74-gmffn" May 27 20:16:22.404663 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:22.404519 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/310feb14-5593-4e11-9109-c53086141a9c-webhook-cert\") pod \"opendatahub-operator-controller-manager-b59bfd74-gmffn\" (UID: \"310feb14-5593-4e11-9109-c53086141a9c\") " pod="opendatahub/opendatahub-operator-controller-manager-b59bfd74-gmffn" May 27 20:16:22.409723 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:22.409704 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n5ld\" (UniqueName: \"kubernetes.io/projected/310feb14-5593-4e11-9109-c53086141a9c-kube-api-access-9n5ld\") pod \"opendatahub-operator-controller-manager-b59bfd74-gmffn\" (UID: \"310feb14-5593-4e11-9109-c53086141a9c\") " pod="opendatahub/opendatahub-operator-controller-manager-b59bfd74-gmffn" May 27 20:16:22.484937 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:22.484912 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b59bfd74-gmffn" May 27 20:16:22.616592 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:22.616514 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b59bfd74-gmffn"] May 27 20:16:22.618858 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:16:22.618831 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod310feb14_5593_4e11_9109_c53086141a9c.slice/crio-7921e7ac17088068b45a1a1842dbd079b6c5d30edff6a2286806df76406a5548 WatchSource:0}: Error finding container 7921e7ac17088068b45a1a1842dbd079b6c5d30edff6a2286806df76406a5548: Status 404 returned error can't find the container with id 7921e7ac17088068b45a1a1842dbd079b6c5d30edff6a2286806df76406a5548 May 27 20:16:23.276399 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:23.276360 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b59bfd74-gmffn" event={"ID":"310feb14-5593-4e11-9109-c53086141a9c","Type":"ContainerStarted","Data":"7921e7ac17088068b45a1a1842dbd079b6c5d30edff6a2286806df76406a5548"} May 27 20:16:24.281838 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:24.281798 2554 generic.go:358] "Generic (PLEG): container finished" podID="7ec2fe69-a3d5-4aaf-98db-d651637aa7fa" containerID="b84ea054a4521e6425d6ef7d8b73531c780a5ebe18193a0541c8aa084fe7791b" exitCode=0 May 27 20:16:24.282311 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:24.281882 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x" event={"ID":"7ec2fe69-a3d5-4aaf-98db-d651637aa7fa","Type":"ContainerDied","Data":"b84ea054a4521e6425d6ef7d8b73531c780a5ebe18193a0541c8aa084fe7791b"} May 27 20:16:25.286789 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:25.286714 2554 generic.go:358] "Generic (PLEG): container finished" podID="7ec2fe69-a3d5-4aaf-98db-d651637aa7fa" containerID="36ddb661b82d7ecf21819218430abb8c7ac7c7396c2a6f81f4bdc2149a3287c7" exitCode=0 May 27 20:16:25.287183 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:25.286796 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x" event={"ID":"7ec2fe69-a3d5-4aaf-98db-d651637aa7fa","Type":"ContainerDied","Data":"36ddb661b82d7ecf21819218430abb8c7ac7c7396c2a6f81f4bdc2149a3287c7"} May 27 20:16:25.288158 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:25.288138 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b59bfd74-gmffn" event={"ID":"310feb14-5593-4e11-9109-c53086141a9c","Type":"ContainerStarted","Data":"d184993708800aa386219b54bfe2c4b21b6817be967bf99c57de6ce3f868b2da"} May 27 20:16:25.288315 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:25.288304 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b59bfd74-gmffn" May 27 20:16:25.322662 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:25.322582 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b59bfd74-gmffn" podStartSLOduration=0.901533617 podStartE2EDuration="3.322565063s" podCreationTimestamp="2026-05-27 20:16:22 +0000 UTC" firstStartedPulling="2026-05-27 20:16:22.620646572 +0000 UTC m=+292.148715195" lastFinishedPulling="2026-05-27 20:16:25.04167802 +0000 UTC m=+294.569746641" observedRunningTime="2026-05-27 20:16:25.321867113 +0000 UTC m=+294.849935755" watchObservedRunningTime="2026-05-27 20:16:25.322565063 +0000 UTC m=+294.850633706" May 27 20:16:26.273671 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.273636 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c47b79f86-v82x9"] May 27 20:16:26.280989 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.280963 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c47b79f86-v82x9" May 27 20:16:26.284271 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.284141 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 27 20:16:26.284615 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.284588 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 27 20:16:26.284735 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.284591 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 27 20:16:26.285337 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.285087 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 27 20:16:26.285435 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.285392 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bcr7j\"" May 27 20:16:26.285594 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.285576 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 27 20:16:26.286933 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.286911 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c47b79f86-v82x9"] May 27 20:16:26.421503 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.421481 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x" May 27 20:16:26.440212 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.439180 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9646a09a-7500-453f-988e-2889ff9038cd-cert\") pod \"lws-controller-manager-6c47b79f86-v82x9\" (UID: \"9646a09a-7500-453f-988e-2889ff9038cd\") " pod="openshift-lws-operator/lws-controller-manager-6c47b79f86-v82x9" May 27 20:16:26.440212 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.439287 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9646a09a-7500-453f-988e-2889ff9038cd-manager-config\") pod \"lws-controller-manager-6c47b79f86-v82x9\" (UID: \"9646a09a-7500-453f-988e-2889ff9038cd\") " pod="openshift-lws-operator/lws-controller-manager-6c47b79f86-v82x9" May 27 20:16:26.440212 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.439330 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh4tf\" (UniqueName: \"kubernetes.io/projected/9646a09a-7500-453f-988e-2889ff9038cd-kube-api-access-fh4tf\") pod \"lws-controller-manager-6c47b79f86-v82x9\" (UID: \"9646a09a-7500-453f-988e-2889ff9038cd\") " pod="openshift-lws-operator/lws-controller-manager-6c47b79f86-v82x9" May 27 20:16:26.440212 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.439396 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9646a09a-7500-453f-988e-2889ff9038cd-metrics-cert\") pod \"lws-controller-manager-6c47b79f86-v82x9\" (UID: \"9646a09a-7500-453f-988e-2889ff9038cd\") " pod="openshift-lws-operator/lws-controller-manager-6c47b79f86-v82x9" May 27 20:16:26.540535 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.540463 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqzls\" (UniqueName: \"kubernetes.io/projected/7ec2fe69-a3d5-4aaf-98db-d651637aa7fa-kube-api-access-qqzls\") pod \"7ec2fe69-a3d5-4aaf-98db-d651637aa7fa\" (UID: \"7ec2fe69-a3d5-4aaf-98db-d651637aa7fa\") " May 27 20:16:26.540535 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.540508 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ec2fe69-a3d5-4aaf-98db-d651637aa7fa-bundle\") pod \"7ec2fe69-a3d5-4aaf-98db-d651637aa7fa\" (UID: \"7ec2fe69-a3d5-4aaf-98db-d651637aa7fa\") " May 27 20:16:26.540737 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.540544 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ec2fe69-a3d5-4aaf-98db-d651637aa7fa-util\") pod \"7ec2fe69-a3d5-4aaf-98db-d651637aa7fa\" (UID: \"7ec2fe69-a3d5-4aaf-98db-d651637aa7fa\") " May 27 20:16:26.540737 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.540680 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9646a09a-7500-453f-988e-2889ff9038cd-cert\") pod \"lws-controller-manager-6c47b79f86-v82x9\" (UID: \"9646a09a-7500-453f-988e-2889ff9038cd\") " pod="openshift-lws-operator/lws-controller-manager-6c47b79f86-v82x9" May 27 20:16:26.540834 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.540738 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9646a09a-7500-453f-988e-2889ff9038cd-manager-config\") pod \"lws-controller-manager-6c47b79f86-v82x9\" (UID: \"9646a09a-7500-453f-988e-2889ff9038cd\") " pod="openshift-lws-operator/lws-controller-manager-6c47b79f86-v82x9" May 27 20:16:26.540834 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.540776 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fh4tf\" (UniqueName: \"kubernetes.io/projected/9646a09a-7500-453f-988e-2889ff9038cd-kube-api-access-fh4tf\") pod \"lws-controller-manager-6c47b79f86-v82x9\" (UID: \"9646a09a-7500-453f-988e-2889ff9038cd\") " pod="openshift-lws-operator/lws-controller-manager-6c47b79f86-v82x9" May 27 20:16:26.540934 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.540833 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9646a09a-7500-453f-988e-2889ff9038cd-metrics-cert\") pod \"lws-controller-manager-6c47b79f86-v82x9\" (UID: \"9646a09a-7500-453f-988e-2889ff9038cd\") " pod="openshift-lws-operator/lws-controller-manager-6c47b79f86-v82x9" May 27 20:16:26.541613 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.541569 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ec2fe69-a3d5-4aaf-98db-d651637aa7fa-bundle" (OuterVolumeSpecName: "bundle") pod "7ec2fe69-a3d5-4aaf-98db-d651637aa7fa" (UID: "7ec2fe69-a3d5-4aaf-98db-d651637aa7fa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 20:16:26.541613 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.541599 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9646a09a-7500-453f-988e-2889ff9038cd-manager-config\") pod \"lws-controller-manager-6c47b79f86-v82x9\" (UID: \"9646a09a-7500-453f-988e-2889ff9038cd\") " pod="openshift-lws-operator/lws-controller-manager-6c47b79f86-v82x9" May 27 20:16:26.543089 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.543054 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ec2fe69-a3d5-4aaf-98db-d651637aa7fa-kube-api-access-qqzls" (OuterVolumeSpecName: "kube-api-access-qqzls") pod "7ec2fe69-a3d5-4aaf-98db-d651637aa7fa" (UID: "7ec2fe69-a3d5-4aaf-98db-d651637aa7fa"). InnerVolumeSpecName "kube-api-access-qqzls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:16:26.543288 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.543272 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9646a09a-7500-453f-988e-2889ff9038cd-cert\") pod \"lws-controller-manager-6c47b79f86-v82x9\" (UID: \"9646a09a-7500-453f-988e-2889ff9038cd\") " pod="openshift-lws-operator/lws-controller-manager-6c47b79f86-v82x9" May 27 20:16:26.543579 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.543558 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9646a09a-7500-453f-988e-2889ff9038cd-metrics-cert\") pod \"lws-controller-manager-6c47b79f86-v82x9\" (UID: \"9646a09a-7500-453f-988e-2889ff9038cd\") " pod="openshift-lws-operator/lws-controller-manager-6c47b79f86-v82x9" May 27 20:16:26.546380 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.546359 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ec2fe69-a3d5-4aaf-98db-d651637aa7fa-util" (OuterVolumeSpecName: "util") pod "7ec2fe69-a3d5-4aaf-98db-d651637aa7fa" (UID: "7ec2fe69-a3d5-4aaf-98db-d651637aa7fa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 20:16:26.559679 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.559659 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh4tf\" (UniqueName: \"kubernetes.io/projected/9646a09a-7500-453f-988e-2889ff9038cd-kube-api-access-fh4tf\") pod \"lws-controller-manager-6c47b79f86-v82x9\" (UID: \"9646a09a-7500-453f-988e-2889ff9038cd\") " pod="openshift-lws-operator/lws-controller-manager-6c47b79f86-v82x9" May 27 20:16:26.591081 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.591062 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c47b79f86-v82x9" May 27 20:16:26.641777 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.641703 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqzls\" (UniqueName: \"kubernetes.io/projected/7ec2fe69-a3d5-4aaf-98db-d651637aa7fa-kube-api-access-qqzls\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:16:26.641777 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.641741 2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ec2fe69-a3d5-4aaf-98db-d651637aa7fa-bundle\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:16:26.641777 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.641756 2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ec2fe69-a3d5-4aaf-98db-d651637aa7fa-util\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:16:26.716134 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:26.715967 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c47b79f86-v82x9"] May 27 20:16:26.718412 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:16:26.718387 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9646a09a_7500_453f_988e_2889ff9038cd.slice/crio-85333ff30e5e24dcc160c775b73d7b12cce3861a226a568866660e4fee01620e WatchSource:0}: Error finding container 85333ff30e5e24dcc160c775b73d7b12cce3861a226a568866660e4fee01620e: Status 404 returned error can't find the container with id 85333ff30e5e24dcc160c775b73d7b12cce3861a226a568866660e4fee01620e May 27 20:16:27.296675 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:27.296643 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x" event={"ID":"7ec2fe69-a3d5-4aaf-98db-d651637aa7fa","Type":"ContainerDied","Data":"64adc5e1ac92d7313bb069d44177a6a19f112fd3647e7571a341463e02048345"} May 27 20:16:27.297102 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:27.296680 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64adc5e1ac92d7313bb069d44177a6a19f112fd3647e7571a341463e02048345" May 27 20:16:27.297102 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:27.296703 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9khs6x" May 27 20:16:27.297750 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:27.297727 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c47b79f86-v82x9" event={"ID":"9646a09a-7500-453f-988e-2889ff9038cd","Type":"ContainerStarted","Data":"85333ff30e5e24dcc160c775b73d7b12cce3861a226a568866660e4fee01620e"} May 27 20:16:28.302932 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:28.302890 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c47b79f86-v82x9" event={"ID":"9646a09a-7500-453f-988e-2889ff9038cd","Type":"ContainerStarted","Data":"933b0b39d13c279c4dfa1e9ad39bd92276813199c1782c87fb5717e079408ea4"} May 27 20:16:28.302932 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:28.302937 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6c47b79f86-v82x9" May 27 20:16:28.321277 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:28.321230 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6c47b79f86-v82x9" podStartSLOduration=0.886801941 podStartE2EDuration="2.321214345s" podCreationTimestamp="2026-05-27 20:16:26 +0000 UTC" firstStartedPulling="2026-05-27 20:16:26.720308516 +0000 UTC m=+296.248377137" lastFinishedPulling="2026-05-27 20:16:28.154720918 +0000 UTC m=+297.682789541" observedRunningTime="2026-05-27 20:16:28.319030035 +0000 UTC m=+297.847098677" watchObservedRunningTime="2026-05-27 20:16:28.321214345 +0000 UTC m=+297.849282987" May 27 20:16:30.954788 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:30.954758 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pb94r_bb578cb6-73de-4fe4-a720-1283d855030b/console-operator/1.log" May 27 20:16:30.955223 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:30.955051 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pb94r_bb578cb6-73de-4fe4-a720-1283d855030b/console-operator/1.log" May 27 20:16:30.958412 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:30.958392 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/ovn-acl-logging/0.log" May 27 20:16:30.958545 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:30.958530 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/ovn-acl-logging/0.log" May 27 20:16:30.964310 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:30.964292 2554 kubelet.go:1628] "Image garbage collection succeeded" May 27 20:16:36.293346 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:36.293315 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b59bfd74-gmffn" May 27 20:16:39.308440 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:39.308409 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6c47b79f86-v82x9" May 27 20:16:42.428948 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.428911 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj"] May 27 20:16:42.429436 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.429253 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ec2fe69-a3d5-4aaf-98db-d651637aa7fa" containerName="pull" May 27 20:16:42.429436 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.429264 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ec2fe69-a3d5-4aaf-98db-d651637aa7fa" containerName="pull" May 27 20:16:42.429436 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.429284 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ec2fe69-a3d5-4aaf-98db-d651637aa7fa" containerName="extract" May 27 20:16:42.429436 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.429290 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ec2fe69-a3d5-4aaf-98db-d651637aa7fa" containerName="extract" May 27 20:16:42.429436 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.429300 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ec2fe69-a3d5-4aaf-98db-d651637aa7fa" containerName="util" May 27 20:16:42.429436 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.429306 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ec2fe69-a3d5-4aaf-98db-d651637aa7fa" containerName="util" May 27 20:16:42.429436 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.429359 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="7ec2fe69-a3d5-4aaf-98db-d651637aa7fa" containerName="extract" May 27 20:16:42.431588 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.431569 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj" May 27 20:16:42.434140 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.434120 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 20:16:42.434269 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.434181 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 20:16:42.435205 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.435190 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r2gl6\"" May 27 20:16:42.443034 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.443014 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj"] May 27 20:16:42.463247 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.463224 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d97sx\" (UniqueName: \"kubernetes.io/projected/8986a7b8-af3f-4b71-aedb-dc8bd99c2f26-kube-api-access-d97sx\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj\" (UID: \"8986a7b8-af3f-4b71-aedb-dc8bd99c2f26\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj" May 27 20:16:42.463345 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.463265 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8986a7b8-af3f-4b71-aedb-dc8bd99c2f26-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj\" (UID: \"8986a7b8-af3f-4b71-aedb-dc8bd99c2f26\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj" May 27 20:16:42.463392 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.463349 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8986a7b8-af3f-4b71-aedb-dc8bd99c2f26-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj\" (UID: \"8986a7b8-af3f-4b71-aedb-dc8bd99c2f26\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj" May 27 20:16:42.563749 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.563715 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d97sx\" (UniqueName: \"kubernetes.io/projected/8986a7b8-af3f-4b71-aedb-dc8bd99c2f26-kube-api-access-d97sx\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj\" (UID: \"8986a7b8-af3f-4b71-aedb-dc8bd99c2f26\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj" May 27 20:16:42.563922 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.563772 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8986a7b8-af3f-4b71-aedb-dc8bd99c2f26-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj\" (UID: \"8986a7b8-af3f-4b71-aedb-dc8bd99c2f26\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj" May 27 20:16:42.563922 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.563839 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8986a7b8-af3f-4b71-aedb-dc8bd99c2f26-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj\" (UID: \"8986a7b8-af3f-4b71-aedb-dc8bd99c2f26\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj" May 27 20:16:42.564173 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.564153 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8986a7b8-af3f-4b71-aedb-dc8bd99c2f26-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj\" (UID: \"8986a7b8-af3f-4b71-aedb-dc8bd99c2f26\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj" May 27 20:16:42.564233 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.564217 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8986a7b8-af3f-4b71-aedb-dc8bd99c2f26-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj\" (UID: \"8986a7b8-af3f-4b71-aedb-dc8bd99c2f26\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj" May 27 20:16:42.576657 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.576612 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d97sx\" (UniqueName: \"kubernetes.io/projected/8986a7b8-af3f-4b71-aedb-dc8bd99c2f26-kube-api-access-d97sx\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj\" (UID: \"8986a7b8-af3f-4b71-aedb-dc8bd99c2f26\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj" May 27 20:16:42.741823 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.741736 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj" May 27 20:16:42.879237 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.879213 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj"] May 27 20:16:42.881292 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:16:42.881260 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8986a7b8_af3f_4b71_aedb_dc8bd99c2f26.slice/crio-128d96aa8f32d7fa811fe54749dbd3edfb96ef841536b1e38bd6a717e47a3676 WatchSource:0}: Error finding container 128d96aa8f32d7fa811fe54749dbd3edfb96ef841536b1e38bd6a717e47a3676: Status 404 returned error can't find the container with id 128d96aa8f32d7fa811fe54749dbd3edfb96ef841536b1e38bd6a717e47a3676 May 27 20:16:42.883244 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:42.883229 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 20:16:43.355802 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:43.355766 2554 generic.go:358] "Generic (PLEG): container finished" podID="8986a7b8-af3f-4b71-aedb-dc8bd99c2f26" containerID="b4abf79ec2755ad3df4e0106c67d26e3951ebfdd247281b29016f966b9fd014d" exitCode=0 May 27 20:16:43.355970 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:43.355812 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj" event={"ID":"8986a7b8-af3f-4b71-aedb-dc8bd99c2f26","Type":"ContainerDied","Data":"b4abf79ec2755ad3df4e0106c67d26e3951ebfdd247281b29016f966b9fd014d"} May 27 20:16:43.355970 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:43.355843 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj" event={"ID":"8986a7b8-af3f-4b71-aedb-dc8bd99c2f26","Type":"ContainerStarted","Data":"128d96aa8f32d7fa811fe54749dbd3edfb96ef841536b1e38bd6a717e47a3676"} May 27 20:16:44.361091 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:44.361058 2554 generic.go:358] "Generic (PLEG): container finished" podID="8986a7b8-af3f-4b71-aedb-dc8bd99c2f26" containerID="30cfd0a495d2c22842e8022008fc46c081b57e26975dc0044ffa2d06dfcec225" exitCode=0 May 27 20:16:44.361415 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:44.361100 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj" event={"ID":"8986a7b8-af3f-4b71-aedb-dc8bd99c2f26","Type":"ContainerDied","Data":"30cfd0a495d2c22842e8022008fc46c081b57e26975dc0044ffa2d06dfcec225"} May 27 20:16:45.366463 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:45.366429 2554 generic.go:358] "Generic (PLEG): container finished" podID="8986a7b8-af3f-4b71-aedb-dc8bd99c2f26" containerID="6cd7af4cf9678f1a1fde75a71cab628ab15e170f36567637e37d571ce4324f65" exitCode=0 May 27 20:16:45.366850 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:45.366517 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj" event={"ID":"8986a7b8-af3f-4b71-aedb-dc8bd99c2f26","Type":"ContainerDied","Data":"6cd7af4cf9678f1a1fde75a71cab628ab15e170f36567637e37d571ce4324f65"} May 27 20:16:46.501637 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:46.501606 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj" May 27 20:16:46.596909 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:46.596880 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8986a7b8-af3f-4b71-aedb-dc8bd99c2f26-bundle\") pod \"8986a7b8-af3f-4b71-aedb-dc8bd99c2f26\" (UID: \"8986a7b8-af3f-4b71-aedb-dc8bd99c2f26\") " May 27 20:16:46.597033 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:46.596918 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d97sx\" (UniqueName: \"kubernetes.io/projected/8986a7b8-af3f-4b71-aedb-dc8bd99c2f26-kube-api-access-d97sx\") pod \"8986a7b8-af3f-4b71-aedb-dc8bd99c2f26\" (UID: \"8986a7b8-af3f-4b71-aedb-dc8bd99c2f26\") " May 27 20:16:46.597033 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:46.596982 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8986a7b8-af3f-4b71-aedb-dc8bd99c2f26-util\") pod \"8986a7b8-af3f-4b71-aedb-dc8bd99c2f26\" (UID: \"8986a7b8-af3f-4b71-aedb-dc8bd99c2f26\") " May 27 20:16:46.597826 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:46.597802 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8986a7b8-af3f-4b71-aedb-dc8bd99c2f26-bundle" (OuterVolumeSpecName: "bundle") pod "8986a7b8-af3f-4b71-aedb-dc8bd99c2f26" (UID: "8986a7b8-af3f-4b71-aedb-dc8bd99c2f26"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 20:16:46.598970 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:46.598940 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8986a7b8-af3f-4b71-aedb-dc8bd99c2f26-kube-api-access-d97sx" (OuterVolumeSpecName: "kube-api-access-d97sx") pod "8986a7b8-af3f-4b71-aedb-dc8bd99c2f26" (UID: "8986a7b8-af3f-4b71-aedb-dc8bd99c2f26"). InnerVolumeSpecName "kube-api-access-d97sx". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:16:46.602831 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:46.602799 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8986a7b8-af3f-4b71-aedb-dc8bd99c2f26-util" (OuterVolumeSpecName: "util") pod "8986a7b8-af3f-4b71-aedb-dc8bd99c2f26" (UID: "8986a7b8-af3f-4b71-aedb-dc8bd99c2f26"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 20:16:46.698526 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:46.698496 2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8986a7b8-af3f-4b71-aedb-dc8bd99c2f26-util\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:16:46.698526 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:46.698529 2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8986a7b8-af3f-4b71-aedb-dc8bd99c2f26-bundle\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:16:46.698699 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:46.698540 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d97sx\" (UniqueName: \"kubernetes.io/projected/8986a7b8-af3f-4b71-aedb-dc8bd99c2f26-kube-api-access-d97sx\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:16:47.376332 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:47.376261 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj" May 27 20:16:47.376479 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:47.376260 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nmqpj" event={"ID":"8986a7b8-af3f-4b71-aedb-dc8bd99c2f26","Type":"ContainerDied","Data":"128d96aa8f32d7fa811fe54749dbd3edfb96ef841536b1e38bd6a717e47a3676"} May 27 20:16:47.376479 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:47.376379 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="128d96aa8f32d7fa811fe54749dbd3edfb96ef841536b1e38bd6a717e47a3676" May 27 20:16:52.464573 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:52.464539 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g"] May 27 20:16:52.465052 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:52.465035 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8986a7b8-af3f-4b71-aedb-dc8bd99c2f26" containerName="extract" May 27 20:16:52.465100 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:52.465054 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8986a7b8-af3f-4b71-aedb-dc8bd99c2f26" containerName="extract" May 27 20:16:52.465100 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:52.465076 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8986a7b8-af3f-4b71-aedb-dc8bd99c2f26" containerName="util" May 27 20:16:52.465100 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:52.465084 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8986a7b8-af3f-4b71-aedb-dc8bd99c2f26" containerName="util" May 27 20:16:52.465100 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:52.465095 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8986a7b8-af3f-4b71-aedb-dc8bd99c2f26" containerName="pull" May 27 20:16:52.465227 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:52.465103 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8986a7b8-af3f-4b71-aedb-dc8bd99c2f26" containerName="pull" May 27 20:16:52.465227 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:52.465196 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="8986a7b8-af3f-4b71-aedb-dc8bd99c2f26" containerName="extract" May 27 20:16:52.469224 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:52.469204 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g" May 27 20:16:52.472696 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:52.472671 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 20:16:52.473129 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:52.473116 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 20:16:52.477577 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:52.477485 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r2gl6\"" May 27 20:16:52.496257 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:52.496235 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g"] May 27 20:16:52.544440 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:52.544409 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c19acfe6-07f0-4655-821c-438ef8003150-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g\" (UID: \"c19acfe6-07f0-4655-821c-438ef8003150\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g" May 27 20:16:52.544553 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:52.544461 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzctg\" (UniqueName: \"kubernetes.io/projected/c19acfe6-07f0-4655-821c-438ef8003150-kube-api-access-pzctg\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g\" (UID: \"c19acfe6-07f0-4655-821c-438ef8003150\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g" May 27 20:16:52.544553 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:52.544507 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c19acfe6-07f0-4655-821c-438ef8003150-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g\" (UID: \"c19acfe6-07f0-4655-821c-438ef8003150\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g" May 27 20:16:52.645869 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:52.645834 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c19acfe6-07f0-4655-821c-438ef8003150-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g\" (UID: \"c19acfe6-07f0-4655-821c-438ef8003150\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g" May 27 20:16:52.646055 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:52.645910 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pzctg\" (UniqueName: \"kubernetes.io/projected/c19acfe6-07f0-4655-821c-438ef8003150-kube-api-access-pzctg\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g\" (UID: \"c19acfe6-07f0-4655-821c-438ef8003150\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g" May 27 20:16:52.646055 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:52.645943 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c19acfe6-07f0-4655-821c-438ef8003150-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g\" (UID: \"c19acfe6-07f0-4655-821c-438ef8003150\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g" May 27 20:16:52.646302 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:52.646279 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c19acfe6-07f0-4655-821c-438ef8003150-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g\" (UID: \"c19acfe6-07f0-4655-821c-438ef8003150\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g" May 27 20:16:52.646302 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:52.646295 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c19acfe6-07f0-4655-821c-438ef8003150-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g\" (UID: \"c19acfe6-07f0-4655-821c-438ef8003150\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g" May 27 20:16:52.665749 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:52.665718 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzctg\" (UniqueName: \"kubernetes.io/projected/c19acfe6-07f0-4655-821c-438ef8003150-kube-api-access-pzctg\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g\" (UID: \"c19acfe6-07f0-4655-821c-438ef8003150\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g" May 27 20:16:52.779740 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:52.779660 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g" May 27 20:16:52.948371 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:52.948344 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g"] May 27 20:16:52.950146 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:16:52.950119 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc19acfe6_07f0_4655_821c_438ef8003150.slice/crio-0bd15df0ad6fd2f09b0d5e282e98ba6871b9ba6cc976b172cd4bbaa008aeb2cc WatchSource:0}: Error finding container 0bd15df0ad6fd2f09b0d5e282e98ba6871b9ba6cc976b172cd4bbaa008aeb2cc: Status 404 returned error can't find the container with id 0bd15df0ad6fd2f09b0d5e282e98ba6871b9ba6cc976b172cd4bbaa008aeb2cc May 27 20:16:53.398276 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:53.398195 2554 generic.go:358] "Generic (PLEG): container finished" podID="c19acfe6-07f0-4655-821c-438ef8003150" containerID="90e7bf2e3496ac26212b59b5151fdadffaffd94f689be85888483fa831cf7b04" exitCode=0 May 27 20:16:53.398484 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:53.398277 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g" event={"ID":"c19acfe6-07f0-4655-821c-438ef8003150","Type":"ContainerDied","Data":"90e7bf2e3496ac26212b59b5151fdadffaffd94f689be85888483fa831cf7b04"} May 27 20:16:53.398484 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:53.398316 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g" event={"ID":"c19acfe6-07f0-4655-821c-438ef8003150","Type":"ContainerStarted","Data":"0bd15df0ad6fd2f09b0d5e282e98ba6871b9ba6cc976b172cd4bbaa008aeb2cc"} May 27 20:16:54.403937 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:54.403909 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g" event={"ID":"c19acfe6-07f0-4655-821c-438ef8003150","Type":"ContainerStarted","Data":"c770a50a970e78bd3509bb354d64bf7e101fbf131b2940f0a1b129b4938f4d29"} May 27 20:16:55.409282 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:55.409250 2554 generic.go:358] "Generic (PLEG): container finished" podID="c19acfe6-07f0-4655-821c-438ef8003150" containerID="c770a50a970e78bd3509bb354d64bf7e101fbf131b2940f0a1b129b4938f4d29" exitCode=0 May 27 20:16:55.409720 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:55.409340 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g" event={"ID":"c19acfe6-07f0-4655-821c-438ef8003150","Type":"ContainerDied","Data":"c770a50a970e78bd3509bb354d64bf7e101fbf131b2940f0a1b129b4938f4d29"} May 27 20:16:56.416279 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:56.416244 2554 generic.go:358] "Generic (PLEG): container finished" podID="c19acfe6-07f0-4655-821c-438ef8003150" containerID="a2a193c1db95656f991c58b9013c3047d34d0c1422229a8b4ff028a21c2c6ecd" exitCode=0 May 27 20:16:56.416675 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:56.416283 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g" event={"ID":"c19acfe6-07f0-4655-821c-438ef8003150","Type":"ContainerDied","Data":"a2a193c1db95656f991c58b9013c3047d34d0c1422229a8b4ff028a21c2c6ecd"} May 27 20:16:57.542039 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:57.542014 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g" May 27 20:16:57.589999 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:57.589976 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzctg\" (UniqueName: \"kubernetes.io/projected/c19acfe6-07f0-4655-821c-438ef8003150-kube-api-access-pzctg\") pod \"c19acfe6-07f0-4655-821c-438ef8003150\" (UID: \"c19acfe6-07f0-4655-821c-438ef8003150\") " May 27 20:16:57.590109 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:57.590035 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c19acfe6-07f0-4655-821c-438ef8003150-util\") pod \"c19acfe6-07f0-4655-821c-438ef8003150\" (UID: \"c19acfe6-07f0-4655-821c-438ef8003150\") " May 27 20:16:57.590109 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:57.590067 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c19acfe6-07f0-4655-821c-438ef8003150-bundle\") pod \"c19acfe6-07f0-4655-821c-438ef8003150\" (UID: \"c19acfe6-07f0-4655-821c-438ef8003150\") " May 27 20:16:57.591054 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:57.591026 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c19acfe6-07f0-4655-821c-438ef8003150-bundle" (OuterVolumeSpecName: "bundle") pod "c19acfe6-07f0-4655-821c-438ef8003150" (UID: "c19acfe6-07f0-4655-821c-438ef8003150"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 20:16:57.592029 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:57.592007 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c19acfe6-07f0-4655-821c-438ef8003150-kube-api-access-pzctg" (OuterVolumeSpecName: "kube-api-access-pzctg") pod "c19acfe6-07f0-4655-821c-438ef8003150" (UID: "c19acfe6-07f0-4655-821c-438ef8003150"). InnerVolumeSpecName "kube-api-access-pzctg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:16:57.595822 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:57.595799 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c19acfe6-07f0-4655-821c-438ef8003150-util" (OuterVolumeSpecName: "util") pod "c19acfe6-07f0-4655-821c-438ef8003150" (UID: "c19acfe6-07f0-4655-821c-438ef8003150"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 20:16:57.690742 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:57.690715 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzctg\" (UniqueName: \"kubernetes.io/projected/c19acfe6-07f0-4655-821c-438ef8003150-kube-api-access-pzctg\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:16:57.690742 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:57.690737 2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c19acfe6-07f0-4655-821c-438ef8003150-util\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:16:57.690742 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:57.690747 2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c19acfe6-07f0-4655-821c-438ef8003150-bundle\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:16:58.425940 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:58.425908 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g" event={"ID":"c19acfe6-07f0-4655-821c-438ef8003150","Type":"ContainerDied","Data":"0bd15df0ad6fd2f09b0d5e282e98ba6871b9ba6cc976b172cd4bbaa008aeb2cc"} May 27 20:16:58.425940 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:58.425940 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0bd15df0ad6fd2f09b0d5e282e98ba6871b9ba6cc976b172cd4bbaa008aeb2cc" May 27 20:16:58.425940 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:16:58.425941 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azqw2g" May 27 20:17:08.615135 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.615100 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw"] May 27 20:17:08.616232 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.616204 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c19acfe6-07f0-4655-821c-438ef8003150" containerName="pull" May 27 20:17:08.616232 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.616234 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c19acfe6-07f0-4655-821c-438ef8003150" containerName="pull" May 27 20:17:08.616369 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.616260 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c19acfe6-07f0-4655-821c-438ef8003150" containerName="extract" May 27 20:17:08.616369 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.616269 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c19acfe6-07f0-4655-821c-438ef8003150" containerName="extract" May 27 20:17:08.616369 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.616283 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c19acfe6-07f0-4655-821c-438ef8003150" containerName="util" May 27 20:17:08.616369 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.616291 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c19acfe6-07f0-4655-821c-438ef8003150" containerName="util" May 27 20:17:08.616489 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.616381 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="c19acfe6-07f0-4655-821c-438ef8003150" containerName="extract" May 27 20:17:08.623046 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.623027 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.628156 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.628134 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-s7kcp\"" May 27 20:17:08.628265 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.628135 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 27 20:17:08.634379 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.634357 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw"] May 27 20:17:08.677879 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.677854 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d408be-dd9e-4497-8093-b1190650e07f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.677996 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.677891 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7d408be-dd9e-4497-8093-b1190650e07f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.677996 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.677928 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7d408be-dd9e-4497-8093-b1190650e07f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.678081 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.678003 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7d408be-dd9e-4497-8093-b1190650e07f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.678081 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.678032 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7d408be-dd9e-4497-8093-b1190650e07f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.678152 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.678103 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7d408be-dd9e-4497-8093-b1190650e07f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.678152 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.678140 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d408be-dd9e-4497-8093-b1190650e07f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.678230 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.678180 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7d408be-dd9e-4497-8093-b1190650e07f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.678230 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.678203 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd4sp\" (UniqueName: \"kubernetes.io/projected/c7d408be-dd9e-4497-8093-b1190650e07f-kube-api-access-jd4sp\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.779104 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.779072 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d408be-dd9e-4497-8093-b1190650e07f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.779256 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.779122 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7d408be-dd9e-4497-8093-b1190650e07f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.779256 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.779153 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jd4sp\" (UniqueName: \"kubernetes.io/projected/c7d408be-dd9e-4497-8093-b1190650e07f-kube-api-access-jd4sp\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.779256 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.779204 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d408be-dd9e-4497-8093-b1190650e07f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.779256 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.779226 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7d408be-dd9e-4497-8093-b1190650e07f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.779460 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.779258 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7d408be-dd9e-4497-8093-b1190650e07f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.779460 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.779413 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7d408be-dd9e-4497-8093-b1190650e07f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.779568 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.779462 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7d408be-dd9e-4497-8093-b1190650e07f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.779568 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.779500 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d408be-dd9e-4497-8093-b1190650e07f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.779568 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.779514 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7d408be-dd9e-4497-8093-b1190650e07f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.779568 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.779524 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d408be-dd9e-4497-8093-b1190650e07f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.779819 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.779588 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7d408be-dd9e-4497-8093-b1190650e07f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.779819 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.779715 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7d408be-dd9e-4497-8093-b1190650e07f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.780029 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.780010 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7d408be-dd9e-4497-8093-b1190650e07f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.781759 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.781738 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7d408be-dd9e-4497-8093-b1190650e07f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.781983 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.781966 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7d408be-dd9e-4497-8093-b1190650e07f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.788370 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.788348 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd4sp\" (UniqueName: \"kubernetes.io/projected/c7d408be-dd9e-4497-8093-b1190650e07f-kube-api-access-jd4sp\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.788472 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.788405 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7d408be-dd9e-4497-8093-b1190650e07f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw\" (UID: \"c7d408be-dd9e-4497-8093-b1190650e07f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:08.935066 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:08.935037 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:09.065093 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:09.065061 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw"] May 27 20:17:09.067061 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:17:09.067037 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7d408be_dd9e_4497_8093_b1190650e07f.slice/crio-3bf1d7f4691b10bebbf38982852f8af113d225cd4b71789b86dbaf9298401173 WatchSource:0}: Error finding container 3bf1d7f4691b10bebbf38982852f8af113d225cd4b71789b86dbaf9298401173: Status 404 returned error can't find the container with id 3bf1d7f4691b10bebbf38982852f8af113d225cd4b71789b86dbaf9298401173 May 27 20:17:09.464703 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:09.464670 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" event={"ID":"c7d408be-dd9e-4497-8093-b1190650e07f","Type":"ContainerStarted","Data":"3bf1d7f4691b10bebbf38982852f8af113d225cd4b71789b86dbaf9298401173"} May 27 20:17:12.129888 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:12.129842 2554 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 20:17:12.130249 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:12.129925 2554 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 20:17:12.130249 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:12.129971 2554 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 20:17:12.479595 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:12.479555 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" event={"ID":"c7d408be-dd9e-4497-8093-b1190650e07f","Type":"ContainerStarted","Data":"fccdfc14970f16298d64526155eb8b4b9b6eeb4dac465f51d5640172d5ecacff"} May 27 20:17:12.502895 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:12.502851 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" podStartSLOduration=1.442115878 podStartE2EDuration="4.502837981s" podCreationTimestamp="2026-05-27 20:17:08 +0000 UTC" firstStartedPulling="2026-05-27 20:17:09.068879535 +0000 UTC m=+338.596948159" lastFinishedPulling="2026-05-27 20:17:12.129601637 +0000 UTC m=+341.657670262" observedRunningTime="2026-05-27 20:17:12.498521728 +0000 UTC m=+342.026590367" watchObservedRunningTime="2026-05-27 20:17:12.502837981 +0000 UTC m=+342.030906623" May 27 20:17:12.935165 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:12.935128 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:13.941578 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:13.941548 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:14.486908 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:14.486883 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:14.487752 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:14.487728 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw" May 27 20:17:40.427719 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:40.427685 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5bp7d"] May 27 20:17:40.432567 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:40.432546 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5bp7d" May 27 20:17:40.434989 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:40.434967 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-hd7sp\"" May 27 20:17:40.435093 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:40.434967 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 27 20:17:40.435093 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:40.434968 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 27 20:17:40.439053 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:40.439031 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5bp7d"] May 27 20:17:40.460219 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:40.460190 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6l6n\" (UniqueName: \"kubernetes.io/projected/435150cf-f982-4cb3-94a9-ac9102539559-kube-api-access-p6l6n\") pod \"kuadrant-operator-catalog-5bp7d\" (UID: \"435150cf-f982-4cb3-94a9-ac9102539559\") " pod="kuadrant-system/kuadrant-operator-catalog-5bp7d" May 27 20:17:40.561576 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:40.561543 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6l6n\" (UniqueName: \"kubernetes.io/projected/435150cf-f982-4cb3-94a9-ac9102539559-kube-api-access-p6l6n\") pod \"kuadrant-operator-catalog-5bp7d\" (UID: \"435150cf-f982-4cb3-94a9-ac9102539559\") " pod="kuadrant-system/kuadrant-operator-catalog-5bp7d" May 27 20:17:40.569543 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:40.569520 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6l6n\" (UniqueName: \"kubernetes.io/projected/435150cf-f982-4cb3-94a9-ac9102539559-kube-api-access-p6l6n\") pod \"kuadrant-operator-catalog-5bp7d\" (UID: \"435150cf-f982-4cb3-94a9-ac9102539559\") " pod="kuadrant-system/kuadrant-operator-catalog-5bp7d" May 27 20:17:40.743578 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:40.743489 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5bp7d" May 27 20:17:40.797565 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:40.797537 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5bp7d"] May 27 20:17:40.869201 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:40.869179 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5bp7d"] May 27 20:17:40.871278 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:17:40.871246 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod435150cf_f982_4cb3_94a9_ac9102539559.slice/crio-ce9ebcfdd5cc59a0207735a421e723d51125e6cd6e1be26dca3d18aa4e27e273 WatchSource:0}: Error finding container ce9ebcfdd5cc59a0207735a421e723d51125e6cd6e1be26dca3d18aa4e27e273: Status 404 returned error can't find the container with id ce9ebcfdd5cc59a0207735a421e723d51125e6cd6e1be26dca3d18aa4e27e273 May 27 20:17:41.034364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:41.034291 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dln77"] May 27 20:17:41.039037 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:41.039021 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dln77" May 27 20:17:41.064775 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:41.064744 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dln77"] May 27 20:17:41.065901 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:41.065876 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xtpx\" (UniqueName: \"kubernetes.io/projected/e596b454-527b-4ef4-b4e9-df2fe601c8a0-kube-api-access-5xtpx\") pod \"kuadrant-operator-catalog-dln77\" (UID: \"e596b454-527b-4ef4-b4e9-df2fe601c8a0\") " pod="kuadrant-system/kuadrant-operator-catalog-dln77" May 27 20:17:41.166704 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:41.166673 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5xtpx\" (UniqueName: \"kubernetes.io/projected/e596b454-527b-4ef4-b4e9-df2fe601c8a0-kube-api-access-5xtpx\") pod \"kuadrant-operator-catalog-dln77\" (UID: \"e596b454-527b-4ef4-b4e9-df2fe601c8a0\") " pod="kuadrant-system/kuadrant-operator-catalog-dln77" May 27 20:17:41.175457 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:41.175437 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xtpx\" (UniqueName: \"kubernetes.io/projected/e596b454-527b-4ef4-b4e9-df2fe601c8a0-kube-api-access-5xtpx\") pod \"kuadrant-operator-catalog-dln77\" (UID: \"e596b454-527b-4ef4-b4e9-df2fe601c8a0\") " pod="kuadrant-system/kuadrant-operator-catalog-dln77" May 27 20:17:41.348445 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:41.348375 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dln77" May 27 20:17:41.538077 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:41.538048 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dln77"] May 27 20:17:41.583500 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:41.583463 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5bp7d" event={"ID":"435150cf-f982-4cb3-94a9-ac9102539559","Type":"ContainerStarted","Data":"ce9ebcfdd5cc59a0207735a421e723d51125e6cd6e1be26dca3d18aa4e27e273"} May 27 20:17:41.583691 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:17:41.583588 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode596b454_527b_4ef4_b4e9_df2fe601c8a0.slice/crio-b6bcc672dacbe8b2892403a9a4bffde07c8a2611a474702af7c4116fe85b7df0 WatchSource:0}: Error finding container b6bcc672dacbe8b2892403a9a4bffde07c8a2611a474702af7c4116fe85b7df0: Status 404 returned error can't find the container with id b6bcc672dacbe8b2892403a9a4bffde07c8a2611a474702af7c4116fe85b7df0 May 27 20:17:42.590280 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:42.590236 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dln77" event={"ID":"e596b454-527b-4ef4-b4e9-df2fe601c8a0","Type":"ContainerStarted","Data":"b6bcc672dacbe8b2892403a9a4bffde07c8a2611a474702af7c4116fe85b7df0"} May 27 20:17:43.595100 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:43.595065 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5bp7d" event={"ID":"435150cf-f982-4cb3-94a9-ac9102539559","Type":"ContainerStarted","Data":"a360573f56b7fda7a3b1df445b06556a31d945f655c664cacb0e7cfb2cee8284"} May 27 20:17:43.595558 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:43.595155 2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-5bp7d" podUID="435150cf-f982-4cb3-94a9-ac9102539559" containerName="registry-server" containerID="cri-o://a360573f56b7fda7a3b1df445b06556a31d945f655c664cacb0e7cfb2cee8284" gracePeriod=2 May 27 20:17:43.596525 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:43.596503 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dln77" event={"ID":"e596b454-527b-4ef4-b4e9-df2fe601c8a0","Type":"ContainerStarted","Data":"6041118cc9da072a9383aaef94ca1fbcb9dff0d0366462214280a17a8ed85423"} May 27 20:17:43.612547 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:43.612508 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5bp7d" podStartSLOduration=1.4198531380000001 podStartE2EDuration="3.612497496s" podCreationTimestamp="2026-05-27 20:17:40 +0000 UTC" firstStartedPulling="2026-05-27 20:17:40.87301987 +0000 UTC m=+370.401088490" lastFinishedPulling="2026-05-27 20:17:43.065664228 +0000 UTC m=+372.593732848" observedRunningTime="2026-05-27 20:17:43.611381807 +0000 UTC m=+373.139450450" watchObservedRunningTime="2026-05-27 20:17:43.612497496 +0000 UTC m=+373.140566166" May 27 20:17:43.627684 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:43.627642 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dln77" podStartSLOduration=2.143413661 podStartE2EDuration="3.627614074s" podCreationTimestamp="2026-05-27 20:17:40 +0000 UTC" firstStartedPulling="2026-05-27 20:17:41.584926431 +0000 UTC m=+371.112995051" lastFinishedPulling="2026-05-27 20:17:43.069126844 +0000 UTC m=+372.597195464" observedRunningTime="2026-05-27 20:17:43.624850002 +0000 UTC m=+373.152918644" watchObservedRunningTime="2026-05-27 20:17:43.627614074 +0000 UTC m=+373.155682717" May 27 20:17:43.855495 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:43.855445 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5bp7d" May 27 20:17:43.891856 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:43.891831 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6l6n\" (UniqueName: \"kubernetes.io/projected/435150cf-f982-4cb3-94a9-ac9102539559-kube-api-access-p6l6n\") pod \"435150cf-f982-4cb3-94a9-ac9102539559\" (UID: \"435150cf-f982-4cb3-94a9-ac9102539559\") " May 27 20:17:43.893903 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:43.893880 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/435150cf-f982-4cb3-94a9-ac9102539559-kube-api-access-p6l6n" (OuterVolumeSpecName: "kube-api-access-p6l6n") pod "435150cf-f982-4cb3-94a9-ac9102539559" (UID: "435150cf-f982-4cb3-94a9-ac9102539559"). InnerVolumeSpecName "kube-api-access-p6l6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:17:43.992768 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:43.992745 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6l6n\" (UniqueName: \"kubernetes.io/projected/435150cf-f982-4cb3-94a9-ac9102539559-kube-api-access-p6l6n\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:17:44.601178 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:44.601144 2554 generic.go:358] "Generic (PLEG): container finished" podID="435150cf-f982-4cb3-94a9-ac9102539559" containerID="a360573f56b7fda7a3b1df445b06556a31d945f655c664cacb0e7cfb2cee8284" exitCode=0 May 27 20:17:44.601614 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:44.601209 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5bp7d" May 27 20:17:44.601614 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:44.601209 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5bp7d" event={"ID":"435150cf-f982-4cb3-94a9-ac9102539559","Type":"ContainerDied","Data":"a360573f56b7fda7a3b1df445b06556a31d945f655c664cacb0e7cfb2cee8284"} May 27 20:17:44.601614 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:44.601249 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5bp7d" event={"ID":"435150cf-f982-4cb3-94a9-ac9102539559","Type":"ContainerDied","Data":"ce9ebcfdd5cc59a0207735a421e723d51125e6cd6e1be26dca3d18aa4e27e273"} May 27 20:17:44.601614 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:44.601271 2554 scope.go:117] "RemoveContainer" containerID="a360573f56b7fda7a3b1df445b06556a31d945f655c664cacb0e7cfb2cee8284" May 27 20:17:44.611156 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:44.611140 2554 scope.go:117] "RemoveContainer" containerID="a360573f56b7fda7a3b1df445b06556a31d945f655c664cacb0e7cfb2cee8284" May 27 20:17:44.611404 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:17:44.611388 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a360573f56b7fda7a3b1df445b06556a31d945f655c664cacb0e7cfb2cee8284\": container with ID starting with a360573f56b7fda7a3b1df445b06556a31d945f655c664cacb0e7cfb2cee8284 not found: ID does not exist" containerID="a360573f56b7fda7a3b1df445b06556a31d945f655c664cacb0e7cfb2cee8284" May 27 20:17:44.611453 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:44.611412 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a360573f56b7fda7a3b1df445b06556a31d945f655c664cacb0e7cfb2cee8284"} err="failed to get container status \"a360573f56b7fda7a3b1df445b06556a31d945f655c664cacb0e7cfb2cee8284\": rpc error: code = NotFound desc = could not find container \"a360573f56b7fda7a3b1df445b06556a31d945f655c664cacb0e7cfb2cee8284\": container with ID starting with a360573f56b7fda7a3b1df445b06556a31d945f655c664cacb0e7cfb2cee8284 not found: ID does not exist" May 27 20:17:44.624111 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:44.624085 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5bp7d"] May 27 20:17:44.627007 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:44.626985 2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5bp7d"] May 27 20:17:45.055292 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:45.055258 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="435150cf-f982-4cb3-94a9-ac9102539559" path="/var/lib/kubelet/pods/435150cf-f982-4cb3-94a9-ac9102539559/volumes" May 27 20:17:51.348878 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:51.348850 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-dln77" May 27 20:17:51.348878 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:51.348887 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-dln77" May 27 20:17:51.369990 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:51.369967 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-dln77" May 27 20:17:51.646730 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:51.646657 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-dln77" May 27 20:17:56.042667 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.042634 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr"] May 27 20:17:56.043075 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.043038 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="435150cf-f982-4cb3-94a9-ac9102539559" containerName="registry-server" May 27 20:17:56.043075 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.043053 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="435150cf-f982-4cb3-94a9-ac9102539559" containerName="registry-server" May 27 20:17:56.043170 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.043121 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="435150cf-f982-4cb3-94a9-ac9102539559" containerName="registry-server" May 27 20:17:56.047699 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.047682 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr" May 27 20:17:56.051089 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.051072 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ctvqq\"" May 27 20:17:56.055820 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.055795 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr"] May 27 20:17:56.095469 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.095440 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/351b763a-c7e4-4195-8ae6-c627ff9b6829-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr\" (UID: \"351b763a-c7e4-4195-8ae6-c627ff9b6829\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr" May 27 20:17:56.095599 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.095480 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7csnw\" (UniqueName: \"kubernetes.io/projected/351b763a-c7e4-4195-8ae6-c627ff9b6829-kube-api-access-7csnw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr\" (UID: \"351b763a-c7e4-4195-8ae6-c627ff9b6829\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr" May 27 20:17:56.095599 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.095556 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/351b763a-c7e4-4195-8ae6-c627ff9b6829-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr\" (UID: \"351b763a-c7e4-4195-8ae6-c627ff9b6829\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr" May 27 20:17:56.196018 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.195982 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7csnw\" (UniqueName: \"kubernetes.io/projected/351b763a-c7e4-4195-8ae6-c627ff9b6829-kube-api-access-7csnw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr\" (UID: \"351b763a-c7e4-4195-8ae6-c627ff9b6829\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr" May 27 20:17:56.196142 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.196079 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/351b763a-c7e4-4195-8ae6-c627ff9b6829-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr\" (UID: \"351b763a-c7e4-4195-8ae6-c627ff9b6829\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr" May 27 20:17:56.196142 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.196116 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/351b763a-c7e4-4195-8ae6-c627ff9b6829-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr\" (UID: \"351b763a-c7e4-4195-8ae6-c627ff9b6829\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr" May 27 20:17:56.196511 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.196491 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/351b763a-c7e4-4195-8ae6-c627ff9b6829-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr\" (UID: \"351b763a-c7e4-4195-8ae6-c627ff9b6829\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr" May 27 20:17:56.196553 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.196528 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/351b763a-c7e4-4195-8ae6-c627ff9b6829-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr\" (UID: \"351b763a-c7e4-4195-8ae6-c627ff9b6829\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr" May 27 20:17:56.204161 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.204134 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7csnw\" (UniqueName: \"kubernetes.io/projected/351b763a-c7e4-4195-8ae6-c627ff9b6829-kube-api-access-7csnw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr\" (UID: \"351b763a-c7e4-4195-8ae6-c627ff9b6829\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr" May 27 20:17:56.358378 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.358300 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr" May 27 20:17:56.449407 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.449375 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965"] May 27 20:17:56.452918 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.452896 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965" May 27 20:17:56.460556 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.460528 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965"] May 27 20:17:56.491568 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.491548 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr"] May 27 20:17:56.493930 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:17:56.493902 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod351b763a_c7e4_4195_8ae6_c627ff9b6829.slice/crio-cff31adc71e9b9b796a3a6679b42220836bf80c5b8483964e80d05db27914d21 WatchSource:0}: Error finding container cff31adc71e9b9b796a3a6679b42220836bf80c5b8483964e80d05db27914d21: Status 404 returned error can't find the container with id cff31adc71e9b9b796a3a6679b42220836bf80c5b8483964e80d05db27914d21 May 27 20:17:56.498832 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.498768 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40228359-87ef-46b1-b695-56d61de867e0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965\" (UID: \"40228359-87ef-46b1-b695-56d61de867e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965" May 27 20:17:56.498832 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.498823 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cxbh\" (UniqueName: \"kubernetes.io/projected/40228359-87ef-46b1-b695-56d61de867e0-kube-api-access-9cxbh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965\" (UID: \"40228359-87ef-46b1-b695-56d61de867e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965" May 27 20:17:56.498925 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.498897 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40228359-87ef-46b1-b695-56d61de867e0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965\" (UID: \"40228359-87ef-46b1-b695-56d61de867e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965" May 27 20:17:56.599575 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.599553 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9cxbh\" (UniqueName: \"kubernetes.io/projected/40228359-87ef-46b1-b695-56d61de867e0-kube-api-access-9cxbh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965\" (UID: \"40228359-87ef-46b1-b695-56d61de867e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965" May 27 20:17:56.599701 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.599607 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40228359-87ef-46b1-b695-56d61de867e0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965\" (UID: \"40228359-87ef-46b1-b695-56d61de867e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965" May 27 20:17:56.599701 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.599692 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40228359-87ef-46b1-b695-56d61de867e0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965\" (UID: \"40228359-87ef-46b1-b695-56d61de867e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965" May 27 20:17:56.599966 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.599947 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40228359-87ef-46b1-b695-56d61de867e0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965\" (UID: \"40228359-87ef-46b1-b695-56d61de867e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965" May 27 20:17:56.600029 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.599963 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40228359-87ef-46b1-b695-56d61de867e0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965\" (UID: \"40228359-87ef-46b1-b695-56d61de867e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965" May 27 20:17:56.609364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.609317 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cxbh\" (UniqueName: \"kubernetes.io/projected/40228359-87ef-46b1-b695-56d61de867e0-kube-api-access-9cxbh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965\" (UID: \"40228359-87ef-46b1-b695-56d61de867e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965" May 27 20:17:56.644351 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.644324 2554 generic.go:358] "Generic (PLEG): container finished" podID="351b763a-c7e4-4195-8ae6-c627ff9b6829" containerID="151b0882d360c639de1f9cfefea169c7540ae8093ce9c82e74b7223a99985e5f" exitCode=0 May 27 20:17:56.644429 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.644404 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr" event={"ID":"351b763a-c7e4-4195-8ae6-c627ff9b6829","Type":"ContainerDied","Data":"151b0882d360c639de1f9cfefea169c7540ae8093ce9c82e74b7223a99985e5f"} May 27 20:17:56.644483 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.644433 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr" event={"ID":"351b763a-c7e4-4195-8ae6-c627ff9b6829","Type":"ContainerStarted","Data":"cff31adc71e9b9b796a3a6679b42220836bf80c5b8483964e80d05db27914d21"} May 27 20:17:56.765232 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.765206 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965" May 27 20:17:56.848765 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.848737 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6"] May 27 20:17:56.852028 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.852005 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6" May 27 20:17:56.861376 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.861275 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6"] May 27 20:17:56.897616 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.897594 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965"] May 27 20:17:56.899059 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:17:56.899036 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40228359_87ef_46b1_b695_56d61de867e0.slice/crio-e9aa87d2e294a1114d6c349fbe6ee87ca39207472e92e7ff5d06a11b13a7cb4e WatchSource:0}: Error finding container e9aa87d2e294a1114d6c349fbe6ee87ca39207472e92e7ff5d06a11b13a7cb4e: Status 404 returned error can't find the container with id e9aa87d2e294a1114d6c349fbe6ee87ca39207472e92e7ff5d06a11b13a7cb4e May 27 20:17:56.903015 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.902991 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcn5r\" (UniqueName: \"kubernetes.io/projected/548aee60-9b43-4e62-8c69-0b484fb49565-kube-api-access-jcn5r\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6\" (UID: \"548aee60-9b43-4e62-8c69-0b484fb49565\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6" May 27 20:17:56.903105 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.903032 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/548aee60-9b43-4e62-8c69-0b484fb49565-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6\" (UID: \"548aee60-9b43-4e62-8c69-0b484fb49565\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6" May 27 20:17:56.903171 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:56.903152 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/548aee60-9b43-4e62-8c69-0b484fb49565-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6\" (UID: \"548aee60-9b43-4e62-8c69-0b484fb49565\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6" May 27 20:17:57.003593 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.003564 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/548aee60-9b43-4e62-8c69-0b484fb49565-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6\" (UID: \"548aee60-9b43-4e62-8c69-0b484fb49565\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6" May 27 20:17:57.003726 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.003606 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jcn5r\" (UniqueName: \"kubernetes.io/projected/548aee60-9b43-4e62-8c69-0b484fb49565-kube-api-access-jcn5r\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6\" (UID: \"548aee60-9b43-4e62-8c69-0b484fb49565\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6" May 27 20:17:57.003726 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.003658 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/548aee60-9b43-4e62-8c69-0b484fb49565-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6\" (UID: \"548aee60-9b43-4e62-8c69-0b484fb49565\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6" May 27 20:17:57.003915 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.003897 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/548aee60-9b43-4e62-8c69-0b484fb49565-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6\" (UID: \"548aee60-9b43-4e62-8c69-0b484fb49565\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6" May 27 20:17:57.003993 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.003974 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/548aee60-9b43-4e62-8c69-0b484fb49565-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6\" (UID: \"548aee60-9b43-4e62-8c69-0b484fb49565\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6" May 27 20:17:57.013939 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.013915 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcn5r\" (UniqueName: \"kubernetes.io/projected/548aee60-9b43-4e62-8c69-0b484fb49565-kube-api-access-jcn5r\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6\" (UID: \"548aee60-9b43-4e62-8c69-0b484fb49565\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6" May 27 20:17:57.163950 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.163868 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6" May 27 20:17:57.273842 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.273811 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl"] May 27 20:17:57.277340 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.277319 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl" May 27 20:17:57.287108 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.287082 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl"] May 27 20:17:57.298842 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.298796 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6"] May 27 20:17:57.300963 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:17:57.300936 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod548aee60_9b43_4e62_8c69_0b484fb49565.slice/crio-39b3e151899169fb98912dc65ae0f69c3c3eafc0b6842ec7834754305be48913 WatchSource:0}: Error finding container 39b3e151899169fb98912dc65ae0f69c3c3eafc0b6842ec7834754305be48913: Status 404 returned error can't find the container with id 39b3e151899169fb98912dc65ae0f69c3c3eafc0b6842ec7834754305be48913 May 27 20:17:57.406972 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.406945 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e9cf514-4242-4f48-96e9-e4838c7c0291-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl\" (UID: \"6e9cf514-4242-4f48-96e9-e4838c7c0291\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl" May 27 20:17:57.407068 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.406981 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e9cf514-4242-4f48-96e9-e4838c7c0291-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl\" (UID: \"6e9cf514-4242-4f48-96e9-e4838c7c0291\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl" May 27 20:17:57.407136 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.407111 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtgnn\" (UniqueName: \"kubernetes.io/projected/6e9cf514-4242-4f48-96e9-e4838c7c0291-kube-api-access-jtgnn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl\" (UID: \"6e9cf514-4242-4f48-96e9-e4838c7c0291\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl" May 27 20:17:57.508595 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.508563 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e9cf514-4242-4f48-96e9-e4838c7c0291-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl\" (UID: \"6e9cf514-4242-4f48-96e9-e4838c7c0291\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl" May 27 20:17:57.508595 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.508603 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e9cf514-4242-4f48-96e9-e4838c7c0291-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl\" (UID: \"6e9cf514-4242-4f48-96e9-e4838c7c0291\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl" May 27 20:17:57.508857 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.508689 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jtgnn\" (UniqueName: \"kubernetes.io/projected/6e9cf514-4242-4f48-96e9-e4838c7c0291-kube-api-access-jtgnn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl\" (UID: \"6e9cf514-4242-4f48-96e9-e4838c7c0291\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl" May 27 20:17:57.508934 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.508914 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e9cf514-4242-4f48-96e9-e4838c7c0291-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl\" (UID: \"6e9cf514-4242-4f48-96e9-e4838c7c0291\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl" May 27 20:17:57.509005 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.508987 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e9cf514-4242-4f48-96e9-e4838c7c0291-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl\" (UID: \"6e9cf514-4242-4f48-96e9-e4838c7c0291\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl" May 27 20:17:57.517057 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.517028 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtgnn\" (UniqueName: \"kubernetes.io/projected/6e9cf514-4242-4f48-96e9-e4838c7c0291-kube-api-access-jtgnn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl\" (UID: \"6e9cf514-4242-4f48-96e9-e4838c7c0291\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl" May 27 20:17:57.587696 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.587673 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl" May 27 20:17:57.650745 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.650712 2554 generic.go:358] "Generic (PLEG): container finished" podID="351b763a-c7e4-4195-8ae6-c627ff9b6829" containerID="5719b39d8c89acbf4a56c893d3e9f43149296e2844270de004d8502911128861" exitCode=0 May 27 20:17:57.650907 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.650780 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr" event={"ID":"351b763a-c7e4-4195-8ae6-c627ff9b6829","Type":"ContainerDied","Data":"5719b39d8c89acbf4a56c893d3e9f43149296e2844270de004d8502911128861"} May 27 20:17:57.652359 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.652333 2554 generic.go:358] "Generic (PLEG): container finished" podID="548aee60-9b43-4e62-8c69-0b484fb49565" containerID="c83a3b6ca94bb58d389c90d00541072ff02c147852ba53baee46a301d518b8a3" exitCode=0 May 27 20:17:57.652473 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.652395 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6" event={"ID":"548aee60-9b43-4e62-8c69-0b484fb49565","Type":"ContainerDied","Data":"c83a3b6ca94bb58d389c90d00541072ff02c147852ba53baee46a301d518b8a3"} May 27 20:17:57.652473 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.652427 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6" event={"ID":"548aee60-9b43-4e62-8c69-0b484fb49565","Type":"ContainerStarted","Data":"39b3e151899169fb98912dc65ae0f69c3c3eafc0b6842ec7834754305be48913"} May 27 20:17:57.654118 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.654010 2554 generic.go:358] "Generic (PLEG): container finished" podID="40228359-87ef-46b1-b695-56d61de867e0" containerID="61aad0dea34610c190e2b818779e71b1f30055d2166811f34acb8f990bd9aef1" exitCode=0 May 27 20:17:57.654118 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.654045 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965" event={"ID":"40228359-87ef-46b1-b695-56d61de867e0","Type":"ContainerDied","Data":"61aad0dea34610c190e2b818779e71b1f30055d2166811f34acb8f990bd9aef1"} May 27 20:17:57.654118 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.654094 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965" event={"ID":"40228359-87ef-46b1-b695-56d61de867e0","Type":"ContainerStarted","Data":"e9aa87d2e294a1114d6c349fbe6ee87ca39207472e92e7ff5d06a11b13a7cb4e"} May 27 20:17:57.725216 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:57.725189 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl"] May 27 20:17:57.726005 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:17:57.725981 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e9cf514_4242_4f48_96e9_e4838c7c0291.slice/crio-8eb13e88b6671a8644c411b39f7607349f247f7879c74305a36df0faf90c0f38 WatchSource:0}: Error finding container 8eb13e88b6671a8644c411b39f7607349f247f7879c74305a36df0faf90c0f38: Status 404 returned error can't find the container with id 8eb13e88b6671a8644c411b39f7607349f247f7879c74305a36df0faf90c0f38 May 27 20:17:58.660035 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:58.660001 2554 generic.go:358] "Generic (PLEG): container finished" podID="6e9cf514-4242-4f48-96e9-e4838c7c0291" containerID="a4c36718d00f541c205bef416f00237854fd6a79823779ee0c9cefc438307674" exitCode=0 May 27 20:17:58.660750 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:58.660093 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl" event={"ID":"6e9cf514-4242-4f48-96e9-e4838c7c0291","Type":"ContainerDied","Data":"a4c36718d00f541c205bef416f00237854fd6a79823779ee0c9cefc438307674"} May 27 20:17:58.660750 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:58.660129 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl" event={"ID":"6e9cf514-4242-4f48-96e9-e4838c7c0291","Type":"ContainerStarted","Data":"8eb13e88b6671a8644c411b39f7607349f247f7879c74305a36df0faf90c0f38"} May 27 20:17:58.662678 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:58.662648 2554 generic.go:358] "Generic (PLEG): container finished" podID="351b763a-c7e4-4195-8ae6-c627ff9b6829" containerID="14d7e9c7f0f0b27cc141b018083577b9eabaad8016f6786cddb7bc8dbd42dd03" exitCode=0 May 27 20:17:58.662792 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:58.662727 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr" event={"ID":"351b763a-c7e4-4195-8ae6-c627ff9b6829","Type":"ContainerDied","Data":"14d7e9c7f0f0b27cc141b018083577b9eabaad8016f6786cddb7bc8dbd42dd03"} May 27 20:17:58.664360 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:58.664341 2554 generic.go:358] "Generic (PLEG): container finished" podID="548aee60-9b43-4e62-8c69-0b484fb49565" containerID="432624bf868a05d5f4cd716839521cd55e7b93c69eacb6a601742a65923161ad" exitCode=0 May 27 20:17:58.664456 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:58.664412 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6" event={"ID":"548aee60-9b43-4e62-8c69-0b484fb49565","Type":"ContainerDied","Data":"432624bf868a05d5f4cd716839521cd55e7b93c69eacb6a601742a65923161ad"} May 27 20:17:58.666366 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:58.666269 2554 generic.go:358] "Generic (PLEG): container finished" podID="40228359-87ef-46b1-b695-56d61de867e0" containerID="02e9c83b1f736cb4c2eadfaa9acc060779064192d7cd565a7d91fdab2c73a469" exitCode=0 May 27 20:17:58.666366 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:58.666298 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965" event={"ID":"40228359-87ef-46b1-b695-56d61de867e0","Type":"ContainerDied","Data":"02e9c83b1f736cb4c2eadfaa9acc060779064192d7cd565a7d91fdab2c73a469"} May 27 20:17:59.678124 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:59.678089 2554 generic.go:358] "Generic (PLEG): container finished" podID="6e9cf514-4242-4f48-96e9-e4838c7c0291" containerID="4e821520795564be5d53c4b19e798672c9443b04837e1c8d8779f18913505797" exitCode=0 May 27 20:17:59.678493 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:59.678175 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl" event={"ID":"6e9cf514-4242-4f48-96e9-e4838c7c0291","Type":"ContainerDied","Data":"4e821520795564be5d53c4b19e798672c9443b04837e1c8d8779f18913505797"} May 27 20:17:59.680089 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:59.680070 2554 generic.go:358] "Generic (PLEG): container finished" podID="548aee60-9b43-4e62-8c69-0b484fb49565" containerID="ccf05bbf9575180263a907882dd9b09c8c2b1ed3cf9041bd195b05f164ceac24" exitCode=0 May 27 20:17:59.680180 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:59.680094 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6" event={"ID":"548aee60-9b43-4e62-8c69-0b484fb49565","Type":"ContainerDied","Data":"ccf05bbf9575180263a907882dd9b09c8c2b1ed3cf9041bd195b05f164ceac24"} May 27 20:17:59.682057 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:59.682038 2554 generic.go:358] "Generic (PLEG): container finished" podID="40228359-87ef-46b1-b695-56d61de867e0" containerID="9a573d307b172311b82c69052a6ffd6e285ba7122bb3142e5e3a8bbc68279e96" exitCode=0 May 27 20:17:59.682173 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:59.682119 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965" event={"ID":"40228359-87ef-46b1-b695-56d61de867e0","Type":"ContainerDied","Data":"9a573d307b172311b82c69052a6ffd6e285ba7122bb3142e5e3a8bbc68279e96"} May 27 20:17:59.888318 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:17:59.888297 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr" May 27 20:18:00.030858 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.030789 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/351b763a-c7e4-4195-8ae6-c627ff9b6829-util\") pod \"351b763a-c7e4-4195-8ae6-c627ff9b6829\" (UID: \"351b763a-c7e4-4195-8ae6-c627ff9b6829\") " May 27 20:18:00.030858 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.030823 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7csnw\" (UniqueName: \"kubernetes.io/projected/351b763a-c7e4-4195-8ae6-c627ff9b6829-kube-api-access-7csnw\") pod \"351b763a-c7e4-4195-8ae6-c627ff9b6829\" (UID: \"351b763a-c7e4-4195-8ae6-c627ff9b6829\") " May 27 20:18:00.030858 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.030848 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/351b763a-c7e4-4195-8ae6-c627ff9b6829-bundle\") pod \"351b763a-c7e4-4195-8ae6-c627ff9b6829\" (UID: \"351b763a-c7e4-4195-8ae6-c627ff9b6829\") " May 27 20:18:00.031424 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.031392 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/351b763a-c7e4-4195-8ae6-c627ff9b6829-bundle" (OuterVolumeSpecName: "bundle") pod "351b763a-c7e4-4195-8ae6-c627ff9b6829" (UID: "351b763a-c7e4-4195-8ae6-c627ff9b6829"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 20:18:00.032863 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.032841 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/351b763a-c7e4-4195-8ae6-c627ff9b6829-kube-api-access-7csnw" (OuterVolumeSpecName: "kube-api-access-7csnw") pod "351b763a-c7e4-4195-8ae6-c627ff9b6829" (UID: "351b763a-c7e4-4195-8ae6-c627ff9b6829"). InnerVolumeSpecName "kube-api-access-7csnw". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:18:00.036382 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.036360 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/351b763a-c7e4-4195-8ae6-c627ff9b6829-util" (OuterVolumeSpecName: "util") pod "351b763a-c7e4-4195-8ae6-c627ff9b6829" (UID: "351b763a-c7e4-4195-8ae6-c627ff9b6829"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 20:18:00.132330 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.132302 2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/351b763a-c7e4-4195-8ae6-c627ff9b6829-util\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:18:00.132330 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.132327 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7csnw\" (UniqueName: \"kubernetes.io/projected/351b763a-c7e4-4195-8ae6-c627ff9b6829-kube-api-access-7csnw\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:18:00.132460 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.132338 2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/351b763a-c7e4-4195-8ae6-c627ff9b6829-bundle\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:18:00.688136 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.688105 2554 generic.go:358] "Generic (PLEG): container finished" podID="6e9cf514-4242-4f48-96e9-e4838c7c0291" containerID="be163a9964a152956a65431ee9bdfca85798429151db85f98cdd2ec8e3e70a4a" exitCode=0 May 27 20:18:00.688556 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.688245 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl" event={"ID":"6e9cf514-4242-4f48-96e9-e4838c7c0291","Type":"ContainerDied","Data":"be163a9964a152956a65431ee9bdfca85798429151db85f98cdd2ec8e3e70a4a"} May 27 20:18:00.689737 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.689708 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr" event={"ID":"351b763a-c7e4-4195-8ae6-c627ff9b6829","Type":"ContainerDied","Data":"cff31adc71e9b9b796a3a6679b42220836bf80c5b8483964e80d05db27914d21"} May 27 20:18:00.689737 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.689736 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr" May 27 20:18:00.689886 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.689744 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cff31adc71e9b9b796a3a6679b42220836bf80c5b8483964e80d05db27914d21" May 27 20:18:00.820453 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.820430 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6" May 27 20:18:00.853451 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.853431 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965" May 27 20:18:00.939901 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.939829 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40228359-87ef-46b1-b695-56d61de867e0-util\") pod \"40228359-87ef-46b1-b695-56d61de867e0\" (UID: \"40228359-87ef-46b1-b695-56d61de867e0\") " May 27 20:18:00.939901 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.939874 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40228359-87ef-46b1-b695-56d61de867e0-bundle\") pod \"40228359-87ef-46b1-b695-56d61de867e0\" (UID: \"40228359-87ef-46b1-b695-56d61de867e0\") " May 27 20:18:00.939901 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.939893 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/548aee60-9b43-4e62-8c69-0b484fb49565-bundle\") pod \"548aee60-9b43-4e62-8c69-0b484fb49565\" (UID: \"548aee60-9b43-4e62-8c69-0b484fb49565\") " May 27 20:18:00.940111 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.939976 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcn5r\" (UniqueName: \"kubernetes.io/projected/548aee60-9b43-4e62-8c69-0b484fb49565-kube-api-access-jcn5r\") pod \"548aee60-9b43-4e62-8c69-0b484fb49565\" (UID: \"548aee60-9b43-4e62-8c69-0b484fb49565\") " May 27 20:18:00.940111 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.940004 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/548aee60-9b43-4e62-8c69-0b484fb49565-util\") pod \"548aee60-9b43-4e62-8c69-0b484fb49565\" (UID: \"548aee60-9b43-4e62-8c69-0b484fb49565\") " May 27 20:18:00.940111 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.940042 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cxbh\" (UniqueName: \"kubernetes.io/projected/40228359-87ef-46b1-b695-56d61de867e0-kube-api-access-9cxbh\") pod \"40228359-87ef-46b1-b695-56d61de867e0\" (UID: \"40228359-87ef-46b1-b695-56d61de867e0\") " May 27 20:18:00.940506 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.940430 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/548aee60-9b43-4e62-8c69-0b484fb49565-bundle" (OuterVolumeSpecName: "bundle") pod "548aee60-9b43-4e62-8c69-0b484fb49565" (UID: "548aee60-9b43-4e62-8c69-0b484fb49565"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 20:18:00.940506 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.940455 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40228359-87ef-46b1-b695-56d61de867e0-bundle" (OuterVolumeSpecName: "bundle") pod "40228359-87ef-46b1-b695-56d61de867e0" (UID: "40228359-87ef-46b1-b695-56d61de867e0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 20:18:00.942143 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.942123 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/548aee60-9b43-4e62-8c69-0b484fb49565-kube-api-access-jcn5r" (OuterVolumeSpecName: "kube-api-access-jcn5r") pod "548aee60-9b43-4e62-8c69-0b484fb49565" (UID: "548aee60-9b43-4e62-8c69-0b484fb49565"). InnerVolumeSpecName "kube-api-access-jcn5r". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:18:00.942429 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.942410 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40228359-87ef-46b1-b695-56d61de867e0-kube-api-access-9cxbh" (OuterVolumeSpecName: "kube-api-access-9cxbh") pod "40228359-87ef-46b1-b695-56d61de867e0" (UID: "40228359-87ef-46b1-b695-56d61de867e0"). InnerVolumeSpecName "kube-api-access-9cxbh". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:18:00.946522 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.946485 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40228359-87ef-46b1-b695-56d61de867e0-util" (OuterVolumeSpecName: "util") pod "40228359-87ef-46b1-b695-56d61de867e0" (UID: "40228359-87ef-46b1-b695-56d61de867e0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 20:18:00.946661 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:00.946642 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/548aee60-9b43-4e62-8c69-0b484fb49565-util" (OuterVolumeSpecName: "util") pod "548aee60-9b43-4e62-8c69-0b484fb49565" (UID: "548aee60-9b43-4e62-8c69-0b484fb49565"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 20:18:01.041635 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:01.041592 2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40228359-87ef-46b1-b695-56d61de867e0-bundle\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:18:01.041635 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:01.041615 2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/548aee60-9b43-4e62-8c69-0b484fb49565-bundle\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:18:01.041776 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:01.041645 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcn5r\" (UniqueName: \"kubernetes.io/projected/548aee60-9b43-4e62-8c69-0b484fb49565-kube-api-access-jcn5r\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:18:01.041776 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:01.041655 2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/548aee60-9b43-4e62-8c69-0b484fb49565-util\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:18:01.041776 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:01.041664 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cxbh\" (UniqueName: \"kubernetes.io/projected/40228359-87ef-46b1-b695-56d61de867e0-kube-api-access-9cxbh\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:18:01.041776 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:01.041673 2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40228359-87ef-46b1-b695-56d61de867e0-util\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:18:01.695364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:01.695334 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6" event={"ID":"548aee60-9b43-4e62-8c69-0b484fb49565","Type":"ContainerDied","Data":"39b3e151899169fb98912dc65ae0f69c3c3eafc0b6842ec7834754305be48913"} May 27 20:18:01.695364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:01.695361 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6" May 27 20:18:01.695364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:01.695368 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39b3e151899169fb98912dc65ae0f69c3c3eafc0b6842ec7834754305be48913" May 27 20:18:01.697239 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:01.697209 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965" event={"ID":"40228359-87ef-46b1-b695-56d61de867e0","Type":"ContainerDied","Data":"e9aa87d2e294a1114d6c349fbe6ee87ca39207472e92e7ff5d06a11b13a7cb4e"} May 27 20:18:01.697360 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:01.697259 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9aa87d2e294a1114d6c349fbe6ee87ca39207472e92e7ff5d06a11b13a7cb4e" May 27 20:18:01.697360 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:01.697227 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965" May 27 20:18:01.822997 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:01.822976 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl" May 27 20:18:01.949854 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:01.949762 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e9cf514-4242-4f48-96e9-e4838c7c0291-bundle\") pod \"6e9cf514-4242-4f48-96e9-e4838c7c0291\" (UID: \"6e9cf514-4242-4f48-96e9-e4838c7c0291\") " May 27 20:18:01.950031 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:01.949865 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e9cf514-4242-4f48-96e9-e4838c7c0291-util\") pod \"6e9cf514-4242-4f48-96e9-e4838c7c0291\" (UID: \"6e9cf514-4242-4f48-96e9-e4838c7c0291\") " May 27 20:18:01.950031 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:01.949892 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtgnn\" (UniqueName: \"kubernetes.io/projected/6e9cf514-4242-4f48-96e9-e4838c7c0291-kube-api-access-jtgnn\") pod \"6e9cf514-4242-4f48-96e9-e4838c7c0291\" (UID: \"6e9cf514-4242-4f48-96e9-e4838c7c0291\") " May 27 20:18:01.950295 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:01.950268 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e9cf514-4242-4f48-96e9-e4838c7c0291-bundle" (OuterVolumeSpecName: "bundle") pod "6e9cf514-4242-4f48-96e9-e4838c7c0291" (UID: "6e9cf514-4242-4f48-96e9-e4838c7c0291"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 20:18:01.952080 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:01.952058 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e9cf514-4242-4f48-96e9-e4838c7c0291-kube-api-access-jtgnn" (OuterVolumeSpecName: "kube-api-access-jtgnn") pod "6e9cf514-4242-4f48-96e9-e4838c7c0291" (UID: "6e9cf514-4242-4f48-96e9-e4838c7c0291"). InnerVolumeSpecName "kube-api-access-jtgnn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:18:01.955252 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:01.955228 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e9cf514-4242-4f48-96e9-e4838c7c0291-util" (OuterVolumeSpecName: "util") pod "6e9cf514-4242-4f48-96e9-e4838c7c0291" (UID: "6e9cf514-4242-4f48-96e9-e4838c7c0291"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 20:18:02.051065 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:02.051025 2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e9cf514-4242-4f48-96e9-e4838c7c0291-bundle\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:18:02.051065 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:02.051058 2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e9cf514-4242-4f48-96e9-e4838c7c0291-util\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:18:02.051065 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:02.051072 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtgnn\" (UniqueName: \"kubernetes.io/projected/6e9cf514-4242-4f48-96e9-e4838c7c0291-kube-api-access-jtgnn\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:18:02.708992 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:02.708950 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl" event={"ID":"6e9cf514-4242-4f48-96e9-e4838c7c0291","Type":"ContainerDied","Data":"8eb13e88b6671a8644c411b39f7607349f247f7879c74305a36df0faf90c0f38"} May 27 20:18:02.708992 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:02.708991 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8eb13e88b6671a8644c411b39f7607349f247f7879c74305a36df0faf90c0f38" May 27 20:18:02.709419 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:02.709028 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl" May 27 20:18:11.574985 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.574949 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-fnv7v"] May 27 20:18:11.575417 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575337 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="548aee60-9b43-4e62-8c69-0b484fb49565" containerName="util" May 27 20:18:11.575417 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575349 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="548aee60-9b43-4e62-8c69-0b484fb49565" containerName="util" May 27 20:18:11.575417 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575361 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e9cf514-4242-4f48-96e9-e4838c7c0291" containerName="pull" May 27 20:18:11.575417 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575367 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e9cf514-4242-4f48-96e9-e4838c7c0291" containerName="pull" May 27 20:18:11.575417 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575378 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="351b763a-c7e4-4195-8ae6-c627ff9b6829" containerName="extract" May 27 20:18:11.575417 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575384 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="351b763a-c7e4-4195-8ae6-c627ff9b6829" containerName="extract" May 27 20:18:11.575417 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575390 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e9cf514-4242-4f48-96e9-e4838c7c0291" containerName="util" May 27 20:18:11.575417 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575394 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e9cf514-4242-4f48-96e9-e4838c7c0291" containerName="util" May 27 20:18:11.575417 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575400 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40228359-87ef-46b1-b695-56d61de867e0" containerName="pull" May 27 20:18:11.575417 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575404 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="40228359-87ef-46b1-b695-56d61de867e0" containerName="pull" May 27 20:18:11.575417 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575410 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="548aee60-9b43-4e62-8c69-0b484fb49565" containerName="pull" May 27 20:18:11.575417 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575415 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="548aee60-9b43-4e62-8c69-0b484fb49565" containerName="pull" May 27 20:18:11.575417 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575422 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="351b763a-c7e4-4195-8ae6-c627ff9b6829" containerName="pull" May 27 20:18:11.575854 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575427 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="351b763a-c7e4-4195-8ae6-c627ff9b6829" containerName="pull" May 27 20:18:11.575854 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575433 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e9cf514-4242-4f48-96e9-e4838c7c0291" containerName="extract" May 27 20:18:11.575854 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575437 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e9cf514-4242-4f48-96e9-e4838c7c0291" containerName="extract" May 27 20:18:11.575854 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575444 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40228359-87ef-46b1-b695-56d61de867e0" containerName="extract" May 27 20:18:11.575854 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575449 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="40228359-87ef-46b1-b695-56d61de867e0" containerName="extract" May 27 20:18:11.575854 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575457 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="548aee60-9b43-4e62-8c69-0b484fb49565" containerName="extract" May 27 20:18:11.575854 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575462 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="548aee60-9b43-4e62-8c69-0b484fb49565" containerName="extract" May 27 20:18:11.575854 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575471 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="351b763a-c7e4-4195-8ae6-c627ff9b6829" containerName="util" May 27 20:18:11.575854 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575476 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="351b763a-c7e4-4195-8ae6-c627ff9b6829" containerName="util" May 27 20:18:11.575854 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575483 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40228359-87ef-46b1-b695-56d61de867e0" containerName="util" May 27 20:18:11.575854 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575488 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="40228359-87ef-46b1-b695-56d61de867e0" containerName="util" May 27 20:18:11.575854 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575540 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="40228359-87ef-46b1-b695-56d61de867e0" containerName="extract" May 27 20:18:11.575854 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575549 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="6e9cf514-4242-4f48-96e9-e4838c7c0291" containerName="extract" May 27 20:18:11.575854 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575558 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="548aee60-9b43-4e62-8c69-0b484fb49565" containerName="extract" May 27 20:18:11.575854 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.575565 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="351b763a-c7e4-4195-8ae6-c627ff9b6829" containerName="extract" May 27 20:18:11.578364 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.578341 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fnv7v" May 27 20:18:11.580889 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.580862 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 27 20:18:11.581003 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.580919 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-7kk4k\"" May 27 20:18:11.590347 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.590321 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-fnv7v"] May 27 20:18:11.734248 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.734211 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj4wr\" (UniqueName: \"kubernetes.io/projected/a164cbfa-7716-4362-9b91-9dfe09c81cb2-kube-api-access-lj4wr\") pod \"dns-operator-controller-manager-648d5c98bc-fnv7v\" (UID: \"a164cbfa-7716-4362-9b91-9dfe09c81cb2\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fnv7v" May 27 20:18:11.835718 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.835608 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lj4wr\" (UniqueName: \"kubernetes.io/projected/a164cbfa-7716-4362-9b91-9dfe09c81cb2-kube-api-access-lj4wr\") pod \"dns-operator-controller-manager-648d5c98bc-fnv7v\" (UID: \"a164cbfa-7716-4362-9b91-9dfe09c81cb2\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fnv7v" May 27 20:18:11.850872 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.850839 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj4wr\" (UniqueName: \"kubernetes.io/projected/a164cbfa-7716-4362-9b91-9dfe09c81cb2-kube-api-access-lj4wr\") pod \"dns-operator-controller-manager-648d5c98bc-fnv7v\" (UID: \"a164cbfa-7716-4362-9b91-9dfe09c81cb2\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fnv7v" May 27 20:18:11.888766 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:11.888744 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fnv7v" May 27 20:18:12.025671 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:12.025643 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-fnv7v"] May 27 20:18:12.027215 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:18:12.027189 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda164cbfa_7716_4362_9b91_9dfe09c81cb2.slice/crio-46fd8821e4540f348136c4b3e1599fcf94ba9cdfd9a67f67d242a506bf6f2156 WatchSource:0}: Error finding container 46fd8821e4540f348136c4b3e1599fcf94ba9cdfd9a67f67d242a506bf6f2156: Status 404 returned error can't find the container with id 46fd8821e4540f348136c4b3e1599fcf94ba9cdfd9a67f67d242a506bf6f2156 May 27 20:18:12.748689 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:12.748649 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fnv7v" event={"ID":"a164cbfa-7716-4362-9b91-9dfe09c81cb2","Type":"ContainerStarted","Data":"46fd8821e4540f348136c4b3e1599fcf94ba9cdfd9a67f67d242a506bf6f2156"} May 27 20:18:14.759530 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:14.759441 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fnv7v" event={"ID":"a164cbfa-7716-4362-9b91-9dfe09c81cb2","Type":"ContainerStarted","Data":"4779f49efc81a6c83719c042e3654614d769c042c0fbc21194b509d7305b4e94"} May 27 20:18:14.759530 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:14.759509 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fnv7v" May 27 20:18:14.781720 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:14.781671 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fnv7v" podStartSLOduration=1.309283354 podStartE2EDuration="3.781659543s" podCreationTimestamp="2026-05-27 20:18:11 +0000 UTC" firstStartedPulling="2026-05-27 20:18:12.029105317 +0000 UTC m=+401.557173937" lastFinishedPulling="2026-05-27 20:18:14.501481492 +0000 UTC m=+404.029550126" observedRunningTime="2026-05-27 20:18:14.778386657 +0000 UTC m=+404.306455301" watchObservedRunningTime="2026-05-27 20:18:14.781659543 +0000 UTC m=+404.309728185" May 27 20:18:16.884904 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:16.884869 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k"] May 27 20:18:16.888939 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:16.888919 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k" May 27 20:18:16.891597 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:16.891582 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hpcdj\"" May 27 20:18:16.903129 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:16.903107 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k"] May 27 20:18:16.981294 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:16.981262 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z4lx\" (UniqueName: \"kubernetes.io/projected/3160a231-ca2b-416f-a595-c8164eb9c746-kube-api-access-8z4lx\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2qp7k\" (UID: \"3160a231-ca2b-416f-a595-c8164eb9c746\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k" May 27 20:18:16.981294 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:16.981298 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3160a231-ca2b-416f-a595-c8164eb9c746-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2qp7k\" (UID: \"3160a231-ca2b-416f-a595-c8164eb9c746\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k" May 27 20:18:17.082751 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:17.082723 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8z4lx\" (UniqueName: \"kubernetes.io/projected/3160a231-ca2b-416f-a595-c8164eb9c746-kube-api-access-8z4lx\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2qp7k\" (UID: \"3160a231-ca2b-416f-a595-c8164eb9c746\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k" May 27 20:18:17.082909 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:17.082758 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3160a231-ca2b-416f-a595-c8164eb9c746-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2qp7k\" (UID: \"3160a231-ca2b-416f-a595-c8164eb9c746\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k" May 27 20:18:17.083117 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:17.083101 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3160a231-ca2b-416f-a595-c8164eb9c746-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2qp7k\" (UID: \"3160a231-ca2b-416f-a595-c8164eb9c746\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k" May 27 20:18:17.093138 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:17.093109 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z4lx\" (UniqueName: \"kubernetes.io/projected/3160a231-ca2b-416f-a595-c8164eb9c746-kube-api-access-8z4lx\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2qp7k\" (UID: \"3160a231-ca2b-416f-a595-c8164eb9c746\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k" May 27 20:18:17.199406 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:17.199368 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k" May 27 20:18:17.333443 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:17.333419 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k"] May 27 20:18:17.335033 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:18:17.334998 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3160a231_ca2b_416f_a595_c8164eb9c746.slice/crio-1eb75f0ff569ba0194441c883e114ce44be587312348ae0ab74f370363c9f153 WatchSource:0}: Error finding container 1eb75f0ff569ba0194441c883e114ce44be587312348ae0ab74f370363c9f153: Status 404 returned error can't find the container with id 1eb75f0ff569ba0194441c883e114ce44be587312348ae0ab74f370363c9f153 May 27 20:18:17.775223 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:17.775181 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k" event={"ID":"3160a231-ca2b-416f-a595-c8164eb9c746","Type":"ContainerStarted","Data":"1eb75f0ff569ba0194441c883e114ce44be587312348ae0ab74f370363c9f153"} May 27 20:18:23.780386 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:23.780347 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-z646l"] May 27 20:18:23.782991 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:23.782976 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-z646l" May 27 20:18:23.786119 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:23.786096 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-msdw5\"" May 27 20:18:23.801288 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:23.801253 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k" event={"ID":"3160a231-ca2b-416f-a595-c8164eb9c746","Type":"ContainerStarted","Data":"89c36732c64155b6fb79e39dd353a3245d0719d7dd456222ed71bf679ed790fc"} May 27 20:18:23.801424 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:23.801316 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k" May 27 20:18:23.805313 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:23.805285 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-z646l"] May 27 20:18:23.882380 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:23.882327 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k" podStartSLOduration=1.82391726 podStartE2EDuration="7.882311212s" podCreationTimestamp="2026-05-27 20:18:16 +0000 UTC" firstStartedPulling="2026-05-27 20:18:17.337350513 +0000 UTC m=+406.865419138" lastFinishedPulling="2026-05-27 20:18:23.395744465 +0000 UTC m=+412.923813090" observedRunningTime="2026-05-27 20:18:23.866511657 +0000 UTC m=+413.394580299" watchObservedRunningTime="2026-05-27 20:18:23.882311212 +0000 UTC m=+413.410379854" May 27 20:18:23.945254 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:23.945208 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrddx\" (UniqueName: \"kubernetes.io/projected/2b59dfc2-ebd3-4a71-9452-549594f33326-kube-api-access-jrddx\") pod \"limitador-operator-controller-manager-85c4996f8c-z646l\" (UID: \"2b59dfc2-ebd3-4a71-9452-549594f33326\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-z646l" May 27 20:18:24.046097 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:24.046000 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jrddx\" (UniqueName: \"kubernetes.io/projected/2b59dfc2-ebd3-4a71-9452-549594f33326-kube-api-access-jrddx\") pod \"limitador-operator-controller-manager-85c4996f8c-z646l\" (UID: \"2b59dfc2-ebd3-4a71-9452-549594f33326\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-z646l" May 27 20:18:24.057479 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:24.057448 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrddx\" (UniqueName: \"kubernetes.io/projected/2b59dfc2-ebd3-4a71-9452-549594f33326-kube-api-access-jrddx\") pod \"limitador-operator-controller-manager-85c4996f8c-z646l\" (UID: \"2b59dfc2-ebd3-4a71-9452-549594f33326\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-z646l" May 27 20:18:24.093132 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:24.093094 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-z646l" May 27 20:18:24.233913 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:24.233886 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-z646l"] May 27 20:18:24.235252 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:18:24.235215 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b59dfc2_ebd3_4a71_9452_549594f33326.slice/crio-46e14a690c52e3e4c9f65833380c0f3b23e573de81f6d24e3766388fccd5d9a6 WatchSource:0}: Error finding container 46e14a690c52e3e4c9f65833380c0f3b23e573de81f6d24e3766388fccd5d9a6: Status 404 returned error can't find the container with id 46e14a690c52e3e4c9f65833380c0f3b23e573de81f6d24e3766388fccd5d9a6 May 27 20:18:24.806821 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:24.806789 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-z646l" event={"ID":"2b59dfc2-ebd3-4a71-9452-549594f33326","Type":"ContainerStarted","Data":"46e14a690c52e3e4c9f65833380c0f3b23e573de81f6d24e3766388fccd5d9a6"} May 27 20:18:25.768368 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:25.768335 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-fnv7v" May 27 20:18:26.818007 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:26.817925 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-z646l" event={"ID":"2b59dfc2-ebd3-4a71-9452-549594f33326","Type":"ContainerStarted","Data":"d1c00263f9e57e1a39c3de9f3d5695e94df2cb5f3a6818d518fa91ef0b792ce0"} May 27 20:18:26.818351 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:26.818070 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-z646l" May 27 20:18:26.839009 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:26.838957 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-z646l" podStartSLOduration=1.507076845 podStartE2EDuration="3.838943073s" podCreationTimestamp="2026-05-27 20:18:23 +0000 UTC" firstStartedPulling="2026-05-27 20:18:24.237104235 +0000 UTC m=+413.765172855" lastFinishedPulling="2026-05-27 20:18:26.568970459 +0000 UTC m=+416.097039083" observedRunningTime="2026-05-27 20:18:26.837130186 +0000 UTC m=+416.365198829" watchObservedRunningTime="2026-05-27 20:18:26.838943073 +0000 UTC m=+416.367011714" May 27 20:18:33.661962 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:33.661931 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b8546cb84-p5mvd"] May 27 20:18:34.809216 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:34.809189 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k" May 27 20:18:36.692531 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.692493 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k"] May 27 20:18:36.692923 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.692750 2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k" podUID="3160a231-ca2b-416f-a595-c8164eb9c746" containerName="manager" containerID="cri-o://89c36732c64155b6fb79e39dd353a3245d0719d7dd456222ed71bf679ed790fc" gracePeriod=2 May 27 20:18:36.709252 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.707085 2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k"] May 27 20:18:36.722834 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.722806 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-shn6m"] May 27 20:18:36.723215 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.723200 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3160a231-ca2b-416f-a595-c8164eb9c746" containerName="manager" May 27 20:18:36.723215 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.723214 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3160a231-ca2b-416f-a595-c8164eb9c746" containerName="manager" May 27 20:18:36.723405 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.723279 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="3160a231-ca2b-416f-a595-c8164eb9c746" containerName="manager" May 27 20:18:36.725319 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.725295 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-shn6m" May 27 20:18:36.740148 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.740125 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-shn6m"] May 27 20:18:36.745288 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.745267 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-z646l"] May 27 20:18:36.745530 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.745492 2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-z646l" podUID="2b59dfc2-ebd3-4a71-9452-549594f33326" containerName="manager" containerID="cri-o://d1c00263f9e57e1a39c3de9f3d5695e94df2cb5f3a6818d518fa91ef0b792ce0" gracePeriod=2 May 27 20:18:36.747472 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.747449 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-z646l" May 27 20:18:36.753189 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.752981 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a03ae067-29d8-433c-bcff-78ffe00a0536-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-shn6m\" (UID: \"a03ae067-29d8-433c-bcff-78ffe00a0536\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-shn6m" May 27 20:18:36.753189 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.753070 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbd4b\" (UniqueName: \"kubernetes.io/projected/a03ae067-29d8-433c-bcff-78ffe00a0536-kube-api-access-cbd4b\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-shn6m\" (UID: \"a03ae067-29d8-433c-bcff-78ffe00a0536\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-shn6m" May 27 20:18:36.755905 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.755882 2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-z646l"] May 27 20:18:36.766291 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.766254 2554 status_manager.go:895] "Failed to get status for pod" podUID="3160a231-ca2b-416f-a595-c8164eb9c746" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-2qp7k\" is forbidden: User \"system:node:ip-10-0-135-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-103.ec2.internal' and this object" May 27 20:18:36.768515 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.768483 2554 status_manager.go:895] "Failed to get status for pod" podUID="3160a231-ca2b-416f-a595-c8164eb9c746" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-2qp7k\" is forbidden: User \"system:node:ip-10-0-135-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-103.ec2.internal' and this object" May 27 20:18:36.770704 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.770607 2554 status_manager.go:895] "Failed to get status for pod" podUID="2b59dfc2-ebd3-4a71-9452-549594f33326" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-z646l" err="pods \"limitador-operator-controller-manager-85c4996f8c-z646l\" is forbidden: User \"system:node:ip-10-0-135-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-103.ec2.internal' and this object" May 27 20:18:36.773789 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.773769 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v99r4"] May 27 20:18:36.774123 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.774112 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b59dfc2-ebd3-4a71-9452-549594f33326" containerName="manager" May 27 20:18:36.774165 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.774135 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b59dfc2-ebd3-4a71-9452-549594f33326" containerName="manager" May 27 20:18:36.774199 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.774190 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="2b59dfc2-ebd3-4a71-9452-549594f33326" containerName="manager" May 27 20:18:36.776269 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.776255 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v99r4" May 27 20:18:36.786921 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.786901 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v99r4"] May 27 20:18:36.803986 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.803962 2554 status_manager.go:895] "Failed to get status for pod" podUID="3160a231-ca2b-416f-a595-c8164eb9c746" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-2qp7k\" is forbidden: User \"system:node:ip-10-0-135-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-103.ec2.internal' and this object" May 27 20:18:36.805758 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.805735 2554 status_manager.go:895] "Failed to get status for pod" podUID="2b59dfc2-ebd3-4a71-9452-549594f33326" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-z646l" err="pods \"limitador-operator-controller-manager-85c4996f8c-z646l\" is forbidden: User \"system:node:ip-10-0-135-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-103.ec2.internal' and this object" May 27 20:18:36.853994 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.853974 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cbd4b\" (UniqueName: \"kubernetes.io/projected/a03ae067-29d8-433c-bcff-78ffe00a0536-kube-api-access-cbd4b\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-shn6m\" (UID: \"a03ae067-29d8-433c-bcff-78ffe00a0536\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-shn6m" May 27 20:18:36.854084 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.854063 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a03ae067-29d8-433c-bcff-78ffe00a0536-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-shn6m\" (UID: \"a03ae067-29d8-433c-bcff-78ffe00a0536\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-shn6m" May 27 20:18:36.854207 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.854191 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6prq\" (UniqueName: \"kubernetes.io/projected/f0287acf-1579-496d-b546-0b9c8592a8fa-kube-api-access-p6prq\") pod \"limitador-operator-controller-manager-85c4996f8c-v99r4\" (UID: \"f0287acf-1579-496d-b546-0b9c8592a8fa\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v99r4" May 27 20:18:36.854435 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.854411 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a03ae067-29d8-433c-bcff-78ffe00a0536-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-shn6m\" (UID: \"a03ae067-29d8-433c-bcff-78ffe00a0536\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-shn6m" May 27 20:18:36.858910 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.858889 2554 generic.go:358] "Generic (PLEG): container finished" podID="3160a231-ca2b-416f-a595-c8164eb9c746" containerID="89c36732c64155b6fb79e39dd353a3245d0719d7dd456222ed71bf679ed790fc" exitCode=0 May 27 20:18:36.862283 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.862262 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbd4b\" (UniqueName: \"kubernetes.io/projected/a03ae067-29d8-433c-bcff-78ffe00a0536-kube-api-access-cbd4b\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-shn6m\" (UID: \"a03ae067-29d8-433c-bcff-78ffe00a0536\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-shn6m" May 27 20:18:36.955545 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.955477 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6prq\" (UniqueName: \"kubernetes.io/projected/f0287acf-1579-496d-b546-0b9c8592a8fa-kube-api-access-p6prq\") pod \"limitador-operator-controller-manager-85c4996f8c-v99r4\" (UID: \"f0287acf-1579-496d-b546-0b9c8592a8fa\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v99r4" May 27 20:18:36.964533 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.964514 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6prq\" (UniqueName: \"kubernetes.io/projected/f0287acf-1579-496d-b546-0b9c8592a8fa-kube-api-access-p6prq\") pod \"limitador-operator-controller-manager-85c4996f8c-v99r4\" (UID: \"f0287acf-1579-496d-b546-0b9c8592a8fa\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v99r4" May 27 20:18:36.981329 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.981311 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k" May 27 20:18:36.983485 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.983452 2554 status_manager.go:895] "Failed to get status for pod" podUID="2b59dfc2-ebd3-4a71-9452-549594f33326" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-z646l" err="pods \"limitador-operator-controller-manager-85c4996f8c-z646l\" is forbidden: User \"system:node:ip-10-0-135-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-103.ec2.internal' and this object" May 27 20:18:36.984425 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.984404 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-z646l" May 27 20:18:36.985433 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.985412 2554 status_manager.go:895] "Failed to get status for pod" podUID="3160a231-ca2b-416f-a595-c8164eb9c746" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-2qp7k\" is forbidden: User \"system:node:ip-10-0-135-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-103.ec2.internal' and this object" May 27 20:18:36.987610 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.987594 2554 status_manager.go:895] "Failed to get status for pod" podUID="3160a231-ca2b-416f-a595-c8164eb9c746" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-2qp7k\" is forbidden: User \"system:node:ip-10-0-135-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-103.ec2.internal' and this object" May 27 20:18:36.989301 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:36.989281 2554 status_manager.go:895] "Failed to get status for pod" podUID="2b59dfc2-ebd3-4a71-9452-549594f33326" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-z646l" err="pods \"limitador-operator-controller-manager-85c4996f8c-z646l\" is forbidden: User \"system:node:ip-10-0-135-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-103.ec2.internal' and this object" May 27 20:18:37.056584 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.056556 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8z4lx\" (UniqueName: \"kubernetes.io/projected/3160a231-ca2b-416f-a595-c8164eb9c746-kube-api-access-8z4lx\") pod \"3160a231-ca2b-416f-a595-c8164eb9c746\" (UID: \"3160a231-ca2b-416f-a595-c8164eb9c746\") " May 27 20:18:37.056740 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.056601 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3160a231-ca2b-416f-a595-c8164eb9c746-extensions-socket-volume\") pod \"3160a231-ca2b-416f-a595-c8164eb9c746\" (UID: \"3160a231-ca2b-416f-a595-c8164eb9c746\") " May 27 20:18:37.056740 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.056638 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrddx\" (UniqueName: \"kubernetes.io/projected/2b59dfc2-ebd3-4a71-9452-549594f33326-kube-api-access-jrddx\") pod \"2b59dfc2-ebd3-4a71-9452-549594f33326\" (UID: \"2b59dfc2-ebd3-4a71-9452-549594f33326\") " May 27 20:18:37.057014 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.056991 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3160a231-ca2b-416f-a595-c8164eb9c746-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3160a231-ca2b-416f-a595-c8164eb9c746" (UID: "3160a231-ca2b-416f-a595-c8164eb9c746"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 20:18:37.058507 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.058487 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3160a231-ca2b-416f-a595-c8164eb9c746-kube-api-access-8z4lx" (OuterVolumeSpecName: "kube-api-access-8z4lx") pod "3160a231-ca2b-416f-a595-c8164eb9c746" (UID: "3160a231-ca2b-416f-a595-c8164eb9c746"). InnerVolumeSpecName "kube-api-access-8z4lx". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:18:37.058581 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.058568 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b59dfc2-ebd3-4a71-9452-549594f33326-kube-api-access-jrddx" (OuterVolumeSpecName: "kube-api-access-jrddx") pod "2b59dfc2-ebd3-4a71-9452-549594f33326" (UID: "2b59dfc2-ebd3-4a71-9452-549594f33326"). InnerVolumeSpecName "kube-api-access-jrddx". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:18:37.127414 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.127379 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-shn6m" May 27 20:18:37.133082 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.133061 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v99r4" May 27 20:18:37.158023 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.157991 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8z4lx\" (UniqueName: \"kubernetes.io/projected/3160a231-ca2b-416f-a595-c8164eb9c746-kube-api-access-8z4lx\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:18:37.158023 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.158024 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3160a231-ca2b-416f-a595-c8164eb9c746-extensions-socket-volume\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:18:37.158192 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.158042 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrddx\" (UniqueName: \"kubernetes.io/projected/2b59dfc2-ebd3-4a71-9452-549594f33326-kube-api-access-jrddx\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:18:37.268165 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.268133 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-shn6m"] May 27 20:18:37.269445 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:18:37.269420 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda03ae067_29d8_433c_bcff_78ffe00a0536.slice/crio-f06ffb203b696791e3d7b221d7c75e224253d4b9cbcdc0dfbf1ec205bc112eb3 WatchSource:0}: Error finding container f06ffb203b696791e3d7b221d7c75e224253d4b9cbcdc0dfbf1ec205bc112eb3: Status 404 returned error can't find the container with id f06ffb203b696791e3d7b221d7c75e224253d4b9cbcdc0dfbf1ec205bc112eb3 May 27 20:18:37.287162 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.287141 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v99r4"] May 27 20:18:37.288009 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:18:37.287985 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0287acf_1579_496d_b546_0b9c8592a8fa.slice/crio-3a462853ab0376ac939a1dd9e74a0264405c33dddc2fc7343f0151732a7548ce WatchSource:0}: Error finding container 3a462853ab0376ac939a1dd9e74a0264405c33dddc2fc7343f0151732a7548ce: Status 404 returned error can't find the container with id 3a462853ab0376ac939a1dd9e74a0264405c33dddc2fc7343f0151732a7548ce May 27 20:18:37.864878 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.864840 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-shn6m" event={"ID":"a03ae067-29d8-433c-bcff-78ffe00a0536","Type":"ContainerStarted","Data":"3b0c236770b3f3695e719a14fc42463e29d163a8e32c70e42db1c06b40dbcc73"} May 27 20:18:37.864878 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.864882 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-shn6m" event={"ID":"a03ae067-29d8-433c-bcff-78ffe00a0536","Type":"ContainerStarted","Data":"f06ffb203b696791e3d7b221d7c75e224253d4b9cbcdc0dfbf1ec205bc112eb3"} May 27 20:18:37.865306 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.864915 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-shn6m" May 27 20:18:37.866072 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.866049 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2qp7k" May 27 20:18:37.866188 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.866059 2554 scope.go:117] "RemoveContainer" containerID="89c36732c64155b6fb79e39dd353a3245d0719d7dd456222ed71bf679ed790fc" May 27 20:18:37.867549 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.867520 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v99r4" event={"ID":"f0287acf-1579-496d-b546-0b9c8592a8fa","Type":"ContainerStarted","Data":"be91766c59c2df1af882a1197df340a5c6394beb45e90c34fbdb4faabdc798aa"} May 27 20:18:37.867690 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.867552 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v99r4" event={"ID":"f0287acf-1579-496d-b546-0b9c8592a8fa","Type":"ContainerStarted","Data":"3a462853ab0376ac939a1dd9e74a0264405c33dddc2fc7343f0151732a7548ce"} May 27 20:18:37.867690 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.867641 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v99r4" May 27 20:18:37.868813 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.868789 2554 generic.go:358] "Generic (PLEG): container finished" podID="2b59dfc2-ebd3-4a71-9452-549594f33326" containerID="d1c00263f9e57e1a39c3de9f3d5695e94df2cb5f3a6818d518fa91ef0b792ce0" exitCode=0 May 27 20:18:37.868909 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.868836 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-z646l" May 27 20:18:37.875555 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.875533 2554 scope.go:117] "RemoveContainer" containerID="d1c00263f9e57e1a39c3de9f3d5695e94df2cb5f3a6818d518fa91ef0b792ce0" May 27 20:18:37.883723 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.883705 2554 scope.go:117] "RemoveContainer" containerID="d1c00263f9e57e1a39c3de9f3d5695e94df2cb5f3a6818d518fa91ef0b792ce0" May 27 20:18:37.884086 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:18:37.884025 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1c00263f9e57e1a39c3de9f3d5695e94df2cb5f3a6818d518fa91ef0b792ce0\": container with ID starting with d1c00263f9e57e1a39c3de9f3d5695e94df2cb5f3a6818d518fa91ef0b792ce0 not found: ID does not exist" containerID="d1c00263f9e57e1a39c3de9f3d5695e94df2cb5f3a6818d518fa91ef0b792ce0" May 27 20:18:37.884086 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.884060 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1c00263f9e57e1a39c3de9f3d5695e94df2cb5f3a6818d518fa91ef0b792ce0"} err="failed to get container status \"d1c00263f9e57e1a39c3de9f3d5695e94df2cb5f3a6818d518fa91ef0b792ce0\": rpc error: code = NotFound desc = could not find container \"d1c00263f9e57e1a39c3de9f3d5695e94df2cb5f3a6818d518fa91ef0b792ce0\": container with ID starting with d1c00263f9e57e1a39c3de9f3d5695e94df2cb5f3a6818d518fa91ef0b792ce0 not found: ID does not exist" May 27 20:18:37.884488 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.884446 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-shn6m" podStartSLOduration=1.8844080600000002 podStartE2EDuration="1.88440806s" podCreationTimestamp="2026-05-27 20:18:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:18:37.882360877 +0000 UTC m=+427.410429518" watchObservedRunningTime="2026-05-27 20:18:37.88440806 +0000 UTC m=+427.412476702" May 27 20:18:37.907866 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:37.907827 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v99r4" podStartSLOduration=1.907815705 podStartE2EDuration="1.907815705s" podCreationTimestamp="2026-05-27 20:18:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:18:37.904717095 +0000 UTC m=+427.432785739" watchObservedRunningTime="2026-05-27 20:18:37.907815705 +0000 UTC m=+427.435884347" May 27 20:18:39.055412 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:39.055378 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b59dfc2-ebd3-4a71-9452-549594f33326" path="/var/lib/kubelet/pods/2b59dfc2-ebd3-4a71-9452-549594f33326/volumes" May 27 20:18:39.055796 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:39.055747 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3160a231-ca2b-416f-a595-c8164eb9c746" path="/var/lib/kubelet/pods/3160a231-ca2b-416f-a595-c8164eb9c746/volumes" May 27 20:18:48.878068 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:48.877992 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-v99r4" May 27 20:18:48.878068 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:48.878049 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-shn6m" May 27 20:18:54.717904 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:54.717870 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-shn6m"] May 27 20:18:54.718278 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:54.718092 2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-shn6m" podUID="a03ae067-29d8-433c-bcff-78ffe00a0536" containerName="manager" containerID="cri-o://3b0c236770b3f3695e719a14fc42463e29d163a8e32c70e42db1c06b40dbcc73" gracePeriod=10 May 27 20:18:54.942200 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:54.942174 2554 generic.go:358] "Generic (PLEG): container finished" podID="a03ae067-29d8-433c-bcff-78ffe00a0536" containerID="3b0c236770b3f3695e719a14fc42463e29d163a8e32c70e42db1c06b40dbcc73" exitCode=0 May 27 20:18:54.942302 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:54.942251 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-shn6m" event={"ID":"a03ae067-29d8-433c-bcff-78ffe00a0536","Type":"ContainerDied","Data":"3b0c236770b3f3695e719a14fc42463e29d163a8e32c70e42db1c06b40dbcc73"} May 27 20:18:54.971887 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:54.971815 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sttjf"] May 27 20:18:54.974158 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:54.974136 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sttjf" May 27 20:18:54.988244 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:54.988083 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sttjf"] May 27 20:18:55.064878 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:55.064859 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-shn6m" May 27 20:18:55.110348 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:55.110314 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlmnm\" (UniqueName: \"kubernetes.io/projected/87c642c0-a50a-4a06-87d1-e438d130bf15-kube-api-access-dlmnm\") pod \"kuadrant-operator-controller-manager-55c7f4c975-sttjf\" (UID: \"87c642c0-a50a-4a06-87d1-e438d130bf15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sttjf" May 27 20:18:55.110476 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:55.110371 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87c642c0-a50a-4a06-87d1-e438d130bf15-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-sttjf\" (UID: \"87c642c0-a50a-4a06-87d1-e438d130bf15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sttjf" May 27 20:18:55.210900 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:55.210872 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbd4b\" (UniqueName: \"kubernetes.io/projected/a03ae067-29d8-433c-bcff-78ffe00a0536-kube-api-access-cbd4b\") pod \"a03ae067-29d8-433c-bcff-78ffe00a0536\" (UID: \"a03ae067-29d8-433c-bcff-78ffe00a0536\") " May 27 20:18:55.211024 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:55.210911 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a03ae067-29d8-433c-bcff-78ffe00a0536-extensions-socket-volume\") pod \"a03ae067-29d8-433c-bcff-78ffe00a0536\" (UID: \"a03ae067-29d8-433c-bcff-78ffe00a0536\") " May 27 20:18:55.211088 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:55.211072 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlmnm\" (UniqueName: \"kubernetes.io/projected/87c642c0-a50a-4a06-87d1-e438d130bf15-kube-api-access-dlmnm\") pod \"kuadrant-operator-controller-manager-55c7f4c975-sttjf\" (UID: \"87c642c0-a50a-4a06-87d1-e438d130bf15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sttjf" May 27 20:18:55.211122 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:55.211111 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87c642c0-a50a-4a06-87d1-e438d130bf15-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-sttjf\" (UID: \"87c642c0-a50a-4a06-87d1-e438d130bf15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sttjf" May 27 20:18:55.211305 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:55.211282 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a03ae067-29d8-433c-bcff-78ffe00a0536-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a03ae067-29d8-433c-bcff-78ffe00a0536" (UID: "a03ae067-29d8-433c-bcff-78ffe00a0536"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 20:18:55.211552 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:55.211532 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87c642c0-a50a-4a06-87d1-e438d130bf15-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-sttjf\" (UID: \"87c642c0-a50a-4a06-87d1-e438d130bf15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sttjf" May 27 20:18:55.213019 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:55.213000 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a03ae067-29d8-433c-bcff-78ffe00a0536-kube-api-access-cbd4b" (OuterVolumeSpecName: "kube-api-access-cbd4b") pod "a03ae067-29d8-433c-bcff-78ffe00a0536" (UID: "a03ae067-29d8-433c-bcff-78ffe00a0536"). InnerVolumeSpecName "kube-api-access-cbd4b". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:18:55.227704 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:55.227653 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlmnm\" (UniqueName: \"kubernetes.io/projected/87c642c0-a50a-4a06-87d1-e438d130bf15-kube-api-access-dlmnm\") pod \"kuadrant-operator-controller-manager-55c7f4c975-sttjf\" (UID: \"87c642c0-a50a-4a06-87d1-e438d130bf15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sttjf" May 27 20:18:55.284485 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:55.284455 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sttjf" May 27 20:18:55.312197 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:55.312165 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbd4b\" (UniqueName: \"kubernetes.io/projected/a03ae067-29d8-433c-bcff-78ffe00a0536-kube-api-access-cbd4b\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:18:55.312299 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:55.312203 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a03ae067-29d8-433c-bcff-78ffe00a0536-extensions-socket-volume\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:18:55.415976 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:55.415941 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sttjf"] May 27 20:18:55.416919 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:18:55.416893 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87c642c0_a50a_4a06_87d1_e438d130bf15.slice/crio-2716e73de3299d6fa525a0bf448f02e511fff2d7dcf03be9cae2a1bed675b0c0 WatchSource:0}: Error finding container 2716e73de3299d6fa525a0bf448f02e511fff2d7dcf03be9cae2a1bed675b0c0: Status 404 returned error can't find the container with id 2716e73de3299d6fa525a0bf448f02e511fff2d7dcf03be9cae2a1bed675b0c0 May 27 20:18:55.947327 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:55.947294 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-shn6m" May 27 20:18:55.947327 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:55.947320 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-shn6m" event={"ID":"a03ae067-29d8-433c-bcff-78ffe00a0536","Type":"ContainerDied","Data":"f06ffb203b696791e3d7b221d7c75e224253d4b9cbcdc0dfbf1ec205bc112eb3"} May 27 20:18:55.947857 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:55.947367 2554 scope.go:117] "RemoveContainer" containerID="3b0c236770b3f3695e719a14fc42463e29d163a8e32c70e42db1c06b40dbcc73" May 27 20:18:55.948850 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:55.948822 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sttjf" event={"ID":"87c642c0-a50a-4a06-87d1-e438d130bf15","Type":"ContainerStarted","Data":"ca644be16cb9e91d34b4a4735f0e1b091bed4f9c9223f0279d61121c2be0fe59"} May 27 20:18:55.948979 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:55.948856 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sttjf" event={"ID":"87c642c0-a50a-4a06-87d1-e438d130bf15","Type":"ContainerStarted","Data":"2716e73de3299d6fa525a0bf448f02e511fff2d7dcf03be9cae2a1bed675b0c0"} May 27 20:18:55.948979 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:55.948942 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sttjf" May 27 20:18:55.971134 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:55.971086 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sttjf" podStartSLOduration=1.971072038 podStartE2EDuration="1.971072038s" podCreationTimestamp="2026-05-27 20:18:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:18:55.967913546 +0000 UTC m=+445.495982188" watchObservedRunningTime="2026-05-27 20:18:55.971072038 +0000 UTC m=+445.499140687" May 27 20:18:55.990682 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:55.990657 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-shn6m"] May 27 20:18:55.993759 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:55.993729 2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-shn6m"] May 27 20:18:57.054886 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:57.054851 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a03ae067-29d8-433c-bcff-78ffe00a0536" path="/var/lib/kubelet/pods/a03ae067-29d8-433c-bcff-78ffe00a0536/volumes" May 27 20:18:58.684725 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:58.684668 2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5b8546cb84-p5mvd" podUID="8535ffe4-4599-4d5b-9f19-4109380b5f7f" containerName="console" containerID="cri-o://b475d9afd927383f5c12732818bafd4755a4766beea3de22e452903ce1e326e0" gracePeriod=15 May 27 20:18:58.956360 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:58.956339 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b8546cb84-p5mvd_8535ffe4-4599-4d5b-9f19-4109380b5f7f/console/0.log" May 27 20:18:58.956484 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:58.956395 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:18:58.962523 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:58.962505 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b8546cb84-p5mvd_8535ffe4-4599-4d5b-9f19-4109380b5f7f/console/0.log" May 27 20:18:58.962637 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:58.962543 2554 generic.go:358] "Generic (PLEG): container finished" podID="8535ffe4-4599-4d5b-9f19-4109380b5f7f" containerID="b475d9afd927383f5c12732818bafd4755a4766beea3de22e452903ce1e326e0" exitCode=2 May 27 20:18:58.962637 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:58.962604 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8546cb84-p5mvd" May 27 20:18:58.962757 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:58.962647 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8546cb84-p5mvd" event={"ID":"8535ffe4-4599-4d5b-9f19-4109380b5f7f","Type":"ContainerDied","Data":"b475d9afd927383f5c12732818bafd4755a4766beea3de22e452903ce1e326e0"} May 27 20:18:58.962757 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:58.962689 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8546cb84-p5mvd" event={"ID":"8535ffe4-4599-4d5b-9f19-4109380b5f7f","Type":"ContainerDied","Data":"6cd5d50bbd434f49a0052a61d9437dd4b13b8f6aea878a621874cc50d3031837"} May 27 20:18:58.962757 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:58.962709 2554 scope.go:117] "RemoveContainer" containerID="b475d9afd927383f5c12732818bafd4755a4766beea3de22e452903ce1e326e0" May 27 20:18:58.970844 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:58.970823 2554 scope.go:117] "RemoveContainer" containerID="b475d9afd927383f5c12732818bafd4755a4766beea3de22e452903ce1e326e0" May 27 20:18:58.971076 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:18:58.971058 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b475d9afd927383f5c12732818bafd4755a4766beea3de22e452903ce1e326e0\": container with ID starting with b475d9afd927383f5c12732818bafd4755a4766beea3de22e452903ce1e326e0 not found: ID does not exist" containerID="b475d9afd927383f5c12732818bafd4755a4766beea3de22e452903ce1e326e0" May 27 20:18:58.971122 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:58.971084 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b475d9afd927383f5c12732818bafd4755a4766beea3de22e452903ce1e326e0"} err="failed to get container status \"b475d9afd927383f5c12732818bafd4755a4766beea3de22e452903ce1e326e0\": rpc error: code = NotFound desc = could not find container \"b475d9afd927383f5c12732818bafd4755a4766beea3de22e452903ce1e326e0\": container with ID starting with b475d9afd927383f5c12732818bafd4755a4766beea3de22e452903ce1e326e0 not found: ID does not exist" May 27 20:18:59.044581 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:59.044557 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8535ffe4-4599-4d5b-9f19-4109380b5f7f-service-ca\") pod \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " May 27 20:18:59.044738 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:59.044614 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8535ffe4-4599-4d5b-9f19-4109380b5f7f-oauth-serving-cert\") pod \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " May 27 20:18:59.044738 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:59.044659 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8535ffe4-4599-4d5b-9f19-4109380b5f7f-console-serving-cert\") pod \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " May 27 20:18:59.044864 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:59.044764 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8535ffe4-4599-4d5b-9f19-4109380b5f7f-trusted-ca-bundle\") pod \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " May 27 20:18:59.044864 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:59.044793 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8535ffe4-4599-4d5b-9f19-4109380b5f7f-console-config\") pod \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " May 27 20:18:59.044864 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:59.044843 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fvzl\" (UniqueName: \"kubernetes.io/projected/8535ffe4-4599-4d5b-9f19-4109380b5f7f-kube-api-access-9fvzl\") pod \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " May 27 20:18:59.045015 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:59.044917 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8535ffe4-4599-4d5b-9f19-4109380b5f7f-console-oauth-config\") pod \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\" (UID: \"8535ffe4-4599-4d5b-9f19-4109380b5f7f\") " May 27 20:18:59.045065 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:59.045009 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8535ffe4-4599-4d5b-9f19-4109380b5f7f-service-ca" (OuterVolumeSpecName: "service-ca") pod "8535ffe4-4599-4d5b-9f19-4109380b5f7f" (UID: "8535ffe4-4599-4d5b-9f19-4109380b5f7f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 20:18:59.045164 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:59.045136 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8535ffe4-4599-4d5b-9f19-4109380b5f7f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8535ffe4-4599-4d5b-9f19-4109380b5f7f" (UID: "8535ffe4-4599-4d5b-9f19-4109380b5f7f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 20:18:59.045238 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:59.045174 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8535ffe4-4599-4d5b-9f19-4109380b5f7f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8535ffe4-4599-4d5b-9f19-4109380b5f7f" (UID: "8535ffe4-4599-4d5b-9f19-4109380b5f7f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 20:18:59.045238 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:59.045219 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8535ffe4-4599-4d5b-9f19-4109380b5f7f-console-config" (OuterVolumeSpecName: "console-config") pod "8535ffe4-4599-4d5b-9f19-4109380b5f7f" (UID: "8535ffe4-4599-4d5b-9f19-4109380b5f7f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 20:18:59.045375 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:59.045356 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8535ffe4-4599-4d5b-9f19-4109380b5f7f-service-ca\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:18:59.045418 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:59.045383 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8535ffe4-4599-4d5b-9f19-4109380b5f7f-oauth-serving-cert\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:18:59.045418 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:59.045400 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8535ffe4-4599-4d5b-9f19-4109380b5f7f-trusted-ca-bundle\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:18:59.045418 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:59.045414 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8535ffe4-4599-4d5b-9f19-4109380b5f7f-console-config\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:18:59.046822 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:59.046796 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8535ffe4-4599-4d5b-9f19-4109380b5f7f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8535ffe4-4599-4d5b-9f19-4109380b5f7f" (UID: "8535ffe4-4599-4d5b-9f19-4109380b5f7f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 20:18:59.047101 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:59.047082 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8535ffe4-4599-4d5b-9f19-4109380b5f7f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8535ffe4-4599-4d5b-9f19-4109380b5f7f" (UID: "8535ffe4-4599-4d5b-9f19-4109380b5f7f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 20:18:59.047101 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:59.047086 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8535ffe4-4599-4d5b-9f19-4109380b5f7f-kube-api-access-9fvzl" (OuterVolumeSpecName: "kube-api-access-9fvzl") pod "8535ffe4-4599-4d5b-9f19-4109380b5f7f" (UID: "8535ffe4-4599-4d5b-9f19-4109380b5f7f"). InnerVolumeSpecName "kube-api-access-9fvzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:18:59.146730 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:59.146705 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8535ffe4-4599-4d5b-9f19-4109380b5f7f-console-oauth-config\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:18:59.146730 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:59.146727 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8535ffe4-4599-4d5b-9f19-4109380b5f7f-console-serving-cert\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:18:59.146857 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:59.146737 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fvzl\" (UniqueName: \"kubernetes.io/projected/8535ffe4-4599-4d5b-9f19-4109380b5f7f-kube-api-access-9fvzl\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:18:59.279225 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:59.279164 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b8546cb84-p5mvd"] May 27 20:18:59.282930 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:18:59.282908 2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b8546cb84-p5mvd"] May 27 20:19:01.055444 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:01.055410 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8535ffe4-4599-4d5b-9f19-4109380b5f7f" path="/var/lib/kubelet/pods/8535ffe4-4599-4d5b-9f19-4109380b5f7f/volumes" May 27 20:19:06.957019 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:06.956989 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sttjf" May 27 20:19:11.080057 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.080026 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x"] May 27 20:19:11.080601 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.080579 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a03ae067-29d8-433c-bcff-78ffe00a0536" containerName="manager" May 27 20:19:11.080601 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.080603 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a03ae067-29d8-433c-bcff-78ffe00a0536" containerName="manager" May 27 20:19:11.080871 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.080641 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8535ffe4-4599-4d5b-9f19-4109380b5f7f" containerName="console" May 27 20:19:11.080871 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.080647 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8535ffe4-4599-4d5b-9f19-4109380b5f7f" containerName="console" May 27 20:19:11.080871 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.080744 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="8535ffe4-4599-4d5b-9f19-4109380b5f7f" containerName="console" May 27 20:19:11.080871 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.080757 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="a03ae067-29d8-433c-bcff-78ffe00a0536" containerName="manager" May 27 20:19:11.084273 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.084254 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.087389 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.087369 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-llknp\"" May 27 20:19:11.103739 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.103710 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x"] May 27 20:19:11.251431 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.251391 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29619e79-7445-4db5-b1b3-40a55486baef-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.251618 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.251443 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rtzz\" (UniqueName: \"kubernetes.io/projected/29619e79-7445-4db5-b1b3-40a55486baef-kube-api-access-5rtzz\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.251618 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.251508 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29619e79-7445-4db5-b1b3-40a55486baef-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.251618 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.251581 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29619e79-7445-4db5-b1b3-40a55486baef-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.251842 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.251668 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29619e79-7445-4db5-b1b3-40a55486baef-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.251842 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.251696 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29619e79-7445-4db5-b1b3-40a55486baef-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.251842 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.251732 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29619e79-7445-4db5-b1b3-40a55486baef-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.251842 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.251763 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29619e79-7445-4db5-b1b3-40a55486baef-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.251842 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.251797 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29619e79-7445-4db5-b1b3-40a55486baef-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.352518 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.352422 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5rtzz\" (UniqueName: \"kubernetes.io/projected/29619e79-7445-4db5-b1b3-40a55486baef-kube-api-access-5rtzz\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.352518 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.352467 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29619e79-7445-4db5-b1b3-40a55486baef-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.352518 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.352498 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29619e79-7445-4db5-b1b3-40a55486baef-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.352833 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.352541 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29619e79-7445-4db5-b1b3-40a55486baef-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.352833 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.352562 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29619e79-7445-4db5-b1b3-40a55486baef-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.352833 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.352612 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29619e79-7445-4db5-b1b3-40a55486baef-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.352983 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.352868 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29619e79-7445-4db5-b1b3-40a55486baef-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.352983 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.352923 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29619e79-7445-4db5-b1b3-40a55486baef-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.353096 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.352983 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29619e79-7445-4db5-b1b3-40a55486baef-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.353096 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.353007 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29619e79-7445-4db5-b1b3-40a55486baef-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.353193 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.353104 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29619e79-7445-4db5-b1b3-40a55486baef-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.353193 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.353141 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29619e79-7445-4db5-b1b3-40a55486baef-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.353295 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.353212 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29619e79-7445-4db5-b1b3-40a55486baef-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.353549 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.353533 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29619e79-7445-4db5-b1b3-40a55486baef-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.354969 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.354951 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29619e79-7445-4db5-b1b3-40a55486baef-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.355502 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.355484 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29619e79-7445-4db5-b1b3-40a55486baef-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.370100 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.370067 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29619e79-7445-4db5-b1b3-40a55486baef-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.371617 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.371598 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rtzz\" (UniqueName: \"kubernetes.io/projected/29619e79-7445-4db5-b1b3-40a55486baef-kube-api-access-5rtzz\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2wm9x\" (UID: \"29619e79-7445-4db5-b1b3-40a55486baef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.395663 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.395604 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:11.536645 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.536605 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x"] May 27 20:19:11.538483 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:19:11.538457 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29619e79_7445_4db5_b1b3_40a55486baef.slice/crio-d41944cdcc92f6a816f45e670c5a9efe3017ce761ffb59ac2d65798a7f5032d7 WatchSource:0}: Error finding container d41944cdcc92f6a816f45e670c5a9efe3017ce761ffb59ac2d65798a7f5032d7: Status 404 returned error can't find the container with id d41944cdcc92f6a816f45e670c5a9efe3017ce761ffb59ac2d65798a7f5032d7 May 27 20:19:11.540443 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.540417 2554 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 20:19:11.540502 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.540491 2554 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 20:19:11.540570 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:11.540533 2554 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 20:19:12.015043 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:12.015006 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" event={"ID":"29619e79-7445-4db5-b1b3-40a55486baef","Type":"ContainerStarted","Data":"f080f15585efce00aeed4eea0caa6815a53cabb03b67a4908b5f6fa030aa5c33"} May 27 20:19:12.015043 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:12.015044 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" event={"ID":"29619e79-7445-4db5-b1b3-40a55486baef","Type":"ContainerStarted","Data":"d41944cdcc92f6a816f45e670c5a9efe3017ce761ffb59ac2d65798a7f5032d7"} May 27 20:19:12.036362 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:12.036308 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" podStartSLOduration=1.036289759 podStartE2EDuration="1.036289759s" podCreationTimestamp="2026-05-27 20:19:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:19:12.034718587 +0000 UTC m=+461.562787229" watchObservedRunningTime="2026-05-27 20:19:12.036289759 +0000 UTC m=+461.564358400" May 27 20:19:12.396056 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:12.395975 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:12.397683 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:12.397651 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body= May 27 20:19:12.397810 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:12.397707 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" podUID="29619e79-7445-4db5-b1b3-40a55486baef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" May 27 20:19:13.400057 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:13.400023 2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:14.023385 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:14.023352 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:14.024237 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:14.024218 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2wm9x" May 27 20:19:16.009602 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:16.009565 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-kx8vb"] May 27 20:19:16.013450 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:16.013428 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-kx8vb" May 27 20:19:16.015889 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:16.015871 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-q8wkc\"" May 27 20:19:16.021398 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:16.021369 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-kx8vb"] May 27 20:19:16.095312 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:16.095276 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmxzh\" (UniqueName: \"kubernetes.io/projected/7b054462-c7cd-474c-a346-1b8bb8a302b4-kube-api-access-qmxzh\") pod \"authorino-f99f4b5cd-kx8vb\" (UID: \"7b054462-c7cd-474c-a346-1b8bb8a302b4\") " pod="kuadrant-system/authorino-f99f4b5cd-kx8vb" May 27 20:19:16.196099 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:16.196062 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qmxzh\" (UniqueName: \"kubernetes.io/projected/7b054462-c7cd-474c-a346-1b8bb8a302b4-kube-api-access-qmxzh\") pod \"authorino-f99f4b5cd-kx8vb\" (UID: \"7b054462-c7cd-474c-a346-1b8bb8a302b4\") " pod="kuadrant-system/authorino-f99f4b5cd-kx8vb" May 27 20:19:16.206444 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:16.206409 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-g8qmr"] May 27 20:19:16.210013 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:16.209994 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-g8qmr" May 27 20:19:16.224809 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:16.224783 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-g8qmr"] May 27 20:19:16.224981 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:16.224963 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmxzh\" (UniqueName: \"kubernetes.io/projected/7b054462-c7cd-474c-a346-1b8bb8a302b4-kube-api-access-qmxzh\") pod \"authorino-f99f4b5cd-kx8vb\" (UID: \"7b054462-c7cd-474c-a346-1b8bb8a302b4\") " pod="kuadrant-system/authorino-f99f4b5cd-kx8vb" May 27 20:19:16.296924 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:16.296841 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhw4b\" (UniqueName: \"kubernetes.io/projected/ec7a2d2f-92cd-47f5-a741-118b8c00e88c-kube-api-access-qhw4b\") pod \"authorino-7498df8756-g8qmr\" (UID: \"ec7a2d2f-92cd-47f5-a741-118b8c00e88c\") " pod="kuadrant-system/authorino-7498df8756-g8qmr" May 27 20:19:16.324773 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:16.324743 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-kx8vb" May 27 20:19:16.398203 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:16.398168 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qhw4b\" (UniqueName: \"kubernetes.io/projected/ec7a2d2f-92cd-47f5-a741-118b8c00e88c-kube-api-access-qhw4b\") pod \"authorino-7498df8756-g8qmr\" (UID: \"ec7a2d2f-92cd-47f5-a741-118b8c00e88c\") " pod="kuadrant-system/authorino-7498df8756-g8qmr" May 27 20:19:16.411067 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:16.411027 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhw4b\" (UniqueName: \"kubernetes.io/projected/ec7a2d2f-92cd-47f5-a741-118b8c00e88c-kube-api-access-qhw4b\") pod \"authorino-7498df8756-g8qmr\" (UID: \"ec7a2d2f-92cd-47f5-a741-118b8c00e88c\") " pod="kuadrant-system/authorino-7498df8756-g8qmr" May 27 20:19:16.456223 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:16.456196 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-kx8vb"] May 27 20:19:16.458307 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:19:16.458280 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b054462_c7cd_474c_a346_1b8bb8a302b4.slice/crio-059a989c41f7c3b5b236f4a4af3baec03c304c374fccca06fd2889787f09ea3d WatchSource:0}: Error finding container 059a989c41f7c3b5b236f4a4af3baec03c304c374fccca06fd2889787f09ea3d: Status 404 returned error can't find the container with id 059a989c41f7c3b5b236f4a4af3baec03c304c374fccca06fd2889787f09ea3d May 27 20:19:16.519671 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:16.519635 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-g8qmr" May 27 20:19:16.649673 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:16.649655 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-g8qmr"] May 27 20:19:16.651930 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:19:16.651902 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec7a2d2f_92cd_47f5_a741_118b8c00e88c.slice/crio-f974f26934579308212dc446ffacbbc0d8d59dc6b40ff2dec6ffcacaec43db80 WatchSource:0}: Error finding container f974f26934579308212dc446ffacbbc0d8d59dc6b40ff2dec6ffcacaec43db80: Status 404 returned error can't find the container with id f974f26934579308212dc446ffacbbc0d8d59dc6b40ff2dec6ffcacaec43db80 May 27 20:19:17.039006 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:17.038969 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-g8qmr" event={"ID":"ec7a2d2f-92cd-47f5-a741-118b8c00e88c","Type":"ContainerStarted","Data":"f974f26934579308212dc446ffacbbc0d8d59dc6b40ff2dec6ffcacaec43db80"} May 27 20:19:17.040057 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:17.040028 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-kx8vb" event={"ID":"7b054462-c7cd-474c-a346-1b8bb8a302b4","Type":"ContainerStarted","Data":"059a989c41f7c3b5b236f4a4af3baec03c304c374fccca06fd2889787f09ea3d"} May 27 20:19:21.061117 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:21.061082 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-kx8vb" event={"ID":"7b054462-c7cd-474c-a346-1b8bb8a302b4","Type":"ContainerStarted","Data":"bcbcca4116619ac2bf2c4e5484477fa65ba5c5fa369df161391ad615d5f83203"} May 27 20:19:21.062294 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:21.062271 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-g8qmr" event={"ID":"ec7a2d2f-92cd-47f5-a741-118b8c00e88c","Type":"ContainerStarted","Data":"3e446da6153138a4fadabe69a185e33c0576a25bd2f5eda2c5b83b0707546f06"} May 27 20:19:21.094932 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:21.094886 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-g8qmr" podStartSLOduration=1.399506724 podStartE2EDuration="5.094872828s" podCreationTimestamp="2026-05-27 20:19:16 +0000 UTC" firstStartedPulling="2026-05-27 20:19:16.653136334 +0000 UTC m=+466.181204958" lastFinishedPulling="2026-05-27 20:19:20.348502441 +0000 UTC m=+469.876571062" observedRunningTime="2026-05-27 20:19:21.093385018 +0000 UTC m=+470.621453661" watchObservedRunningTime="2026-05-27 20:19:21.094872828 +0000 UTC m=+470.622941468" May 27 20:19:21.108190 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:21.108143 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-kx8vb" podStartSLOduration=2.231433262 podStartE2EDuration="6.108130301s" podCreationTimestamp="2026-05-27 20:19:15 +0000 UTC" firstStartedPulling="2026-05-27 20:19:16.459987639 +0000 UTC m=+465.988056258" lastFinishedPulling="2026-05-27 20:19:20.33668466 +0000 UTC m=+469.864753297" observedRunningTime="2026-05-27 20:19:21.106470152 +0000 UTC m=+470.634538803" watchObservedRunningTime="2026-05-27 20:19:21.108130301 +0000 UTC m=+470.636198942" May 27 20:19:21.136097 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:21.136068 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-kx8vb"] May 27 20:19:23.070173 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:23.070113 2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-kx8vb" podUID="7b054462-c7cd-474c-a346-1b8bb8a302b4" containerName="authorino" containerID="cri-o://bcbcca4116619ac2bf2c4e5484477fa65ba5c5fa369df161391ad615d5f83203" gracePeriod=30 May 27 20:19:23.300252 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:23.300231 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-kx8vb" May 27 20:19:23.364789 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:23.364717 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmxzh\" (UniqueName: \"kubernetes.io/projected/7b054462-c7cd-474c-a346-1b8bb8a302b4-kube-api-access-qmxzh\") pod \"7b054462-c7cd-474c-a346-1b8bb8a302b4\" (UID: \"7b054462-c7cd-474c-a346-1b8bb8a302b4\") " May 27 20:19:23.366666 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:23.366644 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b054462-c7cd-474c-a346-1b8bb8a302b4-kube-api-access-qmxzh" (OuterVolumeSpecName: "kube-api-access-qmxzh") pod "7b054462-c7cd-474c-a346-1b8bb8a302b4" (UID: "7b054462-c7cd-474c-a346-1b8bb8a302b4"). InnerVolumeSpecName "kube-api-access-qmxzh". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:19:23.465433 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:23.465405 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmxzh\" (UniqueName: \"kubernetes.io/projected/7b054462-c7cd-474c-a346-1b8bb8a302b4-kube-api-access-qmxzh\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:19:24.075333 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:24.075296 2554 generic.go:358] "Generic (PLEG): container finished" podID="7b054462-c7cd-474c-a346-1b8bb8a302b4" containerID="bcbcca4116619ac2bf2c4e5484477fa65ba5c5fa369df161391ad615d5f83203" exitCode=0 May 27 20:19:24.075333 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:24.075332 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-kx8vb" May 27 20:19:24.075821 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:24.075378 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-kx8vb" event={"ID":"7b054462-c7cd-474c-a346-1b8bb8a302b4","Type":"ContainerDied","Data":"bcbcca4116619ac2bf2c4e5484477fa65ba5c5fa369df161391ad615d5f83203"} May 27 20:19:24.075821 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:24.075408 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-kx8vb" event={"ID":"7b054462-c7cd-474c-a346-1b8bb8a302b4","Type":"ContainerDied","Data":"059a989c41f7c3b5b236f4a4af3baec03c304c374fccca06fd2889787f09ea3d"} May 27 20:19:24.075821 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:24.075427 2554 scope.go:117] "RemoveContainer" containerID="bcbcca4116619ac2bf2c4e5484477fa65ba5c5fa369df161391ad615d5f83203" May 27 20:19:24.084932 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:24.084914 2554 scope.go:117] "RemoveContainer" containerID="bcbcca4116619ac2bf2c4e5484477fa65ba5c5fa369df161391ad615d5f83203" May 27 20:19:24.085175 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:19:24.085155 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcbcca4116619ac2bf2c4e5484477fa65ba5c5fa369df161391ad615d5f83203\": container with ID starting with bcbcca4116619ac2bf2c4e5484477fa65ba5c5fa369df161391ad615d5f83203 not found: ID does not exist" containerID="bcbcca4116619ac2bf2c4e5484477fa65ba5c5fa369df161391ad615d5f83203" May 27 20:19:24.085222 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:24.085182 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcbcca4116619ac2bf2c4e5484477fa65ba5c5fa369df161391ad615d5f83203"} err="failed to get container status \"bcbcca4116619ac2bf2c4e5484477fa65ba5c5fa369df161391ad615d5f83203\": rpc error: code = NotFound desc = could not find container \"bcbcca4116619ac2bf2c4e5484477fa65ba5c5fa369df161391ad615d5f83203\": container with ID starting with bcbcca4116619ac2bf2c4e5484477fa65ba5c5fa369df161391ad615d5f83203 not found: ID does not exist" May 27 20:19:24.096529 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:24.096504 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-kx8vb"] May 27 20:19:24.100169 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:24.100148 2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-kx8vb"] May 27 20:19:25.056197 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:25.056157 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b054462-c7cd-474c-a346-1b8bb8a302b4" path="/var/lib/kubelet/pods/7b054462-c7cd-474c-a346-1b8bb8a302b4/volumes" May 27 20:19:49.450011 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.449961 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8vh2w"] May 27 20:19:49.450539 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.450519 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b054462-c7cd-474c-a346-1b8bb8a302b4" containerName="authorino" May 27 20:19:49.450614 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.450542 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b054462-c7cd-474c-a346-1b8bb8a302b4" containerName="authorino" May 27 20:19:49.450721 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.450678 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b054462-c7cd-474c-a346-1b8bb8a302b4" containerName="authorino" May 27 20:19:49.453871 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.453849 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-8vh2w" May 27 20:19:49.460336 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.460311 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8vh2w"] May 27 20:19:49.581998 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.581965 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5j2f\" (UniqueName: \"kubernetes.io/projected/4c12b1ff-bb9b-4cb6-a57e-79f6d4b6f2cc-kube-api-access-n5j2f\") pod \"authorino-8b475cf9f-8vh2w\" (UID: \"4c12b1ff-bb9b-4cb6-a57e-79f6d4b6f2cc\") " pod="kuadrant-system/authorino-8b475cf9f-8vh2w" May 27 20:19:49.641473 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.641436 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8vh2w"] May 27 20:19:49.641714 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:19:49.641695 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-n5j2f], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-8vh2w" podUID="4c12b1ff-bb9b-4cb6-a57e-79f6d4b6f2cc" May 27 20:19:49.669420 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.669392 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56fdd757f5-w744q"] May 27 20:19:49.674576 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.674546 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-w744q" May 27 20:19:49.680395 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.680369 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 27 20:19:49.681974 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.681949 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-w744q"] May 27 20:19:49.682530 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.682508 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n5j2f\" (UniqueName: \"kubernetes.io/projected/4c12b1ff-bb9b-4cb6-a57e-79f6d4b6f2cc-kube-api-access-n5j2f\") pod \"authorino-8b475cf9f-8vh2w\" (UID: \"4c12b1ff-bb9b-4cb6-a57e-79f6d4b6f2cc\") " pod="kuadrant-system/authorino-8b475cf9f-8vh2w" May 27 20:19:49.692735 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.692587 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5j2f\" (UniqueName: \"kubernetes.io/projected/4c12b1ff-bb9b-4cb6-a57e-79f6d4b6f2cc-kube-api-access-n5j2f\") pod \"authorino-8b475cf9f-8vh2w\" (UID: \"4c12b1ff-bb9b-4cb6-a57e-79f6d4b6f2cc\") " pod="kuadrant-system/authorino-8b475cf9f-8vh2w" May 27 20:19:49.773489 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.773421 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-w744q"] May 27 20:19:49.773688 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:19:49.773667 2554 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-sxnkm tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-56fdd757f5-w744q" podUID="67f8c6bf-5073-41fc-a5a5-62cda7c467fc" May 27 20:19:49.783389 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.783359 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxnkm\" (UniqueName: \"kubernetes.io/projected/67f8c6bf-5073-41fc-a5a5-62cda7c467fc-kube-api-access-sxnkm\") pod \"authorino-56fdd757f5-w744q\" (UID: \"67f8c6bf-5073-41fc-a5a5-62cda7c467fc\") " pod="kuadrant-system/authorino-56fdd757f5-w744q" May 27 20:19:49.783510 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.783401 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/67f8c6bf-5073-41fc-a5a5-62cda7c467fc-tls-cert\") pod \"authorino-56fdd757f5-w744q\" (UID: \"67f8c6bf-5073-41fc-a5a5-62cda7c467fc\") " pod="kuadrant-system/authorino-56fdd757f5-w744q" May 27 20:19:49.822124 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.822089 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c46d65797-gddlm"] May 27 20:19:49.824385 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.824366 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c46d65797-gddlm" May 27 20:19:49.827636 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.827593 2554 status_manager.go:895] "Failed to get status for pod" podUID="26e71b3a-27a8-44f6-93e4-aaf7e57c1307" pod="kuadrant-system/authorino-7c46d65797-gddlm" err="pods \"authorino-7c46d65797-gddlm\" is forbidden: User \"system:node:ip-10-0-135-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-103.ec2.internal' and this object" May 27 20:19:49.839372 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.839344 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c46d65797-gddlm"] May 27 20:19:49.884478 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.884447 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxnkm\" (UniqueName: \"kubernetes.io/projected/67f8c6bf-5073-41fc-a5a5-62cda7c467fc-kube-api-access-sxnkm\") pod \"authorino-56fdd757f5-w744q\" (UID: \"67f8c6bf-5073-41fc-a5a5-62cda7c467fc\") " pod="kuadrant-system/authorino-56fdd757f5-w744q" May 27 20:19:49.884596 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.884492 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/67f8c6bf-5073-41fc-a5a5-62cda7c467fc-tls-cert\") pod \"authorino-56fdd757f5-w744q\" (UID: \"67f8c6bf-5073-41fc-a5a5-62cda7c467fc\") " pod="kuadrant-system/authorino-56fdd757f5-w744q" May 27 20:19:49.887035 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.887013 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/67f8c6bf-5073-41fc-a5a5-62cda7c467fc-tls-cert\") pod \"authorino-56fdd757f5-w744q\" (UID: \"67f8c6bf-5073-41fc-a5a5-62cda7c467fc\") " pod="kuadrant-system/authorino-56fdd757f5-w744q" May 27 20:19:49.892341 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.892319 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxnkm\" (UniqueName: \"kubernetes.io/projected/67f8c6bf-5073-41fc-a5a5-62cda7c467fc-kube-api-access-sxnkm\") pod \"authorino-56fdd757f5-w744q\" (UID: \"67f8c6bf-5073-41fc-a5a5-62cda7c467fc\") " pod="kuadrant-system/authorino-56fdd757f5-w744q" May 27 20:19:49.985090 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.985048 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/26e71b3a-27a8-44f6-93e4-aaf7e57c1307-tls-cert\") pod \"authorino-7c46d65797-gddlm\" (UID: \"26e71b3a-27a8-44f6-93e4-aaf7e57c1307\") " pod="kuadrant-system/authorino-7c46d65797-gddlm" May 27 20:19:49.985233 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:49.985119 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dln5d\" (UniqueName: \"kubernetes.io/projected/26e71b3a-27a8-44f6-93e4-aaf7e57c1307-kube-api-access-dln5d\") pod \"authorino-7c46d65797-gddlm\" (UID: \"26e71b3a-27a8-44f6-93e4-aaf7e57c1307\") " pod="kuadrant-system/authorino-7c46d65797-gddlm" May 27 20:19:50.086290 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:50.086180 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dln5d\" (UniqueName: \"kubernetes.io/projected/26e71b3a-27a8-44f6-93e4-aaf7e57c1307-kube-api-access-dln5d\") pod \"authorino-7c46d65797-gddlm\" (UID: \"26e71b3a-27a8-44f6-93e4-aaf7e57c1307\") " pod="kuadrant-system/authorino-7c46d65797-gddlm" May 27 20:19:50.086290 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:50.086294 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/26e71b3a-27a8-44f6-93e4-aaf7e57c1307-tls-cert\") pod \"authorino-7c46d65797-gddlm\" (UID: \"26e71b3a-27a8-44f6-93e4-aaf7e57c1307\") " pod="kuadrant-system/authorino-7c46d65797-gddlm" May 27 20:19:50.088615 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:50.088595 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/26e71b3a-27a8-44f6-93e4-aaf7e57c1307-tls-cert\") pod \"authorino-7c46d65797-gddlm\" (UID: \"26e71b3a-27a8-44f6-93e4-aaf7e57c1307\") " pod="kuadrant-system/authorino-7c46d65797-gddlm" May 27 20:19:50.096076 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:50.096054 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dln5d\" (UniqueName: \"kubernetes.io/projected/26e71b3a-27a8-44f6-93e4-aaf7e57c1307-kube-api-access-dln5d\") pod \"authorino-7c46d65797-gddlm\" (UID: \"26e71b3a-27a8-44f6-93e4-aaf7e57c1307\") " pod="kuadrant-system/authorino-7c46d65797-gddlm" May 27 20:19:50.133515 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:50.133477 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c46d65797-gddlm" May 27 20:19:50.177346 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:50.177319 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-w744q" May 27 20:19:50.177523 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:50.177324 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-8vh2w" May 27 20:19:50.184033 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:50.184004 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-w744q" May 27 20:19:50.189146 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:50.189119 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-8vh2w" May 27 20:19:50.272583 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:50.272553 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c46d65797-gddlm"] May 27 20:19:50.273709 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:19:50.273683 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26e71b3a_27a8_44f6_93e4_aaf7e57c1307.slice/crio-a26c7fb18414a0d04469156fc2e446990b72fc6971da5a4e70a3b994163a6813 WatchSource:0}: Error finding container a26c7fb18414a0d04469156fc2e446990b72fc6971da5a4e70a3b994163a6813: Status 404 returned error can't find the container with id a26c7fb18414a0d04469156fc2e446990b72fc6971da5a4e70a3b994163a6813 May 27 20:19:50.288104 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:50.288083 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5j2f\" (UniqueName: \"kubernetes.io/projected/4c12b1ff-bb9b-4cb6-a57e-79f6d4b6f2cc-kube-api-access-n5j2f\") pod \"4c12b1ff-bb9b-4cb6-a57e-79f6d4b6f2cc\" (UID: \"4c12b1ff-bb9b-4cb6-a57e-79f6d4b6f2cc\") " May 27 20:19:50.288192 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:50.288110 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxnkm\" (UniqueName: \"kubernetes.io/projected/67f8c6bf-5073-41fc-a5a5-62cda7c467fc-kube-api-access-sxnkm\") pod \"67f8c6bf-5073-41fc-a5a5-62cda7c467fc\" (UID: \"67f8c6bf-5073-41fc-a5a5-62cda7c467fc\") " May 27 20:19:50.288192 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:50.288130 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/67f8c6bf-5073-41fc-a5a5-62cda7c467fc-tls-cert\") pod \"67f8c6bf-5073-41fc-a5a5-62cda7c467fc\" (UID: \"67f8c6bf-5073-41fc-a5a5-62cda7c467fc\") " May 27 20:19:50.290243 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:50.290217 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67f8c6bf-5073-41fc-a5a5-62cda7c467fc-kube-api-access-sxnkm" (OuterVolumeSpecName: "kube-api-access-sxnkm") pod "67f8c6bf-5073-41fc-a5a5-62cda7c467fc" (UID: "67f8c6bf-5073-41fc-a5a5-62cda7c467fc"). InnerVolumeSpecName "kube-api-access-sxnkm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:19:50.290343 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:50.290274 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c12b1ff-bb9b-4cb6-a57e-79f6d4b6f2cc-kube-api-access-n5j2f" (OuterVolumeSpecName: "kube-api-access-n5j2f") pod "4c12b1ff-bb9b-4cb6-a57e-79f6d4b6f2cc" (UID: "4c12b1ff-bb9b-4cb6-a57e-79f6d4b6f2cc"). InnerVolumeSpecName "kube-api-access-n5j2f". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:19:50.290343 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:50.290281 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67f8c6bf-5073-41fc-a5a5-62cda7c467fc-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "67f8c6bf-5073-41fc-a5a5-62cda7c467fc" (UID: "67f8c6bf-5073-41fc-a5a5-62cda7c467fc"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 20:19:50.389838 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:50.389747 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5j2f\" (UniqueName: \"kubernetes.io/projected/4c12b1ff-bb9b-4cb6-a57e-79f6d4b6f2cc-kube-api-access-n5j2f\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:19:50.389838 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:50.389787 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxnkm\" (UniqueName: \"kubernetes.io/projected/67f8c6bf-5073-41fc-a5a5-62cda7c467fc-kube-api-access-sxnkm\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:19:50.389838 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:50.389799 2554 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/67f8c6bf-5073-41fc-a5a5-62cda7c467fc-tls-cert\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:19:51.182420 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:51.182388 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-8vh2w" May 27 20:19:51.182896 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:51.182423 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c46d65797-gddlm" event={"ID":"26e71b3a-27a8-44f6-93e4-aaf7e57c1307","Type":"ContainerStarted","Data":"536a0beefa1f7fbaed615a564af54e429e34b4b409be0200d7bbe2e1edc134d2"} May 27 20:19:51.182896 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:51.182456 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c46d65797-gddlm" event={"ID":"26e71b3a-27a8-44f6-93e4-aaf7e57c1307","Type":"ContainerStarted","Data":"a26c7fb18414a0d04469156fc2e446990b72fc6971da5a4e70a3b994163a6813"} May 27 20:19:51.182896 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:51.182588 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-w744q" May 27 20:19:51.204747 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:51.204703 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7c46d65797-gddlm" podStartSLOduration=1.924072673 podStartE2EDuration="2.204688994s" podCreationTimestamp="2026-05-27 20:19:49 +0000 UTC" firstStartedPulling="2026-05-27 20:19:50.274976579 +0000 UTC m=+499.803045200" lastFinishedPulling="2026-05-27 20:19:50.555592897 +0000 UTC m=+500.083661521" observedRunningTime="2026-05-27 20:19:51.20433927 +0000 UTC m=+500.732407916" watchObservedRunningTime="2026-05-27 20:19:51.204688994 +0000 UTC m=+500.732757637" May 27 20:19:51.234525 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:51.234497 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-w744q"] May 27 20:19:51.249981 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:51.249951 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-g8qmr"] May 27 20:19:51.250217 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:51.250176 2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-g8qmr" podUID="ec7a2d2f-92cd-47f5-a741-118b8c00e88c" containerName="authorino" containerID="cri-o://3e446da6153138a4fadabe69a185e33c0576a25bd2f5eda2c5b83b0707546f06" gracePeriod=30 May 27 20:19:51.252356 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:51.252334 2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-w744q"] May 27 20:19:51.274690 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:51.274607 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8vh2w"] May 27 20:19:51.280355 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:51.280330 2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8vh2w"] May 27 20:19:51.502134 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:51.502113 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-g8qmr" May 27 20:19:51.601394 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:51.601359 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhw4b\" (UniqueName: \"kubernetes.io/projected/ec7a2d2f-92cd-47f5-a741-118b8c00e88c-kube-api-access-qhw4b\") pod \"ec7a2d2f-92cd-47f5-a741-118b8c00e88c\" (UID: \"ec7a2d2f-92cd-47f5-a741-118b8c00e88c\") " May 27 20:19:51.603708 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:51.603685 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec7a2d2f-92cd-47f5-a741-118b8c00e88c-kube-api-access-qhw4b" (OuterVolumeSpecName: "kube-api-access-qhw4b") pod "ec7a2d2f-92cd-47f5-a741-118b8c00e88c" (UID: "ec7a2d2f-92cd-47f5-a741-118b8c00e88c"). InnerVolumeSpecName "kube-api-access-qhw4b". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:19:51.702260 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:51.702232 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhw4b\" (UniqueName: \"kubernetes.io/projected/ec7a2d2f-92cd-47f5-a741-118b8c00e88c-kube-api-access-qhw4b\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:19:52.187439 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:52.187407 2554 generic.go:358] "Generic (PLEG): container finished" podID="ec7a2d2f-92cd-47f5-a741-118b8c00e88c" containerID="3e446da6153138a4fadabe69a185e33c0576a25bd2f5eda2c5b83b0707546f06" exitCode=0 May 27 20:19:52.187885 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:52.187455 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-g8qmr" May 27 20:19:52.187885 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:52.187495 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-g8qmr" event={"ID":"ec7a2d2f-92cd-47f5-a741-118b8c00e88c","Type":"ContainerDied","Data":"3e446da6153138a4fadabe69a185e33c0576a25bd2f5eda2c5b83b0707546f06"} May 27 20:19:52.187885 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:52.187536 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-g8qmr" event={"ID":"ec7a2d2f-92cd-47f5-a741-118b8c00e88c","Type":"ContainerDied","Data":"f974f26934579308212dc446ffacbbc0d8d59dc6b40ff2dec6ffcacaec43db80"} May 27 20:19:52.187885 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:52.187553 2554 scope.go:117] "RemoveContainer" containerID="3e446da6153138a4fadabe69a185e33c0576a25bd2f5eda2c5b83b0707546f06" May 27 20:19:52.196502 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:52.196482 2554 scope.go:117] "RemoveContainer" containerID="3e446da6153138a4fadabe69a185e33c0576a25bd2f5eda2c5b83b0707546f06" May 27 20:19:52.196791 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:19:52.196767 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e446da6153138a4fadabe69a185e33c0576a25bd2f5eda2c5b83b0707546f06\": container with ID starting with 3e446da6153138a4fadabe69a185e33c0576a25bd2f5eda2c5b83b0707546f06 not found: ID does not exist" containerID="3e446da6153138a4fadabe69a185e33c0576a25bd2f5eda2c5b83b0707546f06" May 27 20:19:52.196887 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:52.196800 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e446da6153138a4fadabe69a185e33c0576a25bd2f5eda2c5b83b0707546f06"} err="failed to get container status \"3e446da6153138a4fadabe69a185e33c0576a25bd2f5eda2c5b83b0707546f06\": rpc error: code = NotFound desc = could not find container \"3e446da6153138a4fadabe69a185e33c0576a25bd2f5eda2c5b83b0707546f06\": container with ID starting with 3e446da6153138a4fadabe69a185e33c0576a25bd2f5eda2c5b83b0707546f06 not found: ID does not exist" May 27 20:19:52.209674 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:52.209646 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-g8qmr"] May 27 20:19:52.213360 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:52.213338 2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-g8qmr"] May 27 20:19:53.056102 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:53.056067 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c12b1ff-bb9b-4cb6-a57e-79f6d4b6f2cc" path="/var/lib/kubelet/pods/4c12b1ff-bb9b-4cb6-a57e-79f6d4b6f2cc/volumes" May 27 20:19:53.056416 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:53.056398 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67f8c6bf-5073-41fc-a5a5-62cda7c467fc" path="/var/lib/kubelet/pods/67f8c6bf-5073-41fc-a5a5-62cda7c467fc/volumes" May 27 20:19:53.056692 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:19:53.056675 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec7a2d2f-92cd-47f5-a741-118b8c00e88c" path="/var/lib/kubelet/pods/ec7a2d2f-92cd-47f5-a741-118b8c00e88c/volumes" May 27 20:21:07.032079 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.032038 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l"] May 27 20:21:07.032676 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.032421 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec7a2d2f-92cd-47f5-a741-118b8c00e88c" containerName="authorino" May 27 20:21:07.032676 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.032432 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec7a2d2f-92cd-47f5-a741-118b8c00e88c" containerName="authorino" May 27 20:21:07.032676 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.032500 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="ec7a2d2f-92cd-47f5-a741-118b8c00e88c" containerName="authorino" May 27 20:21:07.035777 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.035748 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" May 27 20:21:07.038054 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.038031 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 27 20:21:07.039046 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.039026 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 27 20:21:07.039149 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.039067 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wg78k\"" May 27 20:21:07.039149 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.039106 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 27 20:21:07.045908 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.045882 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l"] May 27 20:21:07.082683 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.082656 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d733104f-6580-4646-b8a4-b4b6dc5b69d0-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l\" (UID: \"d733104f-6580-4646-b8a4-b4b6dc5b69d0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" May 27 20:21:07.082683 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.082692 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcjvb\" (UniqueName: \"kubernetes.io/projected/d733104f-6580-4646-b8a4-b4b6dc5b69d0-kube-api-access-bcjvb\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l\" (UID: \"d733104f-6580-4646-b8a4-b4b6dc5b69d0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" May 27 20:21:07.082861 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.082775 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d733104f-6580-4646-b8a4-b4b6dc5b69d0-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l\" (UID: \"d733104f-6580-4646-b8a4-b4b6dc5b69d0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" May 27 20:21:07.082861 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.082804 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d733104f-6580-4646-b8a4-b4b6dc5b69d0-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l\" (UID: \"d733104f-6580-4646-b8a4-b4b6dc5b69d0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" May 27 20:21:07.082861 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.082849 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d733104f-6580-4646-b8a4-b4b6dc5b69d0-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l\" (UID: \"d733104f-6580-4646-b8a4-b4b6dc5b69d0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" May 27 20:21:07.083003 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.082877 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d733104f-6580-4646-b8a4-b4b6dc5b69d0-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l\" (UID: \"d733104f-6580-4646-b8a4-b4b6dc5b69d0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" May 27 20:21:07.184258 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.184223 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d733104f-6580-4646-b8a4-b4b6dc5b69d0-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l\" (UID: \"d733104f-6580-4646-b8a4-b4b6dc5b69d0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" May 27 20:21:07.184413 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.184263 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bcjvb\" (UniqueName: \"kubernetes.io/projected/d733104f-6580-4646-b8a4-b4b6dc5b69d0-kube-api-access-bcjvb\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l\" (UID: \"d733104f-6580-4646-b8a4-b4b6dc5b69d0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" May 27 20:21:07.184413 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.184323 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d733104f-6580-4646-b8a4-b4b6dc5b69d0-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l\" (UID: \"d733104f-6580-4646-b8a4-b4b6dc5b69d0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" May 27 20:21:07.184413 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.184339 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d733104f-6580-4646-b8a4-b4b6dc5b69d0-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l\" (UID: \"d733104f-6580-4646-b8a4-b4b6dc5b69d0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" May 27 20:21:07.184413 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.184376 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d733104f-6580-4646-b8a4-b4b6dc5b69d0-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l\" (UID: \"d733104f-6580-4646-b8a4-b4b6dc5b69d0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" May 27 20:21:07.184670 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.184549 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d733104f-6580-4646-b8a4-b4b6dc5b69d0-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l\" (UID: \"d733104f-6580-4646-b8a4-b4b6dc5b69d0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" May 27 20:21:07.184726 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.184665 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d733104f-6580-4646-b8a4-b4b6dc5b69d0-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l\" (UID: \"d733104f-6580-4646-b8a4-b4b6dc5b69d0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" May 27 20:21:07.184726 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.184710 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d733104f-6580-4646-b8a4-b4b6dc5b69d0-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l\" (UID: \"d733104f-6580-4646-b8a4-b4b6dc5b69d0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" May 27 20:21:07.184811 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.184743 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d733104f-6580-4646-b8a4-b4b6dc5b69d0-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l\" (UID: \"d733104f-6580-4646-b8a4-b4b6dc5b69d0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" May 27 20:21:07.186582 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.186557 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d733104f-6580-4646-b8a4-b4b6dc5b69d0-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l\" (UID: \"d733104f-6580-4646-b8a4-b4b6dc5b69d0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" May 27 20:21:07.186875 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.186859 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d733104f-6580-4646-b8a4-b4b6dc5b69d0-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l\" (UID: \"d733104f-6580-4646-b8a4-b4b6dc5b69d0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" May 27 20:21:07.193102 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.193085 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcjvb\" (UniqueName: \"kubernetes.io/projected/d733104f-6580-4646-b8a4-b4b6dc5b69d0-kube-api-access-bcjvb\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l\" (UID: \"d733104f-6580-4646-b8a4-b4b6dc5b69d0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" May 27 20:21:07.348144 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.348046 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" May 27 20:21:07.489320 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.489284 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l"] May 27 20:21:07.490349 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:21:07.490318 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd733104f_6580_4646_b8a4_b4b6dc5b69d0.slice/crio-5b49be89c3f2d76feb1d7bb8aa70b59d82be7a1ea024e2bf018de6b1da840669 WatchSource:0}: Error finding container 5b49be89c3f2d76feb1d7bb8aa70b59d82be7a1ea024e2bf018de6b1da840669: Status 404 returned error can't find the container with id 5b49be89c3f2d76feb1d7bb8aa70b59d82be7a1ea024e2bf018de6b1da840669 May 27 20:21:07.497581 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:07.497548 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" event={"ID":"d733104f-6580-4646-b8a4-b4b6dc5b69d0","Type":"ContainerStarted","Data":"5b49be89c3f2d76feb1d7bb8aa70b59d82be7a1ea024e2bf018de6b1da840669"} May 27 20:21:13.527904 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:13.527869 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" event={"ID":"d733104f-6580-4646-b8a4-b4b6dc5b69d0","Type":"ContainerStarted","Data":"623b67be8bffa13249a6835547e1e0f3b9fd3052e41e1be58c71d33598823489"} May 27 20:21:18.551725 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:18.551688 2554 generic.go:358] "Generic (PLEG): container finished" podID="d733104f-6580-4646-b8a4-b4b6dc5b69d0" containerID="623b67be8bffa13249a6835547e1e0f3b9fd3052e41e1be58c71d33598823489" exitCode=0 May 27 20:21:18.552057 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:18.551761 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" event={"ID":"d733104f-6580-4646-b8a4-b4b6dc5b69d0","Type":"ContainerDied","Data":"623b67be8bffa13249a6835547e1e0f3b9fd3052e41e1be58c71d33598823489"} May 27 20:21:20.565517 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:20.565482 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" event={"ID":"d733104f-6580-4646-b8a4-b4b6dc5b69d0","Type":"ContainerStarted","Data":"3ee82c2370388f8d8b696f8397c31fd1db144688fbed66f2f0ff806505970186"} May 27 20:21:20.565910 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:20.565698 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" May 27 20:21:20.584425 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:20.584376 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" podStartSLOduration=0.903953066 podStartE2EDuration="13.584363863s" podCreationTimestamp="2026-05-27 20:21:07 +0000 UTC" firstStartedPulling="2026-05-27 20:21:07.49247801 +0000 UTC m=+577.020546829" lastFinishedPulling="2026-05-27 20:21:20.172888992 +0000 UTC m=+589.700957626" observedRunningTime="2026-05-27 20:21:20.582224629 +0000 UTC m=+590.110293272" watchObservedRunningTime="2026-05-27 20:21:20.584363863 +0000 UTC m=+590.112432503" May 27 20:21:21.721606 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:21.721570 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5"] May 27 20:21:21.724186 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:21.724167 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" May 27 20:21:21.726500 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:21.726476 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 27 20:21:21.737304 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:21.737277 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5"] May 27 20:21:21.830142 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:21.830099 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb42d3d0-c9b9-46d7-a794-9f68c1970de7-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5\" (UID: \"bb42d3d0-c9b9-46d7-a794-9f68c1970de7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" May 27 20:21:21.830328 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:21.830213 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb42d3d0-c9b9-46d7-a794-9f68c1970de7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5\" (UID: \"bb42d3d0-c9b9-46d7-a794-9f68c1970de7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" May 27 20:21:21.830328 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:21.830261 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb42d3d0-c9b9-46d7-a794-9f68c1970de7-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5\" (UID: \"bb42d3d0-c9b9-46d7-a794-9f68c1970de7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" May 27 20:21:21.830328 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:21.830279 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb42d3d0-c9b9-46d7-a794-9f68c1970de7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5\" (UID: \"bb42d3d0-c9b9-46d7-a794-9f68c1970de7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" May 27 20:21:21.830328 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:21.830298 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bb42d3d0-c9b9-46d7-a794-9f68c1970de7-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5\" (UID: \"bb42d3d0-c9b9-46d7-a794-9f68c1970de7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" May 27 20:21:21.830498 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:21.830378 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6wg4\" (UniqueName: \"kubernetes.io/projected/bb42d3d0-c9b9-46d7-a794-9f68c1970de7-kube-api-access-j6wg4\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5\" (UID: \"bb42d3d0-c9b9-46d7-a794-9f68c1970de7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" May 27 20:21:21.931285 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:21.931247 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bb42d3d0-c9b9-46d7-a794-9f68c1970de7-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5\" (UID: \"bb42d3d0-c9b9-46d7-a794-9f68c1970de7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" May 27 20:21:21.931512 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:21.931307 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j6wg4\" (UniqueName: \"kubernetes.io/projected/bb42d3d0-c9b9-46d7-a794-9f68c1970de7-kube-api-access-j6wg4\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5\" (UID: \"bb42d3d0-c9b9-46d7-a794-9f68c1970de7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" May 27 20:21:21.931512 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:21.931344 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb42d3d0-c9b9-46d7-a794-9f68c1970de7-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5\" (UID: \"bb42d3d0-c9b9-46d7-a794-9f68c1970de7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" May 27 20:21:21.931512 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:21.931389 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb42d3d0-c9b9-46d7-a794-9f68c1970de7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5\" (UID: \"bb42d3d0-c9b9-46d7-a794-9f68c1970de7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" May 27 20:21:21.931512 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:21.931467 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb42d3d0-c9b9-46d7-a794-9f68c1970de7-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5\" (UID: \"bb42d3d0-c9b9-46d7-a794-9f68c1970de7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" May 27 20:21:21.931512 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:21.931507 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb42d3d0-c9b9-46d7-a794-9f68c1970de7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5\" (UID: \"bb42d3d0-c9b9-46d7-a794-9f68c1970de7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" May 27 20:21:21.931871 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:21.931758 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bb42d3d0-c9b9-46d7-a794-9f68c1970de7-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5\" (UID: \"bb42d3d0-c9b9-46d7-a794-9f68c1970de7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" May 27 20:21:21.931871 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:21.931793 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb42d3d0-c9b9-46d7-a794-9f68c1970de7-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5\" (UID: \"bb42d3d0-c9b9-46d7-a794-9f68c1970de7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" May 27 20:21:21.931871 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:21.931852 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb42d3d0-c9b9-46d7-a794-9f68c1970de7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5\" (UID: \"bb42d3d0-c9b9-46d7-a794-9f68c1970de7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" May 27 20:21:21.933677 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:21.933658 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb42d3d0-c9b9-46d7-a794-9f68c1970de7-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5\" (UID: \"bb42d3d0-c9b9-46d7-a794-9f68c1970de7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" May 27 20:21:21.933873 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:21.933857 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb42d3d0-c9b9-46d7-a794-9f68c1970de7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5\" (UID: \"bb42d3d0-c9b9-46d7-a794-9f68c1970de7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" May 27 20:21:21.938849 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:21.938825 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6wg4\" (UniqueName: \"kubernetes.io/projected/bb42d3d0-c9b9-46d7-a794-9f68c1970de7-kube-api-access-j6wg4\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5\" (UID: \"bb42d3d0-c9b9-46d7-a794-9f68c1970de7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" May 27 20:21:22.034600 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:22.034518 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" May 27 20:21:22.172520 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:22.172491 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5"] May 27 20:21:22.173542 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:21:22.173517 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb42d3d0_c9b9_46d7_a794_9f68c1970de7.slice/crio-5c41ac33d13ba7ec2d8a9ceb3b9bd58631647acfcca22dd7eaf367db8aac402e WatchSource:0}: Error finding container 5c41ac33d13ba7ec2d8a9ceb3b9bd58631647acfcca22dd7eaf367db8aac402e: Status 404 returned error can't find the container with id 5c41ac33d13ba7ec2d8a9ceb3b9bd58631647acfcca22dd7eaf367db8aac402e May 27 20:21:22.575099 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:22.575064 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" event={"ID":"bb42d3d0-c9b9-46d7-a794-9f68c1970de7","Type":"ContainerStarted","Data":"84b6d9d7b29712be51c8336643d93ccd61867fcc8069edcb708b5e5000ffe6b8"} May 27 20:21:22.575099 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:22.575103 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" event={"ID":"bb42d3d0-c9b9-46d7-a794-9f68c1970de7","Type":"ContainerStarted","Data":"5c41ac33d13ba7ec2d8a9ceb3b9bd58631647acfcca22dd7eaf367db8aac402e"} May 27 20:21:30.993038 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:30.993008 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pb94r_bb578cb6-73de-4fe4-a720-1283d855030b/console-operator/1.log" May 27 20:21:30.993563 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:30.993382 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pb94r_bb578cb6-73de-4fe4-a720-1283d855030b/console-operator/1.log" May 27 20:21:30.996734 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:30.996705 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/ovn-acl-logging/0.log" May 27 20:21:30.997245 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:30.997224 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/ovn-acl-logging/0.log" May 27 20:21:31.582700 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:31.582604 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l" May 27 20:21:31.614193 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:31.614156 2554 generic.go:358] "Generic (PLEG): container finished" podID="bb42d3d0-c9b9-46d7-a794-9f68c1970de7" containerID="84b6d9d7b29712be51c8336643d93ccd61867fcc8069edcb708b5e5000ffe6b8" exitCode=0 May 27 20:21:31.614400 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:31.614232 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" event={"ID":"bb42d3d0-c9b9-46d7-a794-9f68c1970de7","Type":"ContainerDied","Data":"84b6d9d7b29712be51c8336643d93ccd61867fcc8069edcb708b5e5000ffe6b8"} May 27 20:21:32.620581 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:32.620544 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" event={"ID":"bb42d3d0-c9b9-46d7-a794-9f68c1970de7","Type":"ContainerStarted","Data":"7270c631efaa5a77a3e5e96206be63f34588abec9579d27106cfc31a1dcb7df6"} May 27 20:21:32.620978 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:32.620808 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" May 27 20:21:32.640970 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:32.640927 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" podStartSLOduration=11.438603333 podStartE2EDuration="11.640915735s" podCreationTimestamp="2026-05-27 20:21:21 +0000 UTC" firstStartedPulling="2026-05-27 20:21:31.614889266 +0000 UTC m=+601.142957887" lastFinishedPulling="2026-05-27 20:21:31.817201656 +0000 UTC m=+601.345270289" observedRunningTime="2026-05-27 20:21:32.638158262 +0000 UTC m=+602.166226906" watchObservedRunningTime="2026-05-27 20:21:32.640915735 +0000 UTC m=+602.168984384" May 27 20:21:43.637809 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:21:43.637733 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5" May 27 20:22:07.190542 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:07.190505 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-579787dd6d-tg2h2"] May 27 20:22:07.194032 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:07.194013 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-579787dd6d-tg2h2" May 27 20:22:07.213565 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:07.213534 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-579787dd6d-tg2h2"] May 27 20:22:07.258309 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:07.258270 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2e01664-bdd2-465b-ac21-3106ac176637-tls-cert\") pod \"authorino-579787dd6d-tg2h2\" (UID: \"d2e01664-bdd2-465b-ac21-3106ac176637\") " pod="kuadrant-system/authorino-579787dd6d-tg2h2" May 27 20:22:07.258483 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:07.258416 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd4pv\" (UniqueName: \"kubernetes.io/projected/d2e01664-bdd2-465b-ac21-3106ac176637-kube-api-access-wd4pv\") pod \"authorino-579787dd6d-tg2h2\" (UID: \"d2e01664-bdd2-465b-ac21-3106ac176637\") " pod="kuadrant-system/authorino-579787dd6d-tg2h2" May 27 20:22:07.359229 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:07.359181 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wd4pv\" (UniqueName: \"kubernetes.io/projected/d2e01664-bdd2-465b-ac21-3106ac176637-kube-api-access-wd4pv\") pod \"authorino-579787dd6d-tg2h2\" (UID: \"d2e01664-bdd2-465b-ac21-3106ac176637\") " pod="kuadrant-system/authorino-579787dd6d-tg2h2" May 27 20:22:07.359505 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:07.359251 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2e01664-bdd2-465b-ac21-3106ac176637-tls-cert\") pod \"authorino-579787dd6d-tg2h2\" (UID: \"d2e01664-bdd2-465b-ac21-3106ac176637\") " pod="kuadrant-system/authorino-579787dd6d-tg2h2" May 27 20:22:07.361700 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:07.361678 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2e01664-bdd2-465b-ac21-3106ac176637-tls-cert\") pod \"authorino-579787dd6d-tg2h2\" (UID: \"d2e01664-bdd2-465b-ac21-3106ac176637\") " pod="kuadrant-system/authorino-579787dd6d-tg2h2" May 27 20:22:07.368666 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:07.368612 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd4pv\" (UniqueName: \"kubernetes.io/projected/d2e01664-bdd2-465b-ac21-3106ac176637-kube-api-access-wd4pv\") pod \"authorino-579787dd6d-tg2h2\" (UID: \"d2e01664-bdd2-465b-ac21-3106ac176637\") " pod="kuadrant-system/authorino-579787dd6d-tg2h2" May 27 20:22:07.502876 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:07.502787 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-579787dd6d-tg2h2" May 27 20:22:07.640488 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:07.640457 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-579787dd6d-tg2h2"] May 27 20:22:07.642343 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:22:07.642309 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2e01664_bdd2_465b_ac21_3106ac176637.slice/crio-e7ad85907215317b2878702dc7e00c46962aeb22bd8a24e36f29f44ea843f1d8 WatchSource:0}: Error finding container e7ad85907215317b2878702dc7e00c46962aeb22bd8a24e36f29f44ea843f1d8: Status 404 returned error can't find the container with id e7ad85907215317b2878702dc7e00c46962aeb22bd8a24e36f29f44ea843f1d8 May 27 20:22:07.644017 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:07.643999 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 20:22:07.784317 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:07.784239 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-579787dd6d-tg2h2" event={"ID":"d2e01664-bdd2-465b-ac21-3106ac176637","Type":"ContainerStarted","Data":"e7ad85907215317b2878702dc7e00c46962aeb22bd8a24e36f29f44ea843f1d8"} May 27 20:22:08.790034 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:08.789996 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-579787dd6d-tg2h2" event={"ID":"d2e01664-bdd2-465b-ac21-3106ac176637","Type":"ContainerStarted","Data":"a9eb9e677c73519131711934f0f02aa9a734d35caef961c69781f17226a753c3"} May 27 20:22:08.806081 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:08.806027 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-579787dd6d-tg2h2" podStartSLOduration=1.375693423 podStartE2EDuration="1.806009938s" podCreationTimestamp="2026-05-27 20:22:07 +0000 UTC" firstStartedPulling="2026-05-27 20:22:07.644128555 +0000 UTC m=+637.172197175" lastFinishedPulling="2026-05-27 20:22:08.074445066 +0000 UTC m=+637.602513690" observedRunningTime="2026-05-27 20:22:08.805374382 +0000 UTC m=+638.333443026" watchObservedRunningTime="2026-05-27 20:22:08.806009938 +0000 UTC m=+638.334078578" May 27 20:22:08.834584 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:08.834543 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c46d65797-gddlm"] May 27 20:22:08.834872 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:08.834829 2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7c46d65797-gddlm" podUID="26e71b3a-27a8-44f6-93e4-aaf7e57c1307" containerName="authorino" containerID="cri-o://536a0beefa1f7fbaed615a564af54e429e34b4b409be0200d7bbe2e1edc134d2" gracePeriod=30 May 27 20:22:09.079131 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:09.079108 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c46d65797-gddlm" May 27 20:22:09.172393 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:09.172361 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dln5d\" (UniqueName: \"kubernetes.io/projected/26e71b3a-27a8-44f6-93e4-aaf7e57c1307-kube-api-access-dln5d\") pod \"26e71b3a-27a8-44f6-93e4-aaf7e57c1307\" (UID: \"26e71b3a-27a8-44f6-93e4-aaf7e57c1307\") " May 27 20:22:09.172578 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:09.172418 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/26e71b3a-27a8-44f6-93e4-aaf7e57c1307-tls-cert\") pod \"26e71b3a-27a8-44f6-93e4-aaf7e57c1307\" (UID: \"26e71b3a-27a8-44f6-93e4-aaf7e57c1307\") " May 27 20:22:09.174632 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:09.174593 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26e71b3a-27a8-44f6-93e4-aaf7e57c1307-kube-api-access-dln5d" (OuterVolumeSpecName: "kube-api-access-dln5d") pod "26e71b3a-27a8-44f6-93e4-aaf7e57c1307" (UID: "26e71b3a-27a8-44f6-93e4-aaf7e57c1307"). InnerVolumeSpecName "kube-api-access-dln5d". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:22:09.183312 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:09.183288 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26e71b3a-27a8-44f6-93e4-aaf7e57c1307-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "26e71b3a-27a8-44f6-93e4-aaf7e57c1307" (UID: "26e71b3a-27a8-44f6-93e4-aaf7e57c1307"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 20:22:09.273922 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:09.273894 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dln5d\" (UniqueName: \"kubernetes.io/projected/26e71b3a-27a8-44f6-93e4-aaf7e57c1307-kube-api-access-dln5d\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:22:09.273922 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:09.273920 2554 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/26e71b3a-27a8-44f6-93e4-aaf7e57c1307-tls-cert\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:22:09.795126 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:09.795093 2554 generic.go:358] "Generic (PLEG): container finished" podID="26e71b3a-27a8-44f6-93e4-aaf7e57c1307" containerID="536a0beefa1f7fbaed615a564af54e429e34b4b409be0200d7bbe2e1edc134d2" exitCode=0 May 27 20:22:09.795544 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:09.795148 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c46d65797-gddlm" May 27 20:22:09.795544 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:09.795174 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c46d65797-gddlm" event={"ID":"26e71b3a-27a8-44f6-93e4-aaf7e57c1307","Type":"ContainerDied","Data":"536a0beefa1f7fbaed615a564af54e429e34b4b409be0200d7bbe2e1edc134d2"} May 27 20:22:09.795544 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:09.795219 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c46d65797-gddlm" event={"ID":"26e71b3a-27a8-44f6-93e4-aaf7e57c1307","Type":"ContainerDied","Data":"a26c7fb18414a0d04469156fc2e446990b72fc6971da5a4e70a3b994163a6813"} May 27 20:22:09.795544 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:09.795238 2554 scope.go:117] "RemoveContainer" containerID="536a0beefa1f7fbaed615a564af54e429e34b4b409be0200d7bbe2e1edc134d2" May 27 20:22:09.804590 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:09.804572 2554 scope.go:117] "RemoveContainer" containerID="536a0beefa1f7fbaed615a564af54e429e34b4b409be0200d7bbe2e1edc134d2" May 27 20:22:09.804850 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:22:09.804832 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"536a0beefa1f7fbaed615a564af54e429e34b4b409be0200d7bbe2e1edc134d2\": container with ID starting with 536a0beefa1f7fbaed615a564af54e429e34b4b409be0200d7bbe2e1edc134d2 not found: ID does not exist" containerID="536a0beefa1f7fbaed615a564af54e429e34b4b409be0200d7bbe2e1edc134d2" May 27 20:22:09.804916 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:09.804859 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"536a0beefa1f7fbaed615a564af54e429e34b4b409be0200d7bbe2e1edc134d2"} err="failed to get container status \"536a0beefa1f7fbaed615a564af54e429e34b4b409be0200d7bbe2e1edc134d2\": rpc error: code = NotFound desc = could not find container \"536a0beefa1f7fbaed615a564af54e429e34b4b409be0200d7bbe2e1edc134d2\": container with ID starting with 536a0beefa1f7fbaed615a564af54e429e34b4b409be0200d7bbe2e1edc134d2 not found: ID does not exist" May 27 20:22:09.818326 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:09.818300 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c46d65797-gddlm"] May 27 20:22:09.823185 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:09.823164 2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7c46d65797-gddlm"] May 27 20:22:11.055857 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:22:11.055824 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26e71b3a-27a8-44f6-93e4-aaf7e57c1307" path="/var/lib/kubelet/pods/26e71b3a-27a8-44f6-93e4-aaf7e57c1307/volumes" May 27 20:26:31.032785 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:26:31.032761 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pb94r_bb578cb6-73de-4fe4-a720-1283d855030b/console-operator/1.log" May 27 20:26:31.036072 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:26:31.036048 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pb94r_bb578cb6-73de-4fe4-a720-1283d855030b/console-operator/1.log" May 27 20:26:31.036831 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:26:31.036811 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/ovn-acl-logging/0.log" May 27 20:26:31.048493 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:26:31.048472 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/ovn-acl-logging/0.log" May 27 20:30:00.152829 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:00.149399 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29665230-bkdsz"] May 27 20:30:00.152829 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:00.150475 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26e71b3a-27a8-44f6-93e4-aaf7e57c1307" containerName="authorino" May 27 20:30:00.152829 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:00.150499 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="26e71b3a-27a8-44f6-93e4-aaf7e57c1307" containerName="authorino" May 27 20:30:00.152829 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:00.150736 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="26e71b3a-27a8-44f6-93e4-aaf7e57c1307" containerName="authorino" May 27 20:30:00.155695 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:00.154316 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665230-bkdsz" May 27 20:30:00.157812 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:00.157779 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bt7f8\"" May 27 20:30:00.174178 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:00.174150 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29665230-bkdsz"] May 27 20:30:00.196975 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:00.196946 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cn4p\" (UniqueName: \"kubernetes.io/projected/b0cb90f7-4ebc-4460-a0e0-fb7df3aa2e0b-kube-api-access-2cn4p\") pod \"maas-api-key-cleanup-29665230-bkdsz\" (UID: \"b0cb90f7-4ebc-4460-a0e0-fb7df3aa2e0b\") " pod="opendatahub/maas-api-key-cleanup-29665230-bkdsz" May 27 20:30:00.298000 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:00.297964 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cn4p\" (UniqueName: \"kubernetes.io/projected/b0cb90f7-4ebc-4460-a0e0-fb7df3aa2e0b-kube-api-access-2cn4p\") pod \"maas-api-key-cleanup-29665230-bkdsz\" (UID: \"b0cb90f7-4ebc-4460-a0e0-fb7df3aa2e0b\") " pod="opendatahub/maas-api-key-cleanup-29665230-bkdsz" May 27 20:30:00.306171 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:00.306145 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cn4p\" (UniqueName: \"kubernetes.io/projected/b0cb90f7-4ebc-4460-a0e0-fb7df3aa2e0b-kube-api-access-2cn4p\") pod \"maas-api-key-cleanup-29665230-bkdsz\" (UID: \"b0cb90f7-4ebc-4460-a0e0-fb7df3aa2e0b\") " pod="opendatahub/maas-api-key-cleanup-29665230-bkdsz" May 27 20:30:00.466128 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:00.466090 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665230-bkdsz" May 27 20:30:00.807713 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:00.807678 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29665230-bkdsz"] May 27 20:30:00.809171 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:30:00.809131 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0cb90f7_4ebc_4460_a0e0_fb7df3aa2e0b.slice/crio-34d2ca654363aa3555c0e3686061beb48d5f1b915a92955fd297c64fa9f5fcb1 WatchSource:0}: Error finding container 34d2ca654363aa3555c0e3686061beb48d5f1b915a92955fd297c64fa9f5fcb1: Status 404 returned error can't find the container with id 34d2ca654363aa3555c0e3686061beb48d5f1b915a92955fd297c64fa9f5fcb1 May 27 20:30:00.811179 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:00.811159 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 20:30:01.677313 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:01.677276 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665230-bkdsz" event={"ID":"b0cb90f7-4ebc-4460-a0e0-fb7df3aa2e0b","Type":"ContainerStarted","Data":"34d2ca654363aa3555c0e3686061beb48d5f1b915a92955fd297c64fa9f5fcb1"} May 27 20:30:04.691983 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:04.691942 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665230-bkdsz" event={"ID":"b0cb90f7-4ebc-4460-a0e0-fb7df3aa2e0b","Type":"ContainerStarted","Data":"a757d372d5459eca70bfb4c4ff7cae23c8392e3e2130c95d6e026e0a9ca48a93"} May 27 20:30:04.708884 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:04.708832 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29665230-bkdsz" podStartSLOduration=1.914236457 podStartE2EDuration="4.708814959s" podCreationTimestamp="2026-05-27 20:30:00 +0000 UTC" firstStartedPulling="2026-05-27 20:30:00.811349254 +0000 UTC m=+1110.339417879" lastFinishedPulling="2026-05-27 20:30:03.605927757 +0000 UTC m=+1113.133996381" observedRunningTime="2026-05-27 20:30:04.706111328 +0000 UTC m=+1114.234179971" watchObservedRunningTime="2026-05-27 20:30:04.708814959 +0000 UTC m=+1114.236883649" May 27 20:30:05.700416 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:05.700377 2554 generic.go:358] "Generic (PLEG): container finished" podID="b0cb90f7-4ebc-4460-a0e0-fb7df3aa2e0b" containerID="a757d372d5459eca70bfb4c4ff7cae23c8392e3e2130c95d6e026e0a9ca48a93" exitCode=0 May 27 20:30:05.700931 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:05.700461 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665230-bkdsz" event={"ID":"b0cb90f7-4ebc-4460-a0e0-fb7df3aa2e0b","Type":"ContainerDied","Data":"a757d372d5459eca70bfb4c4ff7cae23c8392e3e2130c95d6e026e0a9ca48a93"} May 27 20:30:06.844936 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:06.844905 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665230-bkdsz" May 27 20:30:06.967987 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:06.967898 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cn4p\" (UniqueName: \"kubernetes.io/projected/b0cb90f7-4ebc-4460-a0e0-fb7df3aa2e0b-kube-api-access-2cn4p\") pod \"b0cb90f7-4ebc-4460-a0e0-fb7df3aa2e0b\" (UID: \"b0cb90f7-4ebc-4460-a0e0-fb7df3aa2e0b\") " May 27 20:30:06.970104 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:06.970080 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0cb90f7-4ebc-4460-a0e0-fb7df3aa2e0b-kube-api-access-2cn4p" (OuterVolumeSpecName: "kube-api-access-2cn4p") pod "b0cb90f7-4ebc-4460-a0e0-fb7df3aa2e0b" (UID: "b0cb90f7-4ebc-4460-a0e0-fb7df3aa2e0b"). InnerVolumeSpecName "kube-api-access-2cn4p". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:30:07.068887 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:07.068860 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cn4p\" (UniqueName: \"kubernetes.io/projected/b0cb90f7-4ebc-4460-a0e0-fb7df3aa2e0b-kube-api-access-2cn4p\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:30:07.710312 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:07.710275 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665230-bkdsz" event={"ID":"b0cb90f7-4ebc-4460-a0e0-fb7df3aa2e0b","Type":"ContainerDied","Data":"34d2ca654363aa3555c0e3686061beb48d5f1b915a92955fd297c64fa9f5fcb1"} May 27 20:30:07.710312 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:07.710310 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34d2ca654363aa3555c0e3686061beb48d5f1b915a92955fd297c64fa9f5fcb1" May 27 20:30:07.710312 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:30:07.710311 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665230-bkdsz" May 27 20:31:31.083726 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:31:31.083699 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pb94r_bb578cb6-73de-4fe4-a720-1283d855030b/console-operator/1.log" May 27 20:31:31.087388 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:31:31.087362 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/ovn-acl-logging/0.log" May 27 20:31:31.089031 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:31:31.089012 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pb94r_bb578cb6-73de-4fe4-a720-1283d855030b/console-operator/1.log" May 27 20:31:31.092686 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:31:31.092667 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/ovn-acl-logging/0.log" May 27 20:33:27.092995 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:33:27.092960 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sttjf"] May 27 20:33:27.095589 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:33:27.093223 2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sttjf" podUID="87c642c0-a50a-4a06-87d1-e438d130bf15" containerName="manager" containerID="cri-o://ca644be16cb9e91d34b4a4735f0e1b091bed4f9c9223f0279d61121c2be0fe59" gracePeriod=10 May 27 20:33:27.950118 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:33:27.950093 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sttjf" May 27 20:33:28.052742 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:33:28.052652 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87c642c0-a50a-4a06-87d1-e438d130bf15-extensions-socket-volume\") pod \"87c642c0-a50a-4a06-87d1-e438d130bf15\" (UID: \"87c642c0-a50a-4a06-87d1-e438d130bf15\") " May 27 20:33:28.052742 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:33:28.052710 2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlmnm\" (UniqueName: \"kubernetes.io/projected/87c642c0-a50a-4a06-87d1-e438d130bf15-kube-api-access-dlmnm\") pod \"87c642c0-a50a-4a06-87d1-e438d130bf15\" (UID: \"87c642c0-a50a-4a06-87d1-e438d130bf15\") " May 27 20:33:28.053108 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:33:28.053076 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87c642c0-a50a-4a06-87d1-e438d130bf15-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "87c642c0-a50a-4a06-87d1-e438d130bf15" (UID: "87c642c0-a50a-4a06-87d1-e438d130bf15"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 20:33:28.054784 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:33:28.054760 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87c642c0-a50a-4a06-87d1-e438d130bf15-kube-api-access-dlmnm" (OuterVolumeSpecName: "kube-api-access-dlmnm") pod "87c642c0-a50a-4a06-87d1-e438d130bf15" (UID: "87c642c0-a50a-4a06-87d1-e438d130bf15"). InnerVolumeSpecName "kube-api-access-dlmnm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 20:33:28.154468 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:33:28.154420 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87c642c0-a50a-4a06-87d1-e438d130bf15-extensions-socket-volume\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:33:28.154468 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:33:28.154460 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlmnm\" (UniqueName: \"kubernetes.io/projected/87c642c0-a50a-4a06-87d1-e438d130bf15-kube-api-access-dlmnm\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\"" May 27 20:33:28.538122 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:33:28.538082 2554 generic.go:358] "Generic (PLEG): container finished" podID="87c642c0-a50a-4a06-87d1-e438d130bf15" containerID="ca644be16cb9e91d34b4a4735f0e1b091bed4f9c9223f0279d61121c2be0fe59" exitCode=0 May 27 20:33:28.538351 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:33:28.538155 2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sttjf" May 27 20:33:28.538351 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:33:28.538166 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sttjf" event={"ID":"87c642c0-a50a-4a06-87d1-e438d130bf15","Type":"ContainerDied","Data":"ca644be16cb9e91d34b4a4735f0e1b091bed4f9c9223f0279d61121c2be0fe59"} May 27 20:33:28.538351 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:33:28.538213 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sttjf" event={"ID":"87c642c0-a50a-4a06-87d1-e438d130bf15","Type":"ContainerDied","Data":"2716e73de3299d6fa525a0bf448f02e511fff2d7dcf03be9cae2a1bed675b0c0"} May 27 20:33:28.538351 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:33:28.538233 2554 scope.go:117] "RemoveContainer" containerID="ca644be16cb9e91d34b4a4735f0e1b091bed4f9c9223f0279d61121c2be0fe59" May 27 20:33:28.548781 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:33:28.548754 2554 scope.go:117] "RemoveContainer" containerID="ca644be16cb9e91d34b4a4735f0e1b091bed4f9c9223f0279d61121c2be0fe59" May 27 20:33:28.549105 ip-10-0-135-103 kubenswrapper[2554]: E0527 20:33:28.549084 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca644be16cb9e91d34b4a4735f0e1b091bed4f9c9223f0279d61121c2be0fe59\": container with ID starting with ca644be16cb9e91d34b4a4735f0e1b091bed4f9c9223f0279d61121c2be0fe59 not found: ID does not exist" containerID="ca644be16cb9e91d34b4a4735f0e1b091bed4f9c9223f0279d61121c2be0fe59" May 27 20:33:28.549176 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:33:28.549120 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca644be16cb9e91d34b4a4735f0e1b091bed4f9c9223f0279d61121c2be0fe59"} err="failed to get container status \"ca644be16cb9e91d34b4a4735f0e1b091bed4f9c9223f0279d61121c2be0fe59\": rpc error: code = NotFound desc = could not find container \"ca644be16cb9e91d34b4a4735f0e1b091bed4f9c9223f0279d61121c2be0fe59\": container with ID starting with ca644be16cb9e91d34b4a4735f0e1b091bed4f9c9223f0279d61121c2be0fe59 not found: ID does not exist" May 27 20:33:28.560202 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:33:28.560176 2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sttjf"] May 27 20:33:28.565095 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:33:28.565073 2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-sttjf"] May 27 20:33:29.055841 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:33:29.055810 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87c642c0-a50a-4a06-87d1-e438d130bf15" path="/var/lib/kubelet/pods/87c642c0-a50a-4a06-87d1-e438d130bf15/volumes" May 27 20:34:33.232972 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:34:33.232931 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mxcmt"] May 27 20:34:33.233473 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:34:33.233325 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87c642c0-a50a-4a06-87d1-e438d130bf15" containerName="manager" May 27 20:34:33.233473 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:34:33.233336 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="87c642c0-a50a-4a06-87d1-e438d130bf15" containerName="manager" May 27 20:34:33.233473 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:34:33.233355 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0cb90f7-4ebc-4460-a0e0-fb7df3aa2e0b" containerName="cleanup" May 27 20:34:33.233473 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:34:33.233361 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0cb90f7-4ebc-4460-a0e0-fb7df3aa2e0b" containerName="cleanup" May 27 20:34:33.233473 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:34:33.233430 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0cb90f7-4ebc-4460-a0e0-fb7df3aa2e0b" containerName="cleanup" May 27 20:34:33.233473 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:34:33.233442 2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="87c642c0-a50a-4a06-87d1-e438d130bf15" containerName="manager" May 27 20:34:33.236422 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:34:33.236406 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mxcmt" May 27 20:34:33.239525 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:34:33.239503 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hpcdj\"" May 27 20:34:33.248616 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:34:33.248580 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mxcmt"] May 27 20:34:33.361662 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:34:33.361589 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aab6c695-dfdf-4e2d-8d33-f691f462ad0e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-mxcmt\" (UID: \"aab6c695-dfdf-4e2d-8d33-f691f462ad0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mxcmt" May 27 20:34:33.361861 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:34:33.361775 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dp7g\" (UniqueName: \"kubernetes.io/projected/aab6c695-dfdf-4e2d-8d33-f691f462ad0e-kube-api-access-9dp7g\") pod \"kuadrant-operator-controller-manager-55c7f4c975-mxcmt\" (UID: \"aab6c695-dfdf-4e2d-8d33-f691f462ad0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mxcmt" May 27 20:34:33.462312 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:34:33.462268 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aab6c695-dfdf-4e2d-8d33-f691f462ad0e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-mxcmt\" (UID: \"aab6c695-dfdf-4e2d-8d33-f691f462ad0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mxcmt" May 27 20:34:33.462491 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:34:33.462362 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9dp7g\" (UniqueName: \"kubernetes.io/projected/aab6c695-dfdf-4e2d-8d33-f691f462ad0e-kube-api-access-9dp7g\") pod \"kuadrant-operator-controller-manager-55c7f4c975-mxcmt\" (UID: \"aab6c695-dfdf-4e2d-8d33-f691f462ad0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mxcmt" May 27 20:34:33.462690 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:34:33.462665 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aab6c695-dfdf-4e2d-8d33-f691f462ad0e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-mxcmt\" (UID: \"aab6c695-dfdf-4e2d-8d33-f691f462ad0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mxcmt" May 27 20:34:33.470918 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:34:33.470895 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dp7g\" (UniqueName: \"kubernetes.io/projected/aab6c695-dfdf-4e2d-8d33-f691f462ad0e-kube-api-access-9dp7g\") pod \"kuadrant-operator-controller-manager-55c7f4c975-mxcmt\" (UID: \"aab6c695-dfdf-4e2d-8d33-f691f462ad0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mxcmt" May 27 20:34:33.548330 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:34:33.548234 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mxcmt" May 27 20:34:33.695573 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:34:33.695545 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mxcmt"] May 27 20:34:33.696803 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:34:33.696777 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab6c695_dfdf_4e2d_8d33_f691f462ad0e.slice/crio-5f77f0200c0cd5b4172e43fa700f128e3aab3d60d8cf42e7dc71c46febf9b1d7 WatchSource:0}: Error finding container 5f77f0200c0cd5b4172e43fa700f128e3aab3d60d8cf42e7dc71c46febf9b1d7: Status 404 returned error can't find the container with id 5f77f0200c0cd5b4172e43fa700f128e3aab3d60d8cf42e7dc71c46febf9b1d7 May 27 20:34:33.801368 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:34:33.801292 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mxcmt" event={"ID":"aab6c695-dfdf-4e2d-8d33-f691f462ad0e","Type":"ContainerStarted","Data":"85aa9f27373080d5fb478eb280cf9e7845d39ebd28a391f8160ac90b68cef9f0"} May 27 20:34:33.801368 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:34:33.801332 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mxcmt" event={"ID":"aab6c695-dfdf-4e2d-8d33-f691f462ad0e","Type":"ContainerStarted","Data":"5f77f0200c0cd5b4172e43fa700f128e3aab3d60d8cf42e7dc71c46febf9b1d7"} May 27 20:34:33.801368 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:34:33.801357 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mxcmt" May 27 20:34:33.821008 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:34:33.820950 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mxcmt" podStartSLOduration=0.820930172 podStartE2EDuration="820.930172ms" podCreationTimestamp="2026-05-27 20:34:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:34:33.819468351 +0000 UTC m=+1383.347537008" watchObservedRunningTime="2026-05-27 20:34:33.820930172 +0000 UTC m=+1383.348998818" May 27 20:34:44.809366 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:34:44.809328 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-mxcmt" May 27 20:36:31.120403 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:36:31.120378 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pb94r_bb578cb6-73de-4fe4-a720-1283d855030b/console-operator/1.log" May 27 20:36:31.123758 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:36:31.123736 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/ovn-acl-logging/0.log" May 27 20:36:31.126982 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:36:31.126966 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pb94r_bb578cb6-73de-4fe4-a720-1283d855030b/console-operator/1.log" May 27 20:36:31.130175 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:36:31.130159 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/ovn-acl-logging/0.log" May 27 20:41:31.157242 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:41:31.157210 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pb94r_bb578cb6-73de-4fe4-a720-1283d855030b/console-operator/1.log" May 27 20:41:31.160810 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:41:31.160787 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/ovn-acl-logging/0.log" May 27 20:41:31.164177 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:41:31.164157 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pb94r_bb578cb6-73de-4fe4-a720-1283d855030b/console-operator/1.log" May 27 20:41:31.167973 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:41:31.167955 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/ovn-acl-logging/0.log" May 27 20:44:14.088133 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:14.088041 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-579787dd6d-tg2h2_d2e01664-bdd2-465b-ac21-3106ac176637/authorino/0.log" May 27 20:44:19.133839 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:19.133813 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29665230-bkdsz_b0cb90f7-4ebc-4460-a0e0-fb7df3aa2e0b/cleanup/0.log" May 27 20:44:19.650986 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:19.650954 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b59bfd74-gmffn_310feb14-5593-4e11-9109-c53086141a9c/manager/0.log" May 27 20:44:20.733819 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:20.733785 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6_548aee60-9b43-4e62-8c69-0b484fb49565/extract/0.log" May 27 20:44:20.740434 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:20.740412 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6_548aee60-9b43-4e62-8c69-0b484fb49565/util/0.log" May 27 20:44:20.749192 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:20.749167 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6_548aee60-9b43-4e62-8c69-0b484fb49565/pull/0.log" May 27 20:44:20.863151 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:20.863124 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965_40228359-87ef-46b1-b695-56d61de867e0/util/0.log" May 27 20:44:20.868921 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:20.868902 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965_40228359-87ef-46b1-b695-56d61de867e0/pull/0.log" May 27 20:44:20.874455 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:20.874435 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965_40228359-87ef-46b1-b695-56d61de867e0/extract/0.log" May 27 20:44:20.986421 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:20.986337 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr_351b763a-c7e4-4195-8ae6-c627ff9b6829/util/0.log" May 27 20:44:20.992521 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:20.992500 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr_351b763a-c7e4-4195-8ae6-c627ff9b6829/pull/0.log" May 27 20:44:20.998097 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:20.998079 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr_351b763a-c7e4-4195-8ae6-c627ff9b6829/extract/0.log" May 27 20:44:21.118550 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:21.118523 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl_6e9cf514-4242-4f48-96e9-e4838c7c0291/util/0.log" May 27 20:44:21.124654 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:21.124609 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl_6e9cf514-4242-4f48-96e9-e4838c7c0291/pull/0.log" May 27 20:44:21.130733 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:21.130715 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl_6e9cf514-4242-4f48-96e9-e4838c7c0291/extract/0.log" May 27 20:44:21.256692 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:21.256585 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-579787dd6d-tg2h2_d2e01664-bdd2-465b-ac21-3106ac176637/authorino/0.log" May 27 20:44:21.491827 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:21.491798 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-fnv7v_a164cbfa-7716-4362-9b91-9dfe09c81cb2/manager/0.log" May 27 20:44:21.724521 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:21.724489 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dln77_e596b454-527b-4ef4-b4e9-df2fe601c8a0/registry-server/0.log" May 27 20:44:21.850426 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:21.850395 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-mxcmt_aab6c695-dfdf-4e2d-8d33-f691f462ad0e/manager/0.log" May 27 20:44:22.082469 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:22.082388 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-v99r4_f0287acf-1579-496d-b546-0b9c8592a8fa/manager/0.log" May 27 20:44:22.536775 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:22.536743 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw_c7d408be-dd9e-4497-8093-b1190650e07f/istio-proxy/0.log" May 27 20:44:23.004105 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:23.004074 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-2wm9x_29619e79-7445-4db5-b1b3-40a55486baef/istio-proxy/0.log" May 27 20:44:23.241439 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:23.241414 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-696899764b-7qrxr_b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f/router/0.log" May 27 20:44:23.732238 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:23.732211 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l_d733104f-6580-4646-b8a4-b4b6dc5b69d0/storage-initializer/0.log" May 27 20:44:23.739424 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:23.739404 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-2kv6l_d733104f-6580-4646-b8a4-b4b6dc5b69d0/main/0.log" May 27 20:44:24.251293 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:24.251268 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5_bb42d3d0-c9b9-46d7-a794-9f68c1970de7/main/0.log" May 27 20:44:24.259396 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:24.259371 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-qpnt5_bb42d3d0-c9b9-46d7-a794-9f68c1970de7/storage-initializer/0.log" May 27 20:44:31.334369 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:31.334337 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9jjmw_60bae188-0649-4acd-a4dc-c6444d76cd73/global-pull-secret-syncer/0.log" May 27 20:44:31.529348 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:31.529314 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l7zcw_87ac1929-612e-48ec-94ff-0e13017fea11/konnectivity-agent/0.log" May 27 20:44:31.552350 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:31.552324 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-103.ec2.internal_06181dfa378829b92cc5ea772451a452/haproxy/0.log" May 27 20:44:35.518981 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:35.518947 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6_548aee60-9b43-4e62-8c69-0b484fb49565/extract/0.log" May 27 20:44:35.546929 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:35.546901 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6_548aee60-9b43-4e62-8c69-0b484fb49565/util/0.log" May 27 20:44:35.574796 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:35.574765 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kvl6_548aee60-9b43-4e62-8c69-0b484fb49565/pull/0.log" May 27 20:44:35.605937 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:35.605901 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965_40228359-87ef-46b1-b695-56d61de867e0/extract/0.log" May 27 20:44:35.637697 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:35.637669 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965_40228359-87ef-46b1-b695-56d61de867e0/util/0.log" May 27 20:44:35.665012 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:35.664979 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5965_40228359-87ef-46b1-b695-56d61de867e0/pull/0.log" May 27 20:44:35.697163 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:35.697132 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr_351b763a-c7e4-4195-8ae6-c627ff9b6829/extract/0.log" May 27 20:44:35.722282 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:35.722256 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr_351b763a-c7e4-4195-8ae6-c627ff9b6829/util/0.log" May 27 20:44:35.746552 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:35.746524 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lmnfr_351b763a-c7e4-4195-8ae6-c627ff9b6829/pull/0.log" May 27 20:44:35.776752 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:35.776651 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl_6e9cf514-4242-4f48-96e9-e4838c7c0291/extract/0.log" May 27 20:44:35.801228 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:35.801198 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl_6e9cf514-4242-4f48-96e9-e4838c7c0291/util/0.log" May 27 20:44:35.824777 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:35.824750 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ttbvl_6e9cf514-4242-4f48-96e9-e4838c7c0291/pull/0.log" May 27 20:44:36.012153 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:36.012117 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-579787dd6d-tg2h2_d2e01664-bdd2-465b-ac21-3106ac176637/authorino/0.log" May 27 20:44:36.073542 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:36.073460 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-fnv7v_a164cbfa-7716-4362-9b91-9dfe09c81cb2/manager/0.log" May 27 20:44:36.136018 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:36.135990 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dln77_e596b454-527b-4ef4-b4e9-df2fe601c8a0/registry-server/0.log" May 27 20:44:36.214880 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:36.214847 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-mxcmt_aab6c695-dfdf-4e2d-8d33-f691f462ad0e/manager/0.log" May 27 20:44:36.302369 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:36.302329 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-v99r4_f0287acf-1579-496d-b546-0b9c8592a8fa/manager/0.log" May 27 20:44:37.687508 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:37.687459 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dad89792-4533-4bc9-a798-540e06e1acd7/alertmanager/0.log" May 27 20:44:37.718461 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:37.718425 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dad89792-4533-4bc9-a798-540e06e1acd7/config-reloader/0.log" May 27 20:44:37.751278 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:37.751254 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dad89792-4533-4bc9-a798-540e06e1acd7/kube-rbac-proxy-web/0.log" May 27 20:44:37.776383 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:37.776359 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dad89792-4533-4bc9-a798-540e06e1acd7/kube-rbac-proxy/0.log" May 27 20:44:37.805209 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:37.805183 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dad89792-4533-4bc9-a798-540e06e1acd7/kube-rbac-proxy-metric/0.log" May 27 20:44:37.829179 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:37.829151 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dad89792-4533-4bc9-a798-540e06e1acd7/prom-label-proxy/0.log" May 27 20:44:37.854175 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:37.854122 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dad89792-4533-4bc9-a798-540e06e1acd7/init-config-reloader/0.log" May 27 20:44:37.888685 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:37.888650 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-mrhn2_1c0112d8-ba42-4e30-95fd-d8b4554622fc/cluster-monitoring-operator/0.log" May 27 20:44:37.995219 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:37.995133 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5bc8c4b5c-vbsp8_a56e4b67-e0c3-49af-ae40-143730eec714/metrics-server/0.log" May 27 20:44:38.022875 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:38.022848 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-76wd4_82539367-b967-4328-a53b-e0e71ff6ae8c/monitoring-plugin/0.log" May 27 20:44:38.053053 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:38.053030 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4cbtv_5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd/node-exporter/0.log" May 27 20:44:38.077187 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:38.077159 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4cbtv_5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd/kube-rbac-proxy/0.log" May 27 20:44:38.101819 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:38.101796 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4cbtv_5fc52c5a-bc8c-4d9d-8fe4-e33bd3e898fd/init-textfile/0.log" May 27 20:44:38.617135 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:38.617107 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5cdd44b4f8-7xgv6_47216135-f4cd-46eb-8111-a68eabc24fa9/telemeter-client/0.log" May 27 20:44:38.641057 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:38.641021 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5cdd44b4f8-7xgv6_47216135-f4cd-46eb-8111-a68eabc24fa9/reload/0.log" May 27 20:44:38.670555 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:38.670529 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5cdd44b4f8-7xgv6_47216135-f4cd-46eb-8111-a68eabc24fa9/kube-rbac-proxy/0.log" May 27 20:44:38.699031 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:38.699003 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85757fdc65-tjl7p_3d96ebcd-18f4-438b-9a1c-86718d1dd0e8/thanos-query/0.log" May 27 20:44:38.721091 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:38.721061 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85757fdc65-tjl7p_3d96ebcd-18f4-438b-9a1c-86718d1dd0e8/kube-rbac-proxy-web/0.log" May 27 20:44:38.743496 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:38.743412 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85757fdc65-tjl7p_3d96ebcd-18f4-438b-9a1c-86718d1dd0e8/kube-rbac-proxy/0.log" May 27 20:44:38.774485 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:38.774456 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85757fdc65-tjl7p_3d96ebcd-18f4-438b-9a1c-86718d1dd0e8/prom-label-proxy/0.log" May 27 20:44:38.804526 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:38.804503 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85757fdc65-tjl7p_3d96ebcd-18f4-438b-9a1c-86718d1dd0e8/kube-rbac-proxy-rules/0.log" May 27 20:44:38.829160 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:38.829134 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85757fdc65-tjl7p_3d96ebcd-18f4-438b-9a1c-86718d1dd0e8/kube-rbac-proxy-metrics/0.log" May 27 20:44:39.905757 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:39.905719 2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw"] May 27 20:44:39.911703 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:39.911681 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw" May 27 20:44:39.914352 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:39.914169 2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lv5mm\"/\"default-dockercfg-pl5xv\"" May 27 20:44:39.914606 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:39.914586 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lv5mm\"/\"kube-root-ca.crt\"" May 27 20:44:39.915021 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:39.915005 2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lv5mm\"/\"openshift-service-ca.crt\"" May 27 20:44:39.916838 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:39.916815 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw"] May 27 20:44:40.106500 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:40.106452 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a8b506a3-c045-48d2-8ca2-446a29cbca54-podres\") pod \"perf-node-gather-daemonset-j4mpw\" (UID: \"a8b506a3-c045-48d2-8ca2-446a29cbca54\") " pod="openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw" May 27 20:44:40.106500 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:40.106497 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a8b506a3-c045-48d2-8ca2-446a29cbca54-proc\") pod \"perf-node-gather-daemonset-j4mpw\" (UID: \"a8b506a3-c045-48d2-8ca2-446a29cbca54\") " pod="openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw" May 27 20:44:40.106783 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:40.106561 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8b506a3-c045-48d2-8ca2-446a29cbca54-sys\") pod \"perf-node-gather-daemonset-j4mpw\" (UID: \"a8b506a3-c045-48d2-8ca2-446a29cbca54\") " pod="openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw" May 27 20:44:40.106783 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:40.106662 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a8b506a3-c045-48d2-8ca2-446a29cbca54-lib-modules\") pod \"perf-node-gather-daemonset-j4mpw\" (UID: \"a8b506a3-c045-48d2-8ca2-446a29cbca54\") " pod="openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw" May 27 20:44:40.106783 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:40.106690 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29j9p\" (UniqueName: \"kubernetes.io/projected/a8b506a3-c045-48d2-8ca2-446a29cbca54-kube-api-access-29j9p\") pod \"perf-node-gather-daemonset-j4mpw\" (UID: \"a8b506a3-c045-48d2-8ca2-446a29cbca54\") " pod="openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw" May 27 20:44:40.208107 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:40.208074 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a8b506a3-c045-48d2-8ca2-446a29cbca54-proc\") pod \"perf-node-gather-daemonset-j4mpw\" (UID: \"a8b506a3-c045-48d2-8ca2-446a29cbca54\") " pod="openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw" May 27 20:44:40.208308 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:40.208129 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8b506a3-c045-48d2-8ca2-446a29cbca54-sys\") pod \"perf-node-gather-daemonset-j4mpw\" (UID: \"a8b506a3-c045-48d2-8ca2-446a29cbca54\") " pod="openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw" May 27 20:44:40.208308 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:40.208178 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a8b506a3-c045-48d2-8ca2-446a29cbca54-lib-modules\") pod \"perf-node-gather-daemonset-j4mpw\" (UID: \"a8b506a3-c045-48d2-8ca2-446a29cbca54\") " pod="openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw" May 27 20:44:40.208308 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:40.208211 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a8b506a3-c045-48d2-8ca2-446a29cbca54-proc\") pod \"perf-node-gather-daemonset-j4mpw\" (UID: \"a8b506a3-c045-48d2-8ca2-446a29cbca54\") " pod="openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw" May 27 20:44:40.208308 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:40.208250 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8b506a3-c045-48d2-8ca2-446a29cbca54-sys\") pod \"perf-node-gather-daemonset-j4mpw\" (UID: \"a8b506a3-c045-48d2-8ca2-446a29cbca54\") " pod="openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw" May 27 20:44:40.208308 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:40.208274 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29j9p\" (UniqueName: \"kubernetes.io/projected/a8b506a3-c045-48d2-8ca2-446a29cbca54-kube-api-access-29j9p\") pod \"perf-node-gather-daemonset-j4mpw\" (UID: \"a8b506a3-c045-48d2-8ca2-446a29cbca54\") " pod="openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw" May 27 20:44:40.208559 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:40.208314 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a8b506a3-c045-48d2-8ca2-446a29cbca54-lib-modules\") pod \"perf-node-gather-daemonset-j4mpw\" (UID: \"a8b506a3-c045-48d2-8ca2-446a29cbca54\") " pod="openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw" May 27 20:44:40.208559 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:40.208445 2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a8b506a3-c045-48d2-8ca2-446a29cbca54-podres\") pod \"perf-node-gather-daemonset-j4mpw\" (UID: \"a8b506a3-c045-48d2-8ca2-446a29cbca54\") " pod="openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw" May 27 20:44:40.208559 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:40.208551 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a8b506a3-c045-48d2-8ca2-446a29cbca54-podres\") pod \"perf-node-gather-daemonset-j4mpw\" (UID: \"a8b506a3-c045-48d2-8ca2-446a29cbca54\") " pod="openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw" May 27 20:44:40.216855 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:40.216830 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29j9p\" (UniqueName: \"kubernetes.io/projected/a8b506a3-c045-48d2-8ca2-446a29cbca54-kube-api-access-29j9p\") pod \"perf-node-gather-daemonset-j4mpw\" (UID: \"a8b506a3-c045-48d2-8ca2-446a29cbca54\") " pod="openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw" May 27 20:44:40.223570 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:40.223547 2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw" May 27 20:44:40.360661 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:40.360602 2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw"] May 27 20:44:40.362970 ip-10-0-135-103 kubenswrapper[2554]: W0527 20:44:40.362943 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda8b506a3_c045_48d2_8ca2_446a29cbca54.slice/crio-a59308522717c75fe5e5740a39b78332cc881a4b550459fb1c081a5a64444021 WatchSource:0}: Error finding container a59308522717c75fe5e5740a39b78332cc881a4b550459fb1c081a5a64444021: Status 404 returned error can't find the container with id a59308522717c75fe5e5740a39b78332cc881a4b550459fb1c081a5a64444021 May 27 20:44:40.364879 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:40.364863 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 20:44:40.420949 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:40.420923 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pb94r_bb578cb6-73de-4fe4-a720-1283d855030b/console-operator/1.log" May 27 20:44:40.428106 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:40.428085 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pb94r_bb578cb6-73de-4fe4-a720-1283d855030b/console-operator/2.log" May 27 20:44:40.899338 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:40.899306 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-vmck4_b00b05e6-6ed0-457d-882c-402d915f029e/download-server/0.log" May 27 20:44:41.285340 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:41.285307 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw" event={"ID":"a8b506a3-c045-48d2-8ca2-446a29cbca54","Type":"ContainerStarted","Data":"85d950e09eecef1d1c69da29ac3e2f3f808418fa488c549e11ca6ad3adf488de"} May 27 20:44:41.285340 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:41.285348 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw" May 27 20:44:41.285832 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:41.285360 2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw" event={"ID":"a8b506a3-c045-48d2-8ca2-446a29cbca54","Type":"ContainerStarted","Data":"a59308522717c75fe5e5740a39b78332cc881a4b550459fb1c081a5a64444021"} May 27 20:44:41.300933 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:41.300889 2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw" podStartSLOduration=2.300874725 podStartE2EDuration="2.300874725s" podCreationTimestamp="2026-05-27 20:44:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:44:41.300372487 +0000 UTC m=+1990.828441129" watchObservedRunningTime="2026-05-27 20:44:41.300874725 +0000 UTC m=+1990.828943366" May 27 20:44:41.459518 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:41.459484 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-m9rnr_97288a13-4a11-4860-ab23-8d4f178e65fb/volume-data-source-validator/0.log" May 27 20:44:42.302004 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:42.301973 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pwnms_db22aafa-06fa-48ee-b31f-69581a977745/dns/0.log" May 27 20:44:42.324864 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:42.324836 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pwnms_db22aafa-06fa-48ee-b31f-69581a977745/kube-rbac-proxy/0.log" May 27 20:44:42.352361 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:42.352335 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-57cz2_4def15c9-ddcd-4d42-a061-ef4f279c7f63/dns-node-resolver/0.log" May 27 20:44:42.913986 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:42.913956 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w86br_0e6cae6b-bb5a-44a0-b929-68b455a68a96/node-ca/0.log" May 27 20:44:43.689795 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:43.689763 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b8jsbw_c7d408be-dd9e-4497-8093-b1190650e07f/istio-proxy/0.log" May 27 20:44:43.876930 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:43.876902 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-2wm9x_29619e79-7445-4db5-b1b3-40a55486baef/istio-proxy/0.log" May 27 20:44:43.956257 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:43.956172 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-696899764b-7qrxr_b4c04590-5a56-4dd4-ac22-9a3f9b06ae5f/router/0.log" May 27 20:44:44.476616 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:44.476587 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jqxt2_b59afc02-dbe6-4e59-b84a-f7c108bd70e3/serve-healthcheck-canary/0.log" May 27 20:44:44.966148 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:44.966103 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-pcwwj_f237de37-4fce-4257-af56-52a222da551a/insights-operator/0.log" May 27 20:44:44.966746 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:44.966443 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-pcwwj_f237de37-4fce-4257-af56-52a222da551a/insights-operator/1.log" May 27 20:44:45.129859 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:45.129832 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xgzn9_5817ede5-e832-4828-b02b-9fef252e17f2/kube-rbac-proxy/0.log" May 27 20:44:45.150889 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:45.150864 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xgzn9_5817ede5-e832-4828-b02b-9fef252e17f2/exporter/0.log" May 27 20:44:45.172662 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:45.172603 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xgzn9_5817ede5-e832-4828-b02b-9fef252e17f2/extractor/0.log" May 27 20:44:47.225447 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:47.225410 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29665230-bkdsz_b0cb90f7-4ebc-4460-a0e0-fb7df3aa2e0b/cleanup/0.log" May 27 20:44:47.300643 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:47.300599 2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lv5mm/perf-node-gather-daemonset-j4mpw" May 27 20:44:47.410731 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:47.410702 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b59bfd74-gmffn_310feb14-5593-4e11-9109-c53086141a9c/manager/0.log" May 27 20:44:48.649591 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:48.649554 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6c47b79f86-v82x9_9646a09a-7500-453f-988e-2889ff9038cd/manager/0.log" May 27 20:44:53.449048 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:53.449013 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-kfvgn_42327801-84b0-458e-9515-67ebe5684ff6/kube-storage-version-migrator-operator/1.log" May 27 20:44:53.449910 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:53.449887 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-kfvgn_42327801-84b0-458e-9515-67ebe5684ff6/kube-storage-version-migrator-operator/0.log" May 27 20:44:54.495801 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:54.495771 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-69bpk_19db3f5a-b350-4f80-960d-073d72ca4e4b/kube-multus-additional-cni-plugins/0.log" May 27 20:44:54.518666 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:54.518612 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-69bpk_19db3f5a-b350-4f80-960d-073d72ca4e4b/egress-router-binary-copy/0.log" May 27 20:44:54.538137 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:54.538114 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-69bpk_19db3f5a-b350-4f80-960d-073d72ca4e4b/cni-plugins/0.log" May 27 20:44:54.558575 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:54.558549 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-69bpk_19db3f5a-b350-4f80-960d-073d72ca4e4b/bond-cni-plugin/0.log" May 27 20:44:54.579299 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:54.579274 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-69bpk_19db3f5a-b350-4f80-960d-073d72ca4e4b/routeoverride-cni/0.log" May 27 20:44:54.599319 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:54.599295 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-69bpk_19db3f5a-b350-4f80-960d-073d72ca4e4b/whereabouts-cni-bincopy/0.log" May 27 20:44:54.620900 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:54.620856 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-69bpk_19db3f5a-b350-4f80-960d-073d72ca4e4b/whereabouts-cni/0.log" May 27 20:44:54.986373 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:54.986338 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mgcm2_99458291-9c93-4139-9ac4-008f6d1edfb7/kube-multus/0.log" May 27 20:44:55.007332 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:55.007302 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5jv8k_a51bfffe-2896-4ffe-84b0-23a5b5127cdd/network-metrics-daemon/0.log" May 27 20:44:55.027885 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:55.027854 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5jv8k_a51bfffe-2896-4ffe-84b0-23a5b5127cdd/kube-rbac-proxy/0.log" May 27 20:44:56.416150 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:56.416116 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/ovn-controller/0.log" May 27 20:44:56.436212 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:56.436168 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/ovn-acl-logging/0.log" May 27 20:44:56.445133 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:56.445096 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/ovn-acl-logging/1.log" May 27 20:44:56.464638 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:56.464594 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/kube-rbac-proxy-node/0.log" May 27 20:44:56.487045 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:56.487019 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/kube-rbac-proxy-ovn-metrics/0.log" May 27 20:44:56.507643 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:56.507600 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/northd/0.log" May 27 20:44:56.529958 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:56.529932 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/nbdb/0.log" May 27 20:44:56.552060 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:56.552037 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/sbdb/0.log" May 27 20:44:56.652903 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:56.652868 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbcv5_cd676956-4f28-460e-bbf5-3d1502663715/ovnkube-controller/0.log" May 27 20:44:57.785459 ip-10-0-135-103 kubenswrapper[2554]: I0527 20:44:57.785422 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-hm2h8_d572187c-753d-447a-8232-d89446920689/network-check-target-container/0.log"