May 20 21:45:49.855426 ip-10-0-135-24 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 20 21:45:49.855438 ip-10-0-135-24 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 20 21:45:49.855447 ip-10-0-135-24 systemd[1]: kubelet.service: Failed with result 'resources'. May 20 21:45:49.855731 ip-10-0-135-24 systemd[1]: Failed to start Kubernetes Kubelet. May 20 21:45:59.864519 ip-10-0-135-24 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 20 21:45:59.864536 ip-10-0-135-24 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 99f7bc7035f14c93b23f00c74a816f6d -- May 20 21:48:08.952925 ip-10-0-135-24 systemd[1]: Starting Kubernetes Kubelet... May 20 21:48:09.390757 ip-10-0-135-24 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 21:48:09.390757 ip-10-0-135-24 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 20 21:48:09.390757 ip-10-0-135-24 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 21:48:09.390757 ip-10-0-135-24 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 20 21:48:09.390757 ip-10-0-135-24 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 21:48:09.394011 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.393925 2571 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 20 21:48:09.397012 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.396985 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 21:48:09.397012 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397011 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 21:48:09.397163 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397023 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 21:48:09.397163 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397029 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 21:48:09.397163 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397034 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 21:48:09.397163 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397038 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 21:48:09.397163 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397043 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 21:48:09.397163 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397047 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 21:48:09.397163 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397052 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 21:48:09.397163 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397061 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 21:48:09.397163 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397066 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 21:48:09.397163 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397070 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 21:48:09.397163 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397074 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 21:48:09.397163 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397079 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 21:48:09.397163 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397083 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 21:48:09.397163 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397088 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 21:48:09.397163 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397093 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 21:48:09.397163 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397097 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 21:48:09.397163 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397101 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 21:48:09.397163 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397105 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 21:48:09.397163 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397108 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 21:48:09.397163 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397113 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 21:48:09.397744 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397154 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 21:48:09.397744 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397183 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 21:48:09.397744 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397190 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 21:48:09.397744 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397196 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 21:48:09.397744 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397201 2571 feature_gate.go:328] unrecognized feature gate: Example2 May 20 21:48:09.397744 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397208 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 21:48:09.397744 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397213 2571 feature_gate.go:328] unrecognized feature gate: Example May 20 21:48:09.397744 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397218 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 21:48:09.397744 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397223 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 21:48:09.397744 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397230 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 21:48:09.397744 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397234 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 21:48:09.397744 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397240 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 21:48:09.397744 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397244 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 21:48:09.397744 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397256 2571 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 21:48:09.397744 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397261 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 21:48:09.397744 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397270 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 21:48:09.397744 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397275 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 21:48:09.397744 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397280 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 21:48:09.397744 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397284 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 21:48:09.398237 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397289 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 21:48:09.398237 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397294 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 21:48:09.398237 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397299 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 21:48:09.398237 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397303 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 21:48:09.398237 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397311 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 21:48:09.398237 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397326 2571 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 21:48:09.398237 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397337 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 21:48:09.398237 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397343 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 21:48:09.398237 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397348 2571 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 21:48:09.398237 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397353 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 21:48:09.398237 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397358 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 21:48:09.398237 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397363 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 21:48:09.398237 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397367 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 21:48:09.398237 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397372 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 21:48:09.398237 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397377 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 21:48:09.398237 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397383 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 21:48:09.398237 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397388 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 21:48:09.398237 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397393 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 21:48:09.398237 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397403 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 21:48:09.398237 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397408 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 21:48:09.398734 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397413 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 21:48:09.398734 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397418 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 21:48:09.398734 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397423 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 21:48:09.398734 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397427 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 21:48:09.398734 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397462 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 21:48:09.398734 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397484 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 21:48:09.398734 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397600 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 21:48:09.398734 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397609 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 21:48:09.398734 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397616 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 21:48:09.398734 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397619 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 21:48:09.398734 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397622 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 21:48:09.398734 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397625 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 21:48:09.398734 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397628 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 21:48:09.398734 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397631 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 21:48:09.398734 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397633 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 21:48:09.398734 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397648 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 21:48:09.398734 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397652 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 21:48:09.398734 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397656 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 21:48:09.398734 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397660 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 21:48:09.399187 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397663 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 21:48:09.399187 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397666 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 21:48:09.399187 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397668 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 21:48:09.399187 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397671 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 21:48:09.399187 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397674 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 21:48:09.399187 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.397676 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 21:48:09.399187 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398658 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 21:48:09.399187 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398668 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 21:48:09.399187 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398672 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 21:48:09.399187 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398675 2571 feature_gate.go:328] unrecognized feature gate: Example May 20 21:48:09.399187 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398678 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 21:48:09.399187 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398680 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 21:48:09.399187 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398683 2571 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 21:48:09.399187 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398685 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 21:48:09.399187 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398690 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 21:48:09.399187 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398694 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 21:48:09.399187 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398698 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 21:48:09.399187 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398701 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 21:48:09.399187 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398704 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 21:48:09.399187 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398707 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 21:48:09.399681 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398709 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 21:48:09.399681 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398712 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 21:48:09.399681 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398715 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 21:48:09.399681 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398717 2571 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 21:48:09.399681 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398720 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 21:48:09.399681 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398722 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 21:48:09.399681 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398725 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 21:48:09.399681 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398727 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 21:48:09.399681 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398731 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 21:48:09.399681 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398733 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 21:48:09.399681 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398736 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 21:48:09.399681 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398739 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 21:48:09.399681 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398741 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 21:48:09.399681 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398744 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 21:48:09.399681 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398747 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 21:48:09.399681 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398750 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 21:48:09.399681 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398752 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 21:48:09.399681 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398755 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 21:48:09.399681 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398758 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 21:48:09.399681 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398760 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 21:48:09.400175 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398763 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 21:48:09.400175 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398766 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 21:48:09.400175 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398768 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 21:48:09.400175 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398771 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 21:48:09.400175 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398773 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 21:48:09.400175 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398776 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 21:48:09.400175 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398779 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 21:48:09.400175 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398782 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 21:48:09.400175 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398785 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 21:48:09.400175 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398787 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 21:48:09.400175 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398790 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 21:48:09.400175 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398793 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 21:48:09.400175 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398795 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 21:48:09.400175 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398798 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 21:48:09.400175 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398800 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 21:48:09.400175 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398803 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 21:48:09.400175 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398805 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 21:48:09.400175 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398808 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 21:48:09.400175 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398810 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 21:48:09.400175 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398814 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 21:48:09.400677 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398816 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 21:48:09.400677 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398820 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 21:48:09.400677 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398824 2571 feature_gate.go:328] unrecognized feature gate: Example2 May 20 21:48:09.400677 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398827 2571 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 21:48:09.400677 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398830 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 21:48:09.400677 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398832 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 21:48:09.400677 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398836 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 21:48:09.400677 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398839 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 21:48:09.400677 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398842 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 21:48:09.400677 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398845 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 21:48:09.400677 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398848 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 21:48:09.400677 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398851 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 21:48:09.400677 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398853 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 21:48:09.400677 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398856 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 21:48:09.400677 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398858 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 21:48:09.400677 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398861 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 21:48:09.400677 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398864 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 21:48:09.400677 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398866 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 21:48:09.400677 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398869 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 21:48:09.401148 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398872 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 21:48:09.401148 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398874 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 21:48:09.401148 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398877 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 21:48:09.401148 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398879 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 21:48:09.401148 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398882 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 21:48:09.401148 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398885 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 21:48:09.401148 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398889 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 21:48:09.401148 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398891 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 21:48:09.401148 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398894 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 21:48:09.401148 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398897 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 21:48:09.401148 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398899 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 21:48:09.401148 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398901 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 21:48:09.401148 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.398904 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 21:48:09.401148 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399444 2571 flags.go:64] FLAG: --address="0.0.0.0" May 20 21:48:09.401148 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399454 2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 20 21:48:09.401148 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399460 2571 flags.go:64] FLAG: --anonymous-auth="true" May 20 21:48:09.401148 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399465 2571 flags.go:64] FLAG: --application-metrics-count-limit="100" May 20 21:48:09.401148 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399470 2571 flags.go:64] FLAG: --authentication-token-webhook="false" May 20 21:48:09.401148 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399474 2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 20 21:48:09.401148 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399478 2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 20 21:48:09.401148 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399483 2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399486 2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399489 2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399494 2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399498 2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399502 2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399505 2571 flags.go:64] FLAG: --cgroup-root="" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399522 2571 flags.go:64] FLAG: --cgroups-per-qos="true" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399526 2571 flags.go:64] FLAG: --client-ca-file="" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399530 2571 flags.go:64] FLAG: --cloud-config="" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399533 2571 flags.go:64] FLAG: --cloud-provider="external" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399536 2571 flags.go:64] FLAG: --cluster-dns="[]" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399542 2571 flags.go:64] FLAG: --cluster-domain="" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399545 2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399548 2571 flags.go:64] FLAG: --config-dir="" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399551 2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399556 2571 flags.go:64] FLAG: --container-log-max-files="5" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399565 2571 flags.go:64] FLAG: --container-log-max-size="10Mi" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399569 2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399572 2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399576 2571 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399579 2571 flags.go:64] FLAG: --contention-profiling="false" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399582 2571 flags.go:64] FLAG: --cpu-cfs-quota="true" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399585 2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399588 2571 flags.go:64] FLAG: --cpu-manager-policy="none" May 20 21:48:09.401672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399591 2571 flags.go:64] FLAG: --cpu-manager-policy-options="" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399595 2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399598 2571 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399601 2571 flags.go:64] FLAG: --enable-debugging-handlers="true" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399604 2571 flags.go:64] FLAG: --enable-load-reader="false" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399607 2571 flags.go:64] FLAG: --enable-server="true" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399610 2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399615 2571 flags.go:64] FLAG: --event-burst="100" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399618 2571 flags.go:64] FLAG: --event-qps="50" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399621 2571 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399625 2571 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399628 2571 flags.go:64] FLAG: --eviction-hard="" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399632 2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399651 2571 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399654 2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399657 2571 flags.go:64] FLAG: --eviction-soft="" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399660 2571 flags.go:64] FLAG: --eviction-soft-grace-period="" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399663 2571 flags.go:64] FLAG: --exit-on-lock-contention="false" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399666 2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399669 2571 flags.go:64] FLAG: --experimental-mounter-path="" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399672 2571 flags.go:64] FLAG: --fail-cgroupv1="false" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399675 2571 flags.go:64] FLAG: --fail-swap-on="true" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399678 2571 flags.go:64] FLAG: --feature-gates="" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399682 2571 flags.go:64] FLAG: --file-check-frequency="20s" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399685 2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 20 21:48:09.402267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399688 2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 20 21:48:09.402881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399692 2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 20 21:48:09.402881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399695 2571 flags.go:64] FLAG: --healthz-port="10248" May 20 21:48:09.402881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399698 2571 flags.go:64] FLAG: --help="false" May 20 21:48:09.402881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399701 2571 flags.go:64] FLAG: --hostname-override="ip-10-0-135-24.ec2.internal" May 20 21:48:09.402881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399704 2571 flags.go:64] FLAG: --housekeeping-interval="10s" May 20 21:48:09.402881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399707 2571 flags.go:64] FLAG: --http-check-frequency="20s" May 20 21:48:09.402881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399710 2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 20 21:48:09.402881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399713 2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 20 21:48:09.402881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399717 2571 flags.go:64] FLAG: --image-gc-high-threshold="85" May 20 21:48:09.402881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399719 2571 flags.go:64] FLAG: --image-gc-low-threshold="80" May 20 21:48:09.402881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399722 2571 flags.go:64] FLAG: --image-service-endpoint="" May 20 21:48:09.402881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399725 2571 flags.go:64] FLAG: --kernel-memcg-notification="false" May 20 21:48:09.402881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399729 2571 flags.go:64] FLAG: --kube-api-burst="100" May 20 21:48:09.402881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399732 2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 20 21:48:09.402881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399735 2571 flags.go:64] FLAG: --kube-api-qps="50" May 20 21:48:09.402881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399738 2571 flags.go:64] FLAG: --kube-reserved="" May 20 21:48:09.402881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399741 2571 flags.go:64] FLAG: --kube-reserved-cgroup="" May 20 21:48:09.402881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399745 2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 20 21:48:09.402881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399748 2571 flags.go:64] FLAG: --kubelet-cgroups="" May 20 21:48:09.402881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399751 2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 20 21:48:09.402881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399754 2571 flags.go:64] FLAG: --lock-file="" May 20 21:48:09.402881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399757 2571 flags.go:64] FLAG: --log-cadvisor-usage="false" May 20 21:48:09.402881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399760 2571 flags.go:64] FLAG: --log-flush-frequency="5s" May 20 21:48:09.402881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399763 2571 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 20 21:48:09.403553 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399769 2571 flags.go:64] FLAG: --log-json-split-stream="false" May 20 21:48:09.403553 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399772 2571 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 20 21:48:09.403553 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399775 2571 flags.go:64] FLAG: --log-text-split-stream="false" May 20 21:48:09.403553 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399778 2571 flags.go:64] FLAG: --logging-format="text" May 20 21:48:09.403553 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399780 2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 20 21:48:09.403553 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399784 2571 flags.go:64] FLAG: --make-iptables-util-chains="true" May 20 21:48:09.403553 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399786 2571 flags.go:64] FLAG: --manifest-url="" May 20 21:48:09.403553 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399789 2571 flags.go:64] FLAG: --manifest-url-header="" May 20 21:48:09.403553 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399794 2571 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 20 21:48:09.403553 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399797 2571 flags.go:64] FLAG: --max-open-files="1000000" May 20 21:48:09.403553 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399802 2571 flags.go:64] FLAG: --max-pods="110" May 20 21:48:09.403553 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399805 2571 flags.go:64] FLAG: --maximum-dead-containers="-1" May 20 21:48:09.403553 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399808 2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 20 21:48:09.403553 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399810 2571 flags.go:64] FLAG: --memory-manager-policy="None" May 20 21:48:09.403553 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399813 2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 20 21:48:09.403553 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399817 2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 20 21:48:09.403553 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399820 2571 flags.go:64] FLAG: --node-ip="0.0.0.0" May 20 21:48:09.403553 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399823 2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 20 21:48:09.403553 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399830 2571 flags.go:64] FLAG: --node-status-max-images="50" May 20 21:48:09.403553 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399834 2571 flags.go:64] FLAG: --node-status-update-frequency="10s" May 20 21:48:09.403553 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399837 2571 flags.go:64] FLAG: --oom-score-adj="-999" May 20 21:48:09.403553 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399840 2571 flags.go:64] FLAG: --pod-cidr="" May 20 21:48:09.403553 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399843 2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399849 2571 flags.go:64] FLAG: --pod-manifest-path="" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399852 2571 flags.go:64] FLAG: --pod-max-pids="-1" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399855 2571 flags.go:64] FLAG: --pods-per-core="0" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399859 2571 flags.go:64] FLAG: --port="10250" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399862 2571 flags.go:64] FLAG: --protect-kernel-defaults="false" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399865 2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0de8c3ee96973068c" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399868 2571 flags.go:64] FLAG: --qos-reserved="" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399871 2571 flags.go:64] FLAG: --read-only-port="10255" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399874 2571 flags.go:64] FLAG: --register-node="true" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399877 2571 flags.go:64] FLAG: --register-schedulable="true" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399880 2571 flags.go:64] FLAG: --register-with-taints="" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399884 2571 flags.go:64] FLAG: --registry-burst="10" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399887 2571 flags.go:64] FLAG: --registry-qps="5" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399889 2571 flags.go:64] FLAG: --reserved-cpus="" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399892 2571 flags.go:64] FLAG: --reserved-memory="" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399896 2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399899 2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399902 2571 flags.go:64] FLAG: --rotate-certificates="false" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399905 2571 flags.go:64] FLAG: --rotate-server-certificates="false" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399908 2571 flags.go:64] FLAG: --runonce="false" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399911 2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399914 2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399917 2571 flags.go:64] FLAG: --seccomp-default="false" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399920 2571 flags.go:64] FLAG: --serialize-image-pulls="true" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399923 2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 20 21:48:09.404131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399926 2571 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399929 2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399932 2571 flags.go:64] FLAG: --storage-driver-password="root" May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399935 2571 flags.go:64] FLAG: --storage-driver-secure="false" May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399938 2571 flags.go:64] FLAG: --storage-driver-table="stats" May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399940 2571 flags.go:64] FLAG: --storage-driver-user="root" May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399944 2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399950 2571 flags.go:64] FLAG: --sync-frequency="1m0s" May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399953 2571 flags.go:64] FLAG: --system-cgroups="" May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399956 2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399961 2571 flags.go:64] FLAG: --system-reserved-cgroup="" May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399965 2571 flags.go:64] FLAG: --tls-cert-file="" May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399968 2571 flags.go:64] FLAG: --tls-cipher-suites="[]" May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399973 2571 flags.go:64] FLAG: --tls-min-version="" May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399976 2571 flags.go:64] FLAG: --tls-private-key-file="" May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399979 2571 flags.go:64] FLAG: --topology-manager-policy="none" May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399982 2571 flags.go:64] FLAG: --topology-manager-policy-options="" May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399985 2571 flags.go:64] FLAG: --topology-manager-scope="container" May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399988 2571 flags.go:64] FLAG: --v="2" May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399992 2571 flags.go:64] FLAG: --version="false" May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.399996 2571 flags.go:64] FLAG: --vmodule="" May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.400001 2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.400004 2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400110 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400115 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 21:48:09.404784 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400118 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 21:48:09.405484 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400121 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 21:48:09.405484 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400124 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 21:48:09.405484 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400126 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 21:48:09.405484 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400129 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 21:48:09.405484 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400131 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 21:48:09.405484 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400134 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 21:48:09.405484 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400137 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 21:48:09.405484 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400139 2571 feature_gate.go:328] unrecognized feature gate: Example2 May 20 21:48:09.405484 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400142 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 21:48:09.405484 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400145 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 21:48:09.405484 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400147 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 21:48:09.405484 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400150 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 21:48:09.405484 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400153 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 21:48:09.405484 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400158 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 21:48:09.405484 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400165 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 21:48:09.405484 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400167 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 21:48:09.405484 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400170 2571 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 21:48:09.405484 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400173 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 21:48:09.405484 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400175 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 21:48:09.405484 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400178 2571 feature_gate.go:328] unrecognized feature gate: Example May 20 21:48:09.406021 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400181 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 21:48:09.406021 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400184 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 21:48:09.406021 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400187 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 21:48:09.406021 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400189 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 21:48:09.406021 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400194 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 21:48:09.406021 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400197 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 21:48:09.406021 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400200 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 21:48:09.406021 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400204 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 21:48:09.406021 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400208 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 21:48:09.406021 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400211 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 21:48:09.406021 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400214 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 21:48:09.406021 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400217 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 21:48:09.406021 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400220 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 21:48:09.406021 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400223 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 21:48:09.406021 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400226 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 21:48:09.406021 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400228 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 21:48:09.406021 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400231 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 21:48:09.406021 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400233 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 21:48:09.406021 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400236 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 21:48:09.406487 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400239 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 21:48:09.406487 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400241 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 21:48:09.406487 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400244 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 21:48:09.406487 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400247 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 21:48:09.406487 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400249 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 21:48:09.406487 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400252 2571 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 21:48:09.406487 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400255 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 21:48:09.406487 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400266 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 21:48:09.406487 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400268 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 21:48:09.406487 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400271 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 21:48:09.406487 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400274 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 21:48:09.406487 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400276 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 21:48:09.406487 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400279 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 21:48:09.406487 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400281 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 21:48:09.406487 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400284 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 21:48:09.406487 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400286 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 21:48:09.406487 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400289 2571 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 21:48:09.406487 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400291 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 21:48:09.406487 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400294 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 21:48:09.406487 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400296 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 21:48:09.407022 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400299 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 21:48:09.407022 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400302 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 21:48:09.407022 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400304 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 21:48:09.407022 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400307 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 21:48:09.407022 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400309 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 21:48:09.407022 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400312 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 21:48:09.407022 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400315 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 21:48:09.407022 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400317 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 21:48:09.407022 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400320 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 21:48:09.407022 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400322 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 21:48:09.407022 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400325 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 21:48:09.407022 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400328 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 21:48:09.407022 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400330 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 21:48:09.407022 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400333 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 21:48:09.407022 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400335 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 21:48:09.407022 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400338 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 21:48:09.407022 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400340 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 21:48:09.407022 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400343 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 21:48:09.407022 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400345 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 21:48:09.407495 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400350 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 21:48:09.407495 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400353 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 21:48:09.407495 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400356 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 21:48:09.407495 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400359 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 21:48:09.407495 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.400361 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 21:48:09.407495 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.400367 2571 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 21:48:09.407495 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.406582 2571 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 20 21:48:09.407495 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.406599 2571 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 20 21:48:09.407495 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406664 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 21:48:09.407495 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406671 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 21:48:09.407495 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406674 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 21:48:09.407495 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406677 2571 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 21:48:09.407495 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406680 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 21:48:09.407495 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406683 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 21:48:09.407495 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406686 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 21:48:09.407495 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406689 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 21:48:09.407913 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406691 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 21:48:09.407913 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406694 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 21:48:09.407913 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406697 2571 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 21:48:09.407913 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406701 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 21:48:09.407913 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406705 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 21:48:09.407913 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406708 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 21:48:09.407913 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406711 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 21:48:09.407913 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406714 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 21:48:09.407913 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406717 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 21:48:09.407913 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406719 2571 feature_gate.go:328] unrecognized feature gate: Example May 20 21:48:09.407913 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406722 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 21:48:09.407913 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406725 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 21:48:09.407913 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406727 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 21:48:09.407913 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406730 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 21:48:09.407913 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406733 2571 feature_gate.go:328] unrecognized feature gate: Example2 May 20 21:48:09.407913 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406736 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 21:48:09.407913 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406739 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 21:48:09.407913 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406742 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 21:48:09.407913 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406745 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 21:48:09.407913 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406747 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 21:48:09.408405 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406750 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 21:48:09.408405 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406752 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 21:48:09.408405 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406755 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 21:48:09.408405 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406759 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 21:48:09.408405 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406762 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 21:48:09.408405 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406764 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 21:48:09.408405 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406768 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 21:48:09.408405 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406770 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 21:48:09.408405 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406773 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 21:48:09.408405 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406776 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 21:48:09.408405 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406778 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 21:48:09.408405 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406781 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 21:48:09.408405 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406783 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 21:48:09.408405 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406786 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 21:48:09.408405 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406788 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 21:48:09.408405 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406790 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 21:48:09.408405 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406793 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 21:48:09.408405 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406795 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 21:48:09.408405 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406798 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 21:48:09.408405 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406800 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 21:48:09.408928 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406803 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 21:48:09.408928 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406806 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 21:48:09.408928 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406808 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 21:48:09.408928 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406810 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 21:48:09.408928 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406814 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 21:48:09.408928 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406818 2571 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 21:48:09.408928 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406820 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 21:48:09.408928 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406824 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 21:48:09.408928 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406826 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 21:48:09.408928 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406830 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 21:48:09.408928 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406833 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 21:48:09.408928 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406835 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 21:48:09.408928 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406838 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 21:48:09.408928 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406841 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 21:48:09.408928 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406844 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 21:48:09.408928 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406847 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 21:48:09.408928 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406853 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 21:48:09.408928 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406856 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 21:48:09.408928 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406859 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 21:48:09.409403 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406861 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 21:48:09.409403 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406864 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 21:48:09.409403 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406866 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 21:48:09.409403 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406869 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 21:48:09.409403 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406871 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 21:48:09.409403 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406874 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 21:48:09.409403 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406876 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 21:48:09.409403 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406879 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 21:48:09.409403 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406882 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 21:48:09.409403 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406884 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 21:48:09.409403 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406887 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 21:48:09.409403 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406890 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 21:48:09.409403 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406892 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 21:48:09.409403 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406895 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 21:48:09.409403 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406897 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 21:48:09.409403 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406900 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 21:48:09.409403 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406903 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 21:48:09.409403 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406905 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 21:48:09.409403 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.406908 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 21:48:09.409892 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.406913 2571 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 21:48:09.409892 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407022 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 21:48:09.409892 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407027 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 21:48:09.409892 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407030 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 21:48:09.409892 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407034 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 21:48:09.409892 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407037 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 21:48:09.409892 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407040 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 21:48:09.409892 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407043 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 21:48:09.409892 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407046 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 21:48:09.409892 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407049 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 21:48:09.409892 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407052 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 21:48:09.409892 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407060 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 21:48:09.409892 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407063 2571 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 21:48:09.409892 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407066 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 21:48:09.409892 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407068 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 21:48:09.410294 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407071 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 21:48:09.410294 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407074 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 21:48:09.410294 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407076 2571 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 21:48:09.410294 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407079 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 21:48:09.410294 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407081 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 21:48:09.410294 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407084 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 21:48:09.410294 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407087 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 21:48:09.410294 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407089 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 21:48:09.410294 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407092 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 21:48:09.410294 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407094 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 21:48:09.410294 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407096 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 21:48:09.410294 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407099 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 21:48:09.410294 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407101 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 21:48:09.410294 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407105 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 21:48:09.410294 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407109 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 21:48:09.410294 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407112 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 21:48:09.410294 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407114 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 21:48:09.410294 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407117 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 21:48:09.410294 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407120 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 21:48:09.410771 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407123 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 21:48:09.410771 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407126 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 21:48:09.410771 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407129 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 21:48:09.410771 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407131 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 21:48:09.410771 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407134 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 21:48:09.410771 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407136 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 21:48:09.410771 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407139 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 21:48:09.410771 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407141 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 21:48:09.410771 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407144 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 21:48:09.410771 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407146 2571 feature_gate.go:328] unrecognized feature gate: Example2 May 20 21:48:09.410771 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407150 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 21:48:09.410771 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407153 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 21:48:09.410771 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407155 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 21:48:09.410771 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407157 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 21:48:09.410771 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407160 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 21:48:09.410771 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407162 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 21:48:09.410771 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407165 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 21:48:09.410771 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407168 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 21:48:09.410771 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407170 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 21:48:09.410771 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407172 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 21:48:09.411301 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407175 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 21:48:09.411301 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407177 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 21:48:09.411301 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407180 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 21:48:09.411301 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407182 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 21:48:09.411301 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407185 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 21:48:09.411301 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407188 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 21:48:09.411301 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407190 2571 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 21:48:09.411301 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407193 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 21:48:09.411301 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407195 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 21:48:09.411301 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407198 2571 feature_gate.go:328] unrecognized feature gate: Example May 20 21:48:09.411301 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407201 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 21:48:09.411301 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407203 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 21:48:09.411301 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407206 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 21:48:09.411301 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407208 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 21:48:09.411301 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407211 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 21:48:09.411301 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407213 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 21:48:09.411301 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407216 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 21:48:09.411301 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407218 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 21:48:09.411301 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407221 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 21:48:09.411301 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407223 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 21:48:09.411862 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407226 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 21:48:09.411862 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407228 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 21:48:09.411862 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407231 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 21:48:09.411862 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407234 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 21:48:09.411862 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407236 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 21:48:09.411862 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407239 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 21:48:09.411862 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407241 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 21:48:09.411862 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407244 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 21:48:09.411862 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407246 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 21:48:09.411862 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407249 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 21:48:09.411862 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407252 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 21:48:09.411862 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407256 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 21:48:09.411862 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:09.407258 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 21:48:09.411862 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.407263 2571 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 21:48:09.411862 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.408006 2571 server.go:962] "Client rotation is on, will bootstrap in background" May 20 21:48:09.412229 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.410772 2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 20 21:48:09.412229 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.411671 2571 server.go:1019] "Starting client certificate rotation" May 20 21:48:09.412229 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.411780 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 20 21:48:09.412540 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.412526 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 20 21:48:09.435452 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.435427 2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 20 21:48:09.437367 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.437348 2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 20 21:48:09.452270 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.452249 2571 log.go:25] "Validated CRI v1 runtime API" May 20 21:48:09.459803 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.459788 2571 log.go:25] "Validated CRI v1 image API" May 20 21:48:09.460940 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.460926 2571 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 20 21:48:09.465804 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.465784 2571 fs.go:135] Filesystem UUIDs: map[14d0c430-52eb-4a17-bc14-d03cd02109ad:/dev/nvme0n1p4 2a06cb45-8be2-4f47-9c3c-23be89e19ae9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] May 20 21:48:09.465871 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.465803 2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 20 21:48:09.469936 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.469823 2571 manager.go:217] Machine: {Timestamp:2026-05-20 21:48:09.469296416 +0000 UTC m=+0.399113150 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099468 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c31f6bf32d3e21162becdddd02930 SystemUUID:ec2c31f6-bf32-d3e2-1162-becdddd02930 BootID:99f7bc70-35f1-4c93-b23f-00c74a816f6d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:53:05:8f:4f:2d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:53:05:8f:4f:2d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:fe:03:f7:d6:86 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 20 21:48:09.470690 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.470677 2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 20 21:48:09.470798 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.470782 2571 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 20 21:48:09.472864 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.472845 2571 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 20 21:48:09.474249 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.474223 2571 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 20 21:48:09.474410 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.474252 2571 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-24.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 20 21:48:09.474466 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.474422 2571 topology_manager.go:138] "Creating topology manager with none policy" May 20 21:48:09.474466 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.474430 2571 container_manager_linux.go:306] "Creating device plugin manager" May 20 21:48:09.474466 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.474438 2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 20 21:48:09.475867 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.475854 2571 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 20 21:48:09.477484 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.477474 2571 state_mem.go:36] "Initialized new in-memory state store" May 20 21:48:09.477611 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.477601 2571 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 20 21:48:09.480094 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.480085 2571 kubelet.go:491] "Attempting to sync node with API server" May 20 21:48:09.480131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.480098 2571 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 20 21:48:09.480131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.480110 2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 20 21:48:09.480131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.480119 2571 kubelet.go:397] "Adding apiserver pod source" May 20 21:48:09.480131 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.480127 2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 20 21:48:09.481259 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.481246 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 20 21:48:09.481313 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.481264 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 20 21:48:09.484792 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.484772 2571 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 20 21:48:09.486448 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.486433 2571 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 20 21:48:09.487390 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.487377 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 20 21:48:09.487447 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.487395 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 20 21:48:09.487447 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.487402 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 20 21:48:09.487447 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.487407 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 20 21:48:09.487447 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.487416 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 20 21:48:09.487447 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.487422 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 20 21:48:09.487447 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.487428 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 20 21:48:09.487447 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.487433 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 20 21:48:09.487447 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.487440 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 20 21:48:09.487447 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.487446 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 20 21:48:09.487684 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.487459 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 20 21:48:09.487716 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.487699 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 20 21:48:09.489157 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.489146 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 20 21:48:09.489190 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.489159 2571 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 20 21:48:09.492446 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.492433 2571 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 20 21:48:09.492500 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.492469 2571 server.go:1295] "Started kubelet" May 20 21:48:09.492566 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.492536 2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 20 21:48:09.492652 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.492576 2571 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 20 21:48:09.492698 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.492673 2571 server_v1.go:47] "podresources" method="list" useActivePods=true May 20 21:48:09.493249 ip-10-0-135-24 systemd[1]: Started Kubernetes Kubelet. May 20 21:48:09.493897 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.493879 2571 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 20 21:48:09.493942 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:09.493919 2571 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 20 21:48:09.493985 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:09.493932 2571 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 20 21:48:09.495337 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.495324 2571 server.go:317] "Adding debug handlers to kubelet server" May 20 21:48:09.496288 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.496274 2571 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 20 21:48:09.502401 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:09.502369 2571 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 20 21:48:09.502828 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.502811 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 20 21:48:09.503169 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:09.499590 2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-24.ec2.internal.18b1645f962fd614 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-24.ec2.internal,UID:ip-10-0-135-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-24.ec2.internal,},FirstTimestamp:2026-05-20 21:48:09.492444692 +0000 UTC m=+0.422261426,LastTimestamp:2026-05-20 21:48:09.492444692 +0000 UTC m=+0.422261426,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-24.ec2.internal,}" May 20 21:48:09.503309 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.503294 2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 20 21:48:09.503625 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.503608 2571 volume_manager.go:295] "The desired_state_of_world populator starts" May 20 21:48:09.503625 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.503626 2571 volume_manager.go:297] "Starting Kubelet Volume Manager" May 20 21:48:09.503786 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.503771 2571 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 20 21:48:09.503840 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.503821 2571 reconstruct.go:97] "Volume reconstruction finished" May 20 21:48:09.503840 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.503833 2571 reconciler.go:26] "Reconciler: start to sync state" May 20 21:48:09.504178 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.504163 2571 factory.go:55] Registering systemd factory May 20 21:48:09.504251 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.504188 2571 factory.go:223] Registration of the systemd container factory successfully May 20 21:48:09.504389 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:09.504366 2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-24.ec2.internal\" not found" May 20 21:48:09.504480 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.504412 2571 factory.go:153] Registering CRI-O factory May 20 21:48:09.504480 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.504428 2571 factory.go:223] Registration of the crio container factory successfully May 20 21:48:09.504480 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.504471 2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 20 21:48:09.504625 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.504485 2571 factory.go:103] Registering Raw factory May 20 21:48:09.504625 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.504495 2571 manager.go:1196] Started watching for new ooms in manager May 20 21:48:09.505581 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.505559 2571 manager.go:319] Starting recovery of all containers May 20 21:48:09.505864 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:09.505838 2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 20 21:48:09.505978 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:09.505952 2571 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 20 21:48:09.515924 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.515798 2571 manager.go:324] Recovery completed May 20 21:48:09.520125 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.520108 2571 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 21:48:09.521889 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.521873 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-24.ec2.internal" event="NodeHasSufficientMemory" May 20 21:48:09.521945 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.521902 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-24.ec2.internal" event="NodeHasNoDiskPressure" May 20 21:48:09.521945 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.521913 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-24.ec2.internal" event="NodeHasSufficientPID" May 20 21:48:09.522391 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.522376 2571 cpu_manager.go:222] "Starting CPU manager" policy="none" May 20 21:48:09.522391 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.522389 2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 20 21:48:09.522468 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.522403 2571 state_mem.go:36] "Initialized new in-memory state store" May 20 21:48:09.524627 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.524606 2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wt4c9" May 20 21:48:09.524718 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.524678 2571 policy_none.go:49] "None policy: Start" May 20 21:48:09.524718 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.524693 2571 memory_manager.go:186] "Starting memorymanager" policy="None" May 20 21:48:09.524718 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.524704 2571 state_mem.go:35] "Initializing new in-memory state store" May 20 21:48:09.532771 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:09.532711 2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-24.ec2.internal.18b1645f97f12342 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-24.ec2.internal,UID:ip-10-0-135-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-24.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-24.ec2.internal,},FirstTimestamp:2026-05-20 21:48:09.521890114 +0000 UTC m=+0.451706851,LastTimestamp:2026-05-20 21:48:09.521890114 +0000 UTC m=+0.451706851,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-24.ec2.internal,}" May 20 21:48:09.537492 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.537473 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wt4c9" May 20 21:48:09.566137 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.566125 2571 manager.go:341] "Starting Device Plugin manager" May 20 21:48:09.566237 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:09.566161 2571 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 20 21:48:09.566237 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.566170 2571 server.go:85] "Starting device plugin registration server" May 20 21:48:09.566383 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.566369 2571 eviction_manager.go:189] "Eviction manager: starting control loop" May 20 21:48:09.566423 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.566385 2571 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 20 21:48:09.566618 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.566601 2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 20 21:48:09.566740 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.566721 2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 20 21:48:09.566740 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.566734 2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 20 21:48:09.567104 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:09.567083 2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 20 21:48:09.567171 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:09.567129 2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-24.ec2.internal\" not found" May 20 21:48:09.622152 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.622128 2571 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 20 21:48:09.623265 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.623248 2571 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 20 21:48:09.623265 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.623268 2571 status_manager.go:230] "Starting to sync pod status with apiserver" May 20 21:48:09.623410 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.623282 2571 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 20 21:48:09.623410 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.623288 2571 kubelet.go:2451] "Starting kubelet main sync loop" May 20 21:48:09.623410 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:09.623322 2571 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 20 21:48:09.629814 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.629799 2571 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 20 21:48:09.666764 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.666724 2571 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 21:48:09.667508 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.667490 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-24.ec2.internal" event="NodeHasSufficientMemory" May 20 21:48:09.667575 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.667522 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-24.ec2.internal" event="NodeHasNoDiskPressure" May 20 21:48:09.667575 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.667533 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-24.ec2.internal" event="NodeHasSufficientPID" May 20 21:48:09.667575 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.667556 2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-24.ec2.internal" May 20 21:48:09.677877 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.677859 2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-24.ec2.internal" May 20 21:48:09.677945 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:09.677878 2571 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-24.ec2.internal\": node \"ip-10-0-135-24.ec2.internal\" not found" May 20 21:48:09.694366 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:09.694346 2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-24.ec2.internal\" not found" May 20 21:48:09.724221 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.724186 2571 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-24.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-24.ec2.internal"] May 20 21:48:09.724306 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.724266 2571 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 21:48:09.725650 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.725626 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-24.ec2.internal" event="NodeHasSufficientMemory" May 20 21:48:09.725723 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.725671 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-24.ec2.internal" event="NodeHasNoDiskPressure" May 20 21:48:09.725723 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.725682 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-24.ec2.internal" event="NodeHasSufficientPID" May 20 21:48:09.726720 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.726708 2571 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 21:48:09.726868 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.726853 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-24.ec2.internal" May 20 21:48:09.726915 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.726883 2571 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 21:48:09.727384 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.727369 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-24.ec2.internal" event="NodeHasSufficientMemory" May 20 21:48:09.727384 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.727378 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-24.ec2.internal" event="NodeHasSufficientMemory" May 20 21:48:09.727492 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.727396 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-24.ec2.internal" event="NodeHasNoDiskPressure" May 20 21:48:09.727492 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.727412 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-24.ec2.internal" event="NodeHasSufficientPID" May 20 21:48:09.727492 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.727399 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-24.ec2.internal" event="NodeHasNoDiskPressure" May 20 21:48:09.727492 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.727491 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-24.ec2.internal" event="NodeHasSufficientPID" May 20 21:48:09.728486 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.728473 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-24.ec2.internal" May 20 21:48:09.728546 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.728496 2571 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 21:48:09.729121 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.729106 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-24.ec2.internal" event="NodeHasSufficientMemory" May 20 21:48:09.729187 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.729138 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-24.ec2.internal" event="NodeHasNoDiskPressure" May 20 21:48:09.729187 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.729147 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-24.ec2.internal" event="NodeHasSufficientPID" May 20 21:48:09.756229 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:09.756211 2571 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-24.ec2.internal\" not found" node="ip-10-0-135-24.ec2.internal" May 20 21:48:09.760477 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:09.760463 2571 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-24.ec2.internal\" not found" node="ip-10-0-135-24.ec2.internal" May 20 21:48:09.794499 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:09.794479 2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-24.ec2.internal\" not found" May 20 21:48:09.805833 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.805813 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c7aa3561d957a7f9779d8e4e0783c0ff-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-24.ec2.internal\" (UID: \"c7aa3561d957a7f9779d8e4e0783c0ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-24.ec2.internal" May 20 21:48:09.805887 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.805840 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7aa3561d957a7f9779d8e4e0783c0ff-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-24.ec2.internal\" (UID: \"c7aa3561d957a7f9779d8e4e0783c0ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-24.ec2.internal" May 20 21:48:09.805887 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.805857 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec0c946b0168eebf1df2dbb6a8fd579a-config\") pod \"kube-apiserver-proxy-ip-10-0-135-24.ec2.internal\" (UID: \"ec0c946b0168eebf1df2dbb6a8fd579a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-24.ec2.internal" May 20 21:48:09.894560 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:09.894531 2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-24.ec2.internal\" not found" May 20 21:48:09.906911 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.906892 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c7aa3561d957a7f9779d8e4e0783c0ff-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-24.ec2.internal\" (UID: \"c7aa3561d957a7f9779d8e4e0783c0ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-24.ec2.internal" May 20 21:48:09.906964 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.906938 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c7aa3561d957a7f9779d8e4e0783c0ff-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-24.ec2.internal\" (UID: \"c7aa3561d957a7f9779d8e4e0783c0ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-24.ec2.internal" May 20 21:48:09.907000 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.906967 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7aa3561d957a7f9779d8e4e0783c0ff-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-24.ec2.internal\" (UID: \"c7aa3561d957a7f9779d8e4e0783c0ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-24.ec2.internal" May 20 21:48:09.907000 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.906984 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec0c946b0168eebf1df2dbb6a8fd579a-config\") pod \"kube-apiserver-proxy-ip-10-0-135-24.ec2.internal\" (UID: \"ec0c946b0168eebf1df2dbb6a8fd579a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-24.ec2.internal" May 20 21:48:09.907059 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.907016 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec0c946b0168eebf1df2dbb6a8fd579a-config\") pod \"kube-apiserver-proxy-ip-10-0-135-24.ec2.internal\" (UID: \"ec0c946b0168eebf1df2dbb6a8fd579a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-24.ec2.internal" May 20 21:48:09.907093 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:09.907057 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7aa3561d957a7f9779d8e4e0783c0ff-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-24.ec2.internal\" (UID: \"c7aa3561d957a7f9779d8e4e0783c0ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-24.ec2.internal" May 20 21:48:09.995300 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:09.995244 2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-24.ec2.internal\" not found" May 20 21:48:10.058710 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:10.058680 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-24.ec2.internal" May 20 21:48:10.063398 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:10.063378 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-24.ec2.internal" May 20 21:48:10.096083 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:10.096055 2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-24.ec2.internal\" not found" May 20 21:48:10.196561 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:10.196532 2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-24.ec2.internal\" not found" May 20 21:48:10.297074 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:10.297009 2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-24.ec2.internal\" not found" May 20 21:48:10.312205 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:10.312185 2571 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 20 21:48:10.398110 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:10.398087 2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-24.ec2.internal\" not found" May 20 21:48:10.411571 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:10.411554 2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 20 21:48:10.411731 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:10.411710 2571 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 20 21:48:10.411787 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:10.411723 2571 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 20 21:48:10.492170 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:10.492138 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec0c946b0168eebf1df2dbb6a8fd579a.slice/crio-e0f5c047aa939b27009811403d7b0439e217bfeb0e2f5cbd81f029f285922ff4 WatchSource:0}: Error finding container e0f5c047aa939b27009811403d7b0439e217bfeb0e2f5cbd81f029f285922ff4: Status 404 returned error can't find the container with id e0f5c047aa939b27009811403d7b0439e217bfeb0e2f5cbd81f029f285922ff4 May 20 21:48:10.492416 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:10.492394 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7aa3561d957a7f9779d8e4e0783c0ff.slice/crio-8c60e640364208f1760f2730fc9e772c5749e640924b435799ad46914e575abd WatchSource:0}: Error finding container 8c60e640364208f1760f2730fc9e772c5749e640924b435799ad46914e575abd: Status 404 returned error can't find the container with id 8c60e640364208f1760f2730fc9e772c5749e640924b435799ad46914e575abd May 20 21:48:10.496982 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:10.496965 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 21:48:10.498520 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:10.498494 2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-24.ec2.internal\" not found" May 20 21:48:10.502941 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:10.502922 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 20 21:48:10.514191 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:10.514170 2571 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 20 21:48:10.532826 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:10.532806 2571 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 20 21:48:10.538904 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:10.538882 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-19 21:43:09 +0000 UTC" deadline="2028-02-25 04:26:41.177838068 +0000 UTC" May 20 21:48:10.538966 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:10.538904 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15486h38m30.638936572s" May 20 21:48:10.572390 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:10.572370 2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jtc88" May 20 21:48:10.581174 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:10.581159 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jtc88" May 20 21:48:10.598775 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:10.598753 2571 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-24.ec2.internal\" not found" May 20 21:48:10.620651 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:10.620627 2571 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 20 21:48:10.626544 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:10.626510 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-24.ec2.internal" event={"ID":"c7aa3561d957a7f9779d8e4e0783c0ff","Type":"ContainerStarted","Data":"8c60e640364208f1760f2730fc9e772c5749e640924b435799ad46914e575abd"} May 20 21:48:10.627379 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:10.627350 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-24.ec2.internal" event={"ID":"ec0c946b0168eebf1df2dbb6a8fd579a","Type":"ContainerStarted","Data":"e0f5c047aa939b27009811403d7b0439e217bfeb0e2f5cbd81f029f285922ff4"} May 20 21:48:10.704477 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:10.704453 2571 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-24.ec2.internal" May 20 21:48:10.719763 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:10.719746 2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 20 21:48:10.720633 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:10.720622 2571 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-24.ec2.internal" May 20 21:48:10.745879 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:10.745862 2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 20 21:48:11.481964 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.481886 2571 apiserver.go:52] "Watching apiserver" May 20 21:48:11.490294 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.490269 2571 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 20 21:48:11.491142 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.491106 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-cbqtt","kube-system/konnectivity-agent-d549q","openshift-cluster-node-tuning-operator/tuned-82r6j","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-24.ec2.internal","openshift-multus/multus-dn8hq","openshift-multus/network-metrics-daemon-hdgzt","openshift-network-diagnostics/network-check-target-rcvp4","kube-system/kube-apiserver-proxy-ip-10-0-135-24.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k","openshift-dns/node-resolver-6wwrr","openshift-image-registry/node-ca-68fgb","openshift-multus/multus-additional-cni-plugins-76n7v","openshift-network-operator/iptables-alerter-kxb9x","openshift-ovn-kubernetes/ovnkube-node-shgjs"] May 20 21:48:11.492660 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.492610 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6wwrr" May 20 21:48:11.494736 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.494707 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kxb9x" May 20 21:48:11.494844 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.494820 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.496075 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.496055 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.497153 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.497132 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dn8hq" May 20 21:48:11.497512 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.497487 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-htdhq\"" May 20 21:48:11.497680 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.497622 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 20 21:48:11.497979 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.497494 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 20 21:48:11.498294 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.498267 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:11.498375 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:11.498336 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdgzt" podUID="b785e9ea-de17-443e-b54a-ca50c16abeb6" May 20 21:48:11.498738 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.498708 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 20 21:48:11.498738 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.498732 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jdz7z\"" May 20 21:48:11.498887 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.498857 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 20 21:48:11.498966 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.498954 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 20 21:48:11.499020 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.499008 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 20 21:48:11.499524 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.499288 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-959fk\"" May 20 21:48:11.499524 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.499450 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 20 21:48:11.499717 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.499527 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 20 21:48:11.499950 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.499922 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" May 20 21:48:11.500630 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.500610 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 20 21:48:11.500809 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.500738 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 20 21:48:11.501189 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.500811 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 20 21:48:11.501189 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.500815 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 20 21:48:11.501189 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.501158 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:11.501340 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:11.501227 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvp4" podUID="b14ce8d1-3df8-4b0c-b255-a3e5bafe232b" May 20 21:48:11.501714 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.501530 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 20 21:48:11.501714 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.501552 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 20 21:48:11.501714 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.501559 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 20 21:48:11.501896 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.501814 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dhls5\"" May 20 21:48:11.502105 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.502076 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 20 21:48:11.502534 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.502507 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-75lfq\"" May 20 21:48:11.503276 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.502789 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 20 21:48:11.503276 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.502893 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d549q" May 20 21:48:11.503276 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.503224 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 20 21:48:11.503462 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.503321 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 20 21:48:11.503462 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.503395 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 20 21:48:11.503584 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.503568 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-68728\"" May 20 21:48:11.506407 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.506230 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-grtw4\"" May 20 21:48:11.506407 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.506272 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 20 21:48:11.506551 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.506468 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.506600 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.506549 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 20 21:48:11.507598 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.507579 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:11.507703 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.507611 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-68fgb" May 20 21:48:11.507703 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:11.507663 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbqtt" podUID="ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe" May 20 21:48:11.510556 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.510338 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 20 21:48:11.510556 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.510352 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 20 21:48:11.510556 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.510449 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lgfpl\"" May 20 21:48:11.511790 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.511725 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7btkm\"" May 20 21:48:11.511844 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.511797 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 20 21:48:11.511844 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.511801 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 20 21:48:11.512704 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.512084 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 20 21:48:11.514800 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.514630 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4968fde8-82d9-448f-b530-e5893dd57d62-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pfs4k\" (UID: \"4968fde8-82d9-448f-b530-e5893dd57d62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" May 20 21:48:11.514800 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.514676 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-etc-kubernetes\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.514800 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.514728 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-var-lib-kubelet\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.514800 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.514769 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-ovnkube-config\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.515050 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.514811 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnf4t\" (UniqueName: \"kubernetes.io/projected/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-kube-api-access-fnf4t\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.515050 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.514854 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-etc-kubernetes\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.515050 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.514879 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpq5x\" (UniqueName: \"kubernetes.io/projected/62c85ffa-9e66-41a9-a9b7-a3b21a050834-kube-api-access-fpq5x\") pod \"iptables-alerter-kxb9x\" (UID: \"62c85ffa-9e66-41a9-a9b7-a3b21a050834\") " pod="openshift-network-operator/iptables-alerter-kxb9x" May 20 21:48:11.515050 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.514900 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-host-slash\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.515050 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.514945 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-env-overrides\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.515050 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.514979 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-host-var-lib-cni-multus\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.515050 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515015 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aec000a4-9bb5-43e5-b40a-cfe251c18da5-host\") pod \"node-ca-68fgb\" (UID: \"aec000a4-9bb5-43e5-b40a-cfe251c18da5\") " pod="openshift-image-registry/node-ca-68fgb" May 20 21:48:11.515050 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515039 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-etc-sysconfig\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.515421 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515066 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-node-log\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.515421 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515091 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-ovnkube-script-lib\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.515421 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515138 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6bqf\" (UniqueName: \"kubernetes.io/projected/b14ce8d1-3df8-4b0c-b255-a3e5bafe232b-kube-api-access-w6bqf\") pod \"network-check-target-rcvp4\" (UID: \"b14ce8d1-3df8-4b0c-b255-a3e5bafe232b\") " pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:11.515421 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515167 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cs9l\" (UniqueName: \"kubernetes.io/projected/28a7dd6d-170c-416f-95dc-24a6280778e7-kube-api-access-6cs9l\") pod \"multus-additional-cni-plugins-76n7v\" (UID: \"28a7dd6d-170c-416f-95dc-24a6280778e7\") " pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.515421 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515191 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-tmp\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.515421 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515216 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-host-cni-bin\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.515421 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515241 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-752xm\" (UniqueName: \"kubernetes.io/projected/b785e9ea-de17-443e-b54a-ca50c16abeb6-kube-api-access-752xm\") pod \"network-metrics-daemon-hdgzt\" (UID: \"b785e9ea-de17-443e-b54a-ca50c16abeb6\") " pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:11.515421 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515264 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/62c85ffa-9e66-41a9-a9b7-a3b21a050834-iptables-alerter-script\") pod \"iptables-alerter-kxb9x\" (UID: \"62c85ffa-9e66-41a9-a9b7-a3b21a050834\") " pod="openshift-network-operator/iptables-alerter-kxb9x" May 20 21:48:11.515421 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515287 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-host-kubelet\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.515421 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515309 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-cnibin\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.515421 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515374 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-host-var-lib-cni-bin\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.515421 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515400 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-multus-conf-dir\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.515421 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515426 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnjzn\" (UniqueName: \"kubernetes.io/projected/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-kube-api-access-mnjzn\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.516122 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515453 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9p2q\" (UniqueName: \"kubernetes.io/projected/4968fde8-82d9-448f-b530-e5893dd57d62-kube-api-access-b9p2q\") pod \"aws-ebs-csi-driver-node-pfs4k\" (UID: \"4968fde8-82d9-448f-b530-e5893dd57d62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" May 20 21:48:11.516122 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515477 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/28a7dd6d-170c-416f-95dc-24a6280778e7-os-release\") pod \"multus-additional-cni-plugins-76n7v\" (UID: \"28a7dd6d-170c-416f-95dc-24a6280778e7\") " pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.516122 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515505 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-log-socket\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.516122 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515528 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-host-run-k8s-cni-cncf-io\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.516122 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515552 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aec000a4-9bb5-43e5-b40a-cfe251c18da5-serviceca\") pod \"node-ca-68fgb\" (UID: \"aec000a4-9bb5-43e5-b40a-cfe251c18da5\") " pod="openshift-image-registry/node-ca-68fgb" May 20 21:48:11.516122 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515575 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs\") pod \"network-metrics-daemon-hdgzt\" (UID: \"b785e9ea-de17-443e-b54a-ca50c16abeb6\") " pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:11.516122 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515601 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4968fde8-82d9-448f-b530-e5893dd57d62-registration-dir\") pod \"aws-ebs-csi-driver-node-pfs4k\" (UID: \"4968fde8-82d9-448f-b530-e5893dd57d62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" May 20 21:48:11.516122 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515625 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28a7dd6d-170c-416f-95dc-24a6280778e7-system-cni-dir\") pod \"multus-additional-cni-plugins-76n7v\" (UID: \"28a7dd6d-170c-416f-95dc-24a6280778e7\") " pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.516122 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515670 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/28a7dd6d-170c-416f-95dc-24a6280778e7-cni-binary-copy\") pod \"multus-additional-cni-plugins-76n7v\" (UID: \"28a7dd6d-170c-416f-95dc-24a6280778e7\") " pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.516122 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515728 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/28a7dd6d-170c-416f-95dc-24a6280778e7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-76n7v\" (UID: \"28a7dd6d-170c-416f-95dc-24a6280778e7\") " pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.516122 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515755 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-run-ovn\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.516122 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515783 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-system-cni-dir\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.516122 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515807 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/05e755d7-426f-4016-96a8-c1593d299301-agent-certs\") pod \"konnectivity-agent-d549q\" (UID: \"05e755d7-426f-4016-96a8-c1593d299301\") " pod="kube-system/konnectivity-agent-d549q" May 20 21:48:11.516122 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515895 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/28a7dd6d-170c-416f-95dc-24a6280778e7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-76n7v\" (UID: \"28a7dd6d-170c-416f-95dc-24a6280778e7\") " pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.516122 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515923 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-host-run-netns\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.516122 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515955 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62c85ffa-9e66-41a9-a9b7-a3b21a050834-host-slash\") pod \"iptables-alerter-kxb9x\" (UID: \"62c85ffa-9e66-41a9-a9b7-a3b21a050834\") " pod="openshift-network-operator/iptables-alerter-kxb9x" May 20 21:48:11.516897 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.515998 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-systemd-units\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.516897 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.516035 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.516897 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.516063 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-host-run-netns\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.516897 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.516089 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpms2\" (UniqueName: \"kubernetes.io/projected/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-kube-api-access-bpms2\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.517084 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.516928 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-multus-cni-dir\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.517084 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.516964 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-cni-binary-copy\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.517084 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517020 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf000cdd-dfa0-43d2-9df8-84baf9a14af4-tmp-dir\") pod \"node-resolver-6wwrr\" (UID: \"cf000cdd-dfa0-43d2-9df8-84baf9a14af4\") " pod="openshift-dns/node-resolver-6wwrr" May 20 21:48:11.517084 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517050 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-run\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.517084 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517075 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-host-cni-netd\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.517358 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517101 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.517358 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517126 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-multus-daemon-config\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.517358 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517162 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s9jz\" (UniqueName: \"kubernetes.io/projected/aec000a4-9bb5-43e5-b40a-cfe251c18da5-kube-api-access-7s9jz\") pod \"node-ca-68fgb\" (UID: \"aec000a4-9bb5-43e5-b40a-cfe251c18da5\") " pod="openshift-image-registry/node-ca-68fgb" May 20 21:48:11.517358 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517192 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-host\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.517358 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517215 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-etc-tuned\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.517358 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517238 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-run-openvswitch\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.517358 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517260 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-os-release\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.517358 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517279 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4968fde8-82d9-448f-b530-e5893dd57d62-socket-dir\") pod \"aws-ebs-csi-driver-node-pfs4k\" (UID: \"4968fde8-82d9-448f-b530-e5893dd57d62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" May 20 21:48:11.517358 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517302 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4968fde8-82d9-448f-b530-e5893dd57d62-device-dir\") pod \"aws-ebs-csi-driver-node-pfs4k\" (UID: \"4968fde8-82d9-448f-b530-e5893dd57d62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" May 20 21:48:11.517358 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517337 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/28a7dd6d-170c-416f-95dc-24a6280778e7-cnibin\") pod \"multus-additional-cni-plugins-76n7v\" (UID: \"28a7dd6d-170c-416f-95dc-24a6280778e7\") " pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.517798 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517364 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/28a7dd6d-170c-416f-95dc-24a6280778e7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-76n7v\" (UID: \"28a7dd6d-170c-416f-95dc-24a6280778e7\") " pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.517798 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517391 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cf000cdd-dfa0-43d2-9df8-84baf9a14af4-hosts-file\") pod \"node-resolver-6wwrr\" (UID: \"cf000cdd-dfa0-43d2-9df8-84baf9a14af4\") " pod="openshift-dns/node-resolver-6wwrr" May 20 21:48:11.517798 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517429 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-etc-modprobe-d\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.517798 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517451 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-etc-systemd\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.517798 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517473 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-host-run-multus-certs\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.517798 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517502 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-run-systemd\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.517798 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517525 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-etc-sysctl-d\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.517798 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517547 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-var-lib-openvswitch\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.517798 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517576 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-host-var-lib-kubelet\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.517798 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517611 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4968fde8-82d9-448f-b530-e5893dd57d62-etc-selinux\") pod \"aws-ebs-csi-driver-node-pfs4k\" (UID: \"4968fde8-82d9-448f-b530-e5893dd57d62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" May 20 21:48:11.517798 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517653 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-hostroot\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.517798 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517680 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4968fde8-82d9-448f-b530-e5893dd57d62-sys-fs\") pod \"aws-ebs-csi-driver-node-pfs4k\" (UID: \"4968fde8-82d9-448f-b530-e5893dd57d62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" May 20 21:48:11.517798 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517702 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-sys\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.517798 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517725 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-etc-openvswitch\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.517798 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517749 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-multus-socket-dir-parent\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.517798 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517773 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/05e755d7-426f-4016-96a8-c1593d299301-konnectivity-ca\") pod \"konnectivity-agent-d549q\" (UID: \"05e755d7-426f-4016-96a8-c1593d299301\") " pod="kube-system/konnectivity-agent-d549q" May 20 21:48:11.518449 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517807 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl5b6\" (UniqueName: \"kubernetes.io/projected/cf000cdd-dfa0-43d2-9df8-84baf9a14af4-kube-api-access-gl5b6\") pod \"node-resolver-6wwrr\" (UID: \"cf000cdd-dfa0-43d2-9df8-84baf9a14af4\") " pod="openshift-dns/node-resolver-6wwrr" May 20 21:48:11.518449 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517837 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-etc-sysctl-conf\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.518449 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517855 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-lib-modules\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.518449 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.517876 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-ovn-node-metrics-cert\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.582062 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.582028 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 21:43:10 +0000 UTC" deadline="2027-10-27 23:32:21.538795109 +0000 UTC" May 20 21:48:11.582062 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.582059 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12601h44m9.956739312s" May 20 21:48:11.604966 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.604943 2571 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 20 21:48:11.618063 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618035 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf000cdd-dfa0-43d2-9df8-84baf9a14af4-tmp-dir\") pod \"node-resolver-6wwrr\" (UID: \"cf000cdd-dfa0-43d2-9df8-84baf9a14af4\") " pod="openshift-dns/node-resolver-6wwrr" May 20 21:48:11.618175 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618074 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-run\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.618175 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618098 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-host-cni-netd\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.618175 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618122 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.618175 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618144 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-multus-daemon-config\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.618175 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618161 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-run\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.618175 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618170 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7s9jz\" (UniqueName: \"kubernetes.io/projected/aec000a4-9bb5-43e5-b40a-cfe251c18da5-kube-api-access-7s9jz\") pod \"node-ca-68fgb\" (UID: \"aec000a4-9bb5-43e5-b40a-cfe251c18da5\") " pod="openshift-image-registry/node-ca-68fgb" May 20 21:48:11.618466 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618192 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-host\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.618466 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618219 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-etc-tuned\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.618466 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618222 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-host-cni-netd\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.618466 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618242 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-run-openvswitch\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.618466 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618228 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.618466 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618288 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-os-release\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.618466 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618315 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-host\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.618466 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618346 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4968fde8-82d9-448f-b530-e5893dd57d62-socket-dir\") pod \"aws-ebs-csi-driver-node-pfs4k\" (UID: \"4968fde8-82d9-448f-b530-e5893dd57d62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" May 20 21:48:11.618466 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618378 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4968fde8-82d9-448f-b530-e5893dd57d62-device-dir\") pod \"aws-ebs-csi-driver-node-pfs4k\" (UID: \"4968fde8-82d9-448f-b530-e5893dd57d62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" May 20 21:48:11.618466 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618386 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf000cdd-dfa0-43d2-9df8-84baf9a14af4-tmp-dir\") pod \"node-resolver-6wwrr\" (UID: \"cf000cdd-dfa0-43d2-9df8-84baf9a14af4\") " pod="openshift-dns/node-resolver-6wwrr" May 20 21:48:11.618466 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618406 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/28a7dd6d-170c-416f-95dc-24a6280778e7-cnibin\") pod \"multus-additional-cni-plugins-76n7v\" (UID: \"28a7dd6d-170c-416f-95dc-24a6280778e7\") " pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.618466 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618423 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-os-release\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.618466 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618425 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-run-openvswitch\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.618466 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618461 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4968fde8-82d9-448f-b530-e5893dd57d62-device-dir\") pod \"aws-ebs-csi-driver-node-pfs4k\" (UID: \"4968fde8-82d9-448f-b530-e5893dd57d62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" May 20 21:48:11.619120 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618502 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/28a7dd6d-170c-416f-95dc-24a6280778e7-cnibin\") pod \"multus-additional-cni-plugins-76n7v\" (UID: \"28a7dd6d-170c-416f-95dc-24a6280778e7\") " pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.619120 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618531 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/28a7dd6d-170c-416f-95dc-24a6280778e7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-76n7v\" (UID: \"28a7dd6d-170c-416f-95dc-24a6280778e7\") " pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.619120 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618550 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4968fde8-82d9-448f-b530-e5893dd57d62-socket-dir\") pod \"aws-ebs-csi-driver-node-pfs4k\" (UID: \"4968fde8-82d9-448f-b530-e5893dd57d62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" May 20 21:48:11.619120 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618559 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cf000cdd-dfa0-43d2-9df8-84baf9a14af4-hosts-file\") pod \"node-resolver-6wwrr\" (UID: \"cf000cdd-dfa0-43d2-9df8-84baf9a14af4\") " pod="openshift-dns/node-resolver-6wwrr" May 20 21:48:11.619120 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618583 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-etc-modprobe-d\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.619120 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618605 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-etc-systemd\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.619120 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618619 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cf000cdd-dfa0-43d2-9df8-84baf9a14af4-hosts-file\") pod \"node-resolver-6wwrr\" (UID: \"cf000cdd-dfa0-43d2-9df8-84baf9a14af4\") " pod="openshift-dns/node-resolver-6wwrr" May 20 21:48:11.619120 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618629 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-host-run-multus-certs\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.619120 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618670 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-run-systemd\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.619120 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618678 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/28a7dd6d-170c-416f-95dc-24a6280778e7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-76n7v\" (UID: \"28a7dd6d-170c-416f-95dc-24a6280778e7\") " pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.619120 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618690 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-etc-sysctl-d\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.619120 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618710 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-host-run-multus-certs\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.619120 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618732 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-var-lib-openvswitch\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.619120 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618749 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-run-systemd\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.619120 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618756 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-host-var-lib-kubelet\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.619120 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618765 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-etc-modprobe-d\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.619120 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618783 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4968fde8-82d9-448f-b530-e5893dd57d62-etc-selinux\") pod \"aws-ebs-csi-driver-node-pfs4k\" (UID: \"4968fde8-82d9-448f-b530-e5893dd57d62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" May 20 21:48:11.619903 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618811 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-hostroot\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.619903 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618814 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-host-var-lib-kubelet\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.619903 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618820 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-etc-sysctl-d\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.619903 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618785 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-var-lib-openvswitch\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.619903 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618820 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-etc-systemd\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.619903 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618834 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4968fde8-82d9-448f-b530-e5893dd57d62-sys-fs\") pod \"aws-ebs-csi-driver-node-pfs4k\" (UID: \"4968fde8-82d9-448f-b530-e5893dd57d62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" May 20 21:48:11.619903 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618867 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-hostroot\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.619903 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618874 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-original-pull-secret\") pod \"global-pull-secret-syncer-cbqtt\" (UID: \"ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe\") " pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:11.619903 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618879 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4968fde8-82d9-448f-b530-e5893dd57d62-sys-fs\") pod \"aws-ebs-csi-driver-node-pfs4k\" (UID: \"4968fde8-82d9-448f-b530-e5893dd57d62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" May 20 21:48:11.619903 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618894 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4968fde8-82d9-448f-b530-e5893dd57d62-etc-selinux\") pod \"aws-ebs-csi-driver-node-pfs4k\" (UID: \"4968fde8-82d9-448f-b530-e5893dd57d62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" May 20 21:48:11.619903 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618901 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-sys\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.619903 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618924 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-sys\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.619903 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618938 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-etc-openvswitch\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.619903 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618968 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-multus-socket-dir-parent\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.619903 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618991 2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 20 21:48:11.619903 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619027 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-etc-openvswitch\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.619903 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.618995 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/05e755d7-426f-4016-96a8-c1593d299301-konnectivity-ca\") pod \"konnectivity-agent-d549q\" (UID: \"05e755d7-426f-4016-96a8-c1593d299301\") " pod="kube-system/konnectivity-agent-d549q" May 20 21:48:11.619903 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619061 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-multus-socket-dir-parent\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.620736 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619031 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-multus-daemon-config\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.620736 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619083 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gl5b6\" (UniqueName: \"kubernetes.io/projected/cf000cdd-dfa0-43d2-9df8-84baf9a14af4-kube-api-access-gl5b6\") pod \"node-resolver-6wwrr\" (UID: \"cf000cdd-dfa0-43d2-9df8-84baf9a14af4\") " pod="openshift-dns/node-resolver-6wwrr" May 20 21:48:11.620736 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619112 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-etc-sysctl-conf\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.620736 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619136 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-lib-modules\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.620736 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619162 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-ovn-node-metrics-cert\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.620736 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619187 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4968fde8-82d9-448f-b530-e5893dd57d62-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pfs4k\" (UID: \"4968fde8-82d9-448f-b530-e5893dd57d62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" May 20 21:48:11.620736 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619221 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-etc-kubernetes\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.620736 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619244 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-var-lib-kubelet\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.620736 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619261 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-etc-sysctl-conf\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.620736 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619269 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-lib-modules\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.620736 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619268 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-ovnkube-config\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.620736 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619313 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fnf4t\" (UniqueName: \"kubernetes.io/projected/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-kube-api-access-fnf4t\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.620736 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619339 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-etc-kubernetes\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.620736 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619361 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-etc-kubernetes\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.620736 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619365 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fpq5x\" (UniqueName: \"kubernetes.io/projected/62c85ffa-9e66-41a9-a9b7-a3b21a050834-kube-api-access-fpq5x\") pod \"iptables-alerter-kxb9x\" (UID: \"62c85ffa-9e66-41a9-a9b7-a3b21a050834\") " pod="openshift-network-operator/iptables-alerter-kxb9x" May 20 21:48:11.620736 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619413 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-host-slash\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.620736 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619441 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-env-overrides\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.621535 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619471 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/05e755d7-426f-4016-96a8-c1593d299301-konnectivity-ca\") pod \"konnectivity-agent-d549q\" (UID: \"05e755d7-426f-4016-96a8-c1593d299301\") " pod="kube-system/konnectivity-agent-d549q" May 20 21:48:11.621535 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619475 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-host-var-lib-cni-multus\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.621535 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619509 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-host-var-lib-cni-multus\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.621535 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619518 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aec000a4-9bb5-43e5-b40a-cfe251c18da5-host\") pod \"node-ca-68fgb\" (UID: \"aec000a4-9bb5-43e5-b40a-cfe251c18da5\") " pod="openshift-image-registry/node-ca-68fgb" May 20 21:48:11.621535 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619540 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-etc-sysconfig\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.621535 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619549 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-host-slash\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.621535 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619560 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-node-log\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.621535 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619581 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-ovnkube-script-lib\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.621535 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619622 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6bqf\" (UniqueName: \"kubernetes.io/projected/b14ce8d1-3df8-4b0c-b255-a3e5bafe232b-kube-api-access-w6bqf\") pod \"network-check-target-rcvp4\" (UID: \"b14ce8d1-3df8-4b0c-b255-a3e5bafe232b\") " pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:11.621535 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619662 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6cs9l\" (UniqueName: \"kubernetes.io/projected/28a7dd6d-170c-416f-95dc-24a6280778e7-kube-api-access-6cs9l\") pod \"multus-additional-cni-plugins-76n7v\" (UID: \"28a7dd6d-170c-416f-95dc-24a6280778e7\") " pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.621535 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619684 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-tmp\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.621535 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619703 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-host-cni-bin\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.621535 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619723 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-752xm\" (UniqueName: \"kubernetes.io/projected/b785e9ea-de17-443e-b54a-ca50c16abeb6-kube-api-access-752xm\") pod \"network-metrics-daemon-hdgzt\" (UID: \"b785e9ea-de17-443e-b54a-ca50c16abeb6\") " pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:11.621535 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619746 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-dbus\") pod \"global-pull-secret-syncer-cbqtt\" (UID: \"ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe\") " pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:11.621535 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619769 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/62c85ffa-9e66-41a9-a9b7-a3b21a050834-iptables-alerter-script\") pod \"iptables-alerter-kxb9x\" (UID: \"62c85ffa-9e66-41a9-a9b7-a3b21a050834\") " pod="openshift-network-operator/iptables-alerter-kxb9x" May 20 21:48:11.621535 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619792 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-etc-kubernetes\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.621535 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619793 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-host-kubelet\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.622412 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619835 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-cnibin\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.622412 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619859 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-host-var-lib-cni-bin\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.622412 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619833 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-host-kubelet\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.622412 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619883 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-multus-conf-dir\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.622412 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619883 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-ovnkube-config\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.622412 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619908 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mnjzn\" (UniqueName: \"kubernetes.io/projected/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-kube-api-access-mnjzn\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.622412 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619917 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aec000a4-9bb5-43e5-b40a-cfe251c18da5-host\") pod \"node-ca-68fgb\" (UID: \"aec000a4-9bb5-43e5-b40a-cfe251c18da5\") " pod="openshift-image-registry/node-ca-68fgb" May 20 21:48:11.622412 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619928 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b9p2q\" (UniqueName: \"kubernetes.io/projected/4968fde8-82d9-448f-b530-e5893dd57d62-kube-api-access-b9p2q\") pod \"aws-ebs-csi-driver-node-pfs4k\" (UID: \"4968fde8-82d9-448f-b530-e5893dd57d62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" May 20 21:48:11.622412 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619953 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/28a7dd6d-170c-416f-95dc-24a6280778e7-os-release\") pod \"multus-additional-cni-plugins-76n7v\" (UID: \"28a7dd6d-170c-416f-95dc-24a6280778e7\") " pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.622412 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619954 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-env-overrides\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.622412 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619965 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-etc-sysconfig\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.622412 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619977 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-log-socket\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.622412 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620004 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-host-run-k8s-cni-cncf-io\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.622412 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620016 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-node-log\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.622412 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620021 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-cnibin\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.622412 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620056 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-host-var-lib-cni-bin\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.622412 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.619955 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4968fde8-82d9-448f-b530-e5893dd57d62-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pfs4k\" (UID: \"4968fde8-82d9-448f-b530-e5893dd57d62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" May 20 21:48:11.622412 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620095 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aec000a4-9bb5-43e5-b40a-cfe251c18da5-serviceca\") pod \"node-ca-68fgb\" (UID: \"aec000a4-9bb5-43e5-b40a-cfe251c18da5\") " pod="openshift-image-registry/node-ca-68fgb" May 20 21:48:11.623282 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620123 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs\") pod \"network-metrics-daemon-hdgzt\" (UID: \"b785e9ea-de17-443e-b54a-ca50c16abeb6\") " pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:11.623282 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620126 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-var-lib-kubelet\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.623282 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620157 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4968fde8-82d9-448f-b530-e5893dd57d62-registration-dir\") pod \"aws-ebs-csi-driver-node-pfs4k\" (UID: \"4968fde8-82d9-448f-b530-e5893dd57d62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" May 20 21:48:11.623282 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620188 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28a7dd6d-170c-416f-95dc-24a6280778e7-system-cni-dir\") pod \"multus-additional-cni-plugins-76n7v\" (UID: \"28a7dd6d-170c-416f-95dc-24a6280778e7\") " pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.623282 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:11.620196 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:11.623282 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620211 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-host-cni-bin\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.623282 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620249 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-multus-conf-dir\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.623282 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620295 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/28a7dd6d-170c-416f-95dc-24a6280778e7-cni-binary-copy\") pod \"multus-additional-cni-plugins-76n7v\" (UID: \"28a7dd6d-170c-416f-95dc-24a6280778e7\") " pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.623282 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620322 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/28a7dd6d-170c-416f-95dc-24a6280778e7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-76n7v\" (UID: \"28a7dd6d-170c-416f-95dc-24a6280778e7\") " pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.623282 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620367 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-run-ovn\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.623282 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620392 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-system-cni-dir\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.623282 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620419 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/05e755d7-426f-4016-96a8-c1593d299301-agent-certs\") pod \"konnectivity-agent-d549q\" (UID: \"05e755d7-426f-4016-96a8-c1593d299301\") " pod="kube-system/konnectivity-agent-d549q" May 20 21:48:11.623282 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620447 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/28a7dd6d-170c-416f-95dc-24a6280778e7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-76n7v\" (UID: \"28a7dd6d-170c-416f-95dc-24a6280778e7\") " pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.623282 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620469 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4968fde8-82d9-448f-b530-e5893dd57d62-registration-dir\") pod \"aws-ebs-csi-driver-node-pfs4k\" (UID: \"4968fde8-82d9-448f-b530-e5893dd57d62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" May 20 21:48:11.623282 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620485 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-ovnkube-script-lib\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.623282 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620543 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28a7dd6d-170c-416f-95dc-24a6280778e7-system-cni-dir\") pod \"multus-additional-cni-plugins-76n7v\" (UID: \"28a7dd6d-170c-416f-95dc-24a6280778e7\") " pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.623282 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:11.620663 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs podName:b785e9ea-de17-443e-b54a-ca50c16abeb6 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:12.120591051 +0000 UTC m=+3.050407774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs") pod "network-metrics-daemon-hdgzt" (UID: "b785e9ea-de17-443e-b54a-ca50c16abeb6") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:11.623916 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620702 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-log-socket\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.623916 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620760 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/28a7dd6d-170c-416f-95dc-24a6280778e7-os-release\") pod \"multus-additional-cni-plugins-76n7v\" (UID: \"28a7dd6d-170c-416f-95dc-24a6280778e7\") " pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.623916 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620775 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/62c85ffa-9e66-41a9-a9b7-a3b21a050834-iptables-alerter-script\") pod \"iptables-alerter-kxb9x\" (UID: \"62c85ffa-9e66-41a9-a9b7-a3b21a050834\") " pod="openshift-network-operator/iptables-alerter-kxb9x" May 20 21:48:11.623916 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620471 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-host-run-netns\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.623916 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620958 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-host-run-k8s-cni-cncf-io\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.623916 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.620981 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/28a7dd6d-170c-416f-95dc-24a6280778e7-cni-binary-copy\") pod \"multus-additional-cni-plugins-76n7v\" (UID: \"28a7dd6d-170c-416f-95dc-24a6280778e7\") " pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.623916 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.621035 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62c85ffa-9e66-41a9-a9b7-a3b21a050834-host-slash\") pod \"iptables-alerter-kxb9x\" (UID: \"62c85ffa-9e66-41a9-a9b7-a3b21a050834\") " pod="openshift-network-operator/iptables-alerter-kxb9x" May 20 21:48:11.623916 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.621049 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-system-cni-dir\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.623916 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.621064 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-systemd-units\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.623916 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.621082 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-host-run-netns\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.623916 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.621092 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.623916 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.621102 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aec000a4-9bb5-43e5-b40a-cfe251c18da5-serviceca\") pod \"node-ca-68fgb\" (UID: \"aec000a4-9bb5-43e5-b40a-cfe251c18da5\") " pod="openshift-image-registry/node-ca-68fgb" May 20 21:48:11.623916 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.621303 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-kubelet-config\") pod \"global-pull-secret-syncer-cbqtt\" (UID: \"ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe\") " pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:11.623916 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.621334 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-host-run-netns\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.623916 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.621370 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bpms2\" (UniqueName: \"kubernetes.io/projected/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-kube-api-access-bpms2\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.623916 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.621399 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-multus-cni-dir\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.623916 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.621426 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-cni-binary-copy\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.624516 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.621486 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/28a7dd6d-170c-416f-95dc-24a6280778e7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-76n7v\" (UID: \"28a7dd6d-170c-416f-95dc-24a6280778e7\") " pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.624516 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.621507 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.624516 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.621542 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-host-run-netns\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.624516 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.621834 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-multus-cni-dir\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.624516 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.621907 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/28a7dd6d-170c-416f-95dc-24a6280778e7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-76n7v\" (UID: \"28a7dd6d-170c-416f-95dc-24a6280778e7\") " pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.624516 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.621960 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-run-ovn\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.624516 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.621996 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62c85ffa-9e66-41a9-a9b7-a3b21a050834-host-slash\") pod \"iptables-alerter-kxb9x\" (UID: \"62c85ffa-9e66-41a9-a9b7-a3b21a050834\") " pod="openshift-network-operator/iptables-alerter-kxb9x" May 20 21:48:11.624516 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.622041 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-systemd-units\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.624516 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.622714 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-cni-binary-copy\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.624516 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.622714 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-ovn-node-metrics-cert\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.624516 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.623108 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-etc-tuned\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.624516 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.623268 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-tmp\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.624516 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.623535 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/05e755d7-426f-4016-96a8-c1593d299301-agent-certs\") pod \"konnectivity-agent-d549q\" (UID: \"05e755d7-426f-4016-96a8-c1593d299301\") " pod="kube-system/konnectivity-agent-d549q" May 20 21:48:11.627533 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:11.626840 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 21:48:11.627533 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:11.626875 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 21:48:11.627533 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:11.626889 2571 projected.go:194] Error preparing data for projected volume kube-api-access-w6bqf for pod openshift-network-diagnostics/network-check-target-rcvp4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:11.627533 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:11.626963 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b14ce8d1-3df8-4b0c-b255-a3e5bafe232b-kube-api-access-w6bqf podName:b14ce8d1-3df8-4b0c-b255-a3e5bafe232b nodeName:}" failed. No retries permitted until 2026-05-20 21:48:12.126944712 +0000 UTC m=+3.056761453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-w6bqf" (UniqueName: "kubernetes.io/projected/b14ce8d1-3df8-4b0c-b255-a3e5bafe232b-kube-api-access-w6bqf") pod "network-check-target-rcvp4" (UID: "b14ce8d1-3df8-4b0c-b255-a3e5bafe232b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:11.628856 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.628831 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s9jz\" (UniqueName: \"kubernetes.io/projected/aec000a4-9bb5-43e5-b40a-cfe251c18da5-kube-api-access-7s9jz\") pod \"node-ca-68fgb\" (UID: \"aec000a4-9bb5-43e5-b40a-cfe251c18da5\") " pod="openshift-image-registry/node-ca-68fgb" May 20 21:48:11.629661 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.629589 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl5b6\" (UniqueName: \"kubernetes.io/projected/cf000cdd-dfa0-43d2-9df8-84baf9a14af4-kube-api-access-gl5b6\") pod \"node-resolver-6wwrr\" (UID: \"cf000cdd-dfa0-43d2-9df8-84baf9a14af4\") " pod="openshift-dns/node-resolver-6wwrr" May 20 21:48:11.630700 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.630605 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpq5x\" (UniqueName: \"kubernetes.io/projected/62c85ffa-9e66-41a9-a9b7-a3b21a050834-kube-api-access-fpq5x\") pod \"iptables-alerter-kxb9x\" (UID: \"62c85ffa-9e66-41a9-a9b7-a3b21a050834\") " pod="openshift-network-operator/iptables-alerter-kxb9x" May 20 21:48:11.632515 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.632488 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9p2q\" (UniqueName: \"kubernetes.io/projected/4968fde8-82d9-448f-b530-e5893dd57d62-kube-api-access-b9p2q\") pod \"aws-ebs-csi-driver-node-pfs4k\" (UID: \"4968fde8-82d9-448f-b530-e5893dd57d62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" May 20 21:48:11.634057 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.634012 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cs9l\" (UniqueName: \"kubernetes.io/projected/28a7dd6d-170c-416f-95dc-24a6280778e7-kube-api-access-6cs9l\") pod \"multus-additional-cni-plugins-76n7v\" (UID: \"28a7dd6d-170c-416f-95dc-24a6280778e7\") " pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.634685 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.634625 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-752xm\" (UniqueName: \"kubernetes.io/projected/b785e9ea-de17-443e-b54a-ca50c16abeb6-kube-api-access-752xm\") pod \"network-metrics-daemon-hdgzt\" (UID: \"b785e9ea-de17-443e-b54a-ca50c16abeb6\") " pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:11.635136 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.635118 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnjzn\" (UniqueName: \"kubernetes.io/projected/d8a62d5e-8a30-41db-ba35-c34cf1c2e56d-kube-api-access-mnjzn\") pod \"multus-dn8hq\" (UID: \"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d\") " pod="openshift-multus/multus-dn8hq" May 20 21:48:11.635210 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.635136 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpms2\" (UniqueName: \"kubernetes.io/projected/8d148f13-1e0a-4f0d-9e34-69829d0e3a61-kube-api-access-bpms2\") pod \"tuned-82r6j\" (UID: \"8d148f13-1e0a-4f0d-9e34-69829d0e3a61\") " pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.635615 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.635595 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnf4t\" (UniqueName: \"kubernetes.io/projected/a06608b6-fae0-4a42-a0c6-98d3f9cec1b0-kube-api-access-fnf4t\") pod \"ovnkube-node-shgjs\" (UID: \"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.722450 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.722420 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-dbus\") pod \"global-pull-secret-syncer-cbqtt\" (UID: \"ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe\") " pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:11.722619 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.722464 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-kubelet-config\") pod \"global-pull-secret-syncer-cbqtt\" (UID: \"ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe\") " pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:11.722619 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.722529 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-kubelet-config\") pod \"global-pull-secret-syncer-cbqtt\" (UID: \"ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe\") " pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:11.722619 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.722559 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-original-pull-secret\") pod \"global-pull-secret-syncer-cbqtt\" (UID: \"ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe\") " pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:11.722619 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.722596 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-dbus\") pod \"global-pull-secret-syncer-cbqtt\" (UID: \"ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe\") " pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:11.722832 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:11.722652 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 21:48:11.722832 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:11.722694 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-original-pull-secret podName:ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe nodeName:}" failed. No retries permitted until 2026-05-20 21:48:12.222681433 +0000 UTC m=+3.152498157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-original-pull-secret") pod "global-pull-secret-syncer-cbqtt" (UID: "ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe") : object "kube-system"/"original-pull-secret" not registered May 20 21:48:11.805887 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.805811 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6wwrr" May 20 21:48:11.816742 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.816709 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dn8hq" May 20 21:48:11.826363 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.826338 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kxb9x" May 20 21:48:11.831958 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.831938 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-82r6j" May 20 21:48:11.839594 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.839569 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:11.845195 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.845176 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" May 20 21:48:11.852738 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.852719 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d549q" May 20 21:48:11.859192 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.859175 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-76n7v" May 20 21:48:11.863695 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.863679 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-68fgb" May 20 21:48:11.951840 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:11.951809 2571 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 20 21:48:12.125559 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:12.125523 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs\") pod \"network-metrics-daemon-hdgzt\" (UID: \"b785e9ea-de17-443e-b54a-ca50c16abeb6\") " pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:12.125755 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:12.125709 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:12.125810 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:12.125779 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs podName:b785e9ea-de17-443e-b54a-ca50c16abeb6 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:13.125763274 +0000 UTC m=+4.055579994 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs") pod "network-metrics-daemon-hdgzt" (UID: "b785e9ea-de17-443e-b54a-ca50c16abeb6") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:12.203676 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:12.203633 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62c85ffa_9e66_41a9_a9b7_a3b21a050834.slice/crio-6117b075bab74222d739a19b84e8fe30e5a638aafdf095041f0ec1bba1d492c2 WatchSource:0}: Error finding container 6117b075bab74222d739a19b84e8fe30e5a638aafdf095041f0ec1bba1d492c2: Status 404 returned error can't find the container with id 6117b075bab74222d739a19b84e8fe30e5a638aafdf095041f0ec1bba1d492c2 May 20 21:48:12.206789 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:12.206700 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d148f13_1e0a_4f0d_9e34_69829d0e3a61.slice/crio-543d824e3a63e04ec2726d257794072bda796ee92e599a2817092e0135cc5ce7 WatchSource:0}: Error finding container 543d824e3a63e04ec2726d257794072bda796ee92e599a2817092e0135cc5ce7: Status 404 returned error can't find the container with id 543d824e3a63e04ec2726d257794072bda796ee92e599a2817092e0135cc5ce7 May 20 21:48:12.209970 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:12.209950 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf000cdd_dfa0_43d2_9df8_84baf9a14af4.slice/crio-138685050f610ca7706dcca8f5296e39007e6a450825fc01e623bb790f0b03f2 WatchSource:0}: Error finding container 138685050f610ca7706dcca8f5296e39007e6a450825fc01e623bb790f0b03f2: Status 404 returned error can't find the container with id 138685050f610ca7706dcca8f5296e39007e6a450825fc01e623bb790f0b03f2 May 20 21:48:12.210505 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:12.210482 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28a7dd6d_170c_416f_95dc_24a6280778e7.slice/crio-4faf1497a6fd04d4134da27291f47248d9537dc28d4072e38594ab9d59b9b7f6 WatchSource:0}: Error finding container 4faf1497a6fd04d4134da27291f47248d9537dc28d4072e38594ab9d59b9b7f6: Status 404 returned error can't find the container with id 4faf1497a6fd04d4134da27291f47248d9537dc28d4072e38594ab9d59b9b7f6 May 20 21:48:12.211926 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:12.211765 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8a62d5e_8a30_41db_ba35_c34cf1c2e56d.slice/crio-4b82b8af0bb93a7d83481de83348026b560cb99b23b9d824f3eb04057e65ace5 WatchSource:0}: Error finding container 4b82b8af0bb93a7d83481de83348026b560cb99b23b9d824f3eb04057e65ace5: Status 404 returned error can't find the container with id 4b82b8af0bb93a7d83481de83348026b560cb99b23b9d824f3eb04057e65ace5 May 20 21:48:12.212587 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:12.212567 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda06608b6_fae0_4a42_a0c6_98d3f9cec1b0.slice/crio-7042bca5aae57610c77de820effb22562d82b72c41fdc35c8a931e0b6f6a59bd WatchSource:0}: Error finding container 7042bca5aae57610c77de820effb22562d82b72c41fdc35c8a931e0b6f6a59bd: Status 404 returned error can't find the container with id 7042bca5aae57610c77de820effb22562d82b72c41fdc35c8a931e0b6f6a59bd May 20 21:48:12.214910 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:12.214890 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05e755d7_426f_4016_96a8_c1593d299301.slice/crio-e193f7c42195e83a461514e0daf086c6a2f7bd13fea434ad9992cdb67cde5b93 WatchSource:0}: Error finding container e193f7c42195e83a461514e0daf086c6a2f7bd13fea434ad9992cdb67cde5b93: Status 404 returned error can't find the container with id e193f7c42195e83a461514e0daf086c6a2f7bd13fea434ad9992cdb67cde5b93 May 20 21:48:12.216298 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:48:12.216265 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4968fde8_82d9_448f_b530_e5893dd57d62.slice/crio-5b3b3bd2a76b6921cb7262b00d392576b3daf43ffdd1fbdfb4238f1a5803e1e5 WatchSource:0}: Error finding container 5b3b3bd2a76b6921cb7262b00d392576b3daf43ffdd1fbdfb4238f1a5803e1e5: Status 404 returned error can't find the container with id 5b3b3bd2a76b6921cb7262b00d392576b3daf43ffdd1fbdfb4238f1a5803e1e5 May 20 21:48:12.226229 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:12.226205 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-original-pull-secret\") pod \"global-pull-secret-syncer-cbqtt\" (UID: \"ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe\") " pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:12.226329 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:12.226253 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6bqf\" (UniqueName: \"kubernetes.io/projected/b14ce8d1-3df8-4b0c-b255-a3e5bafe232b-kube-api-access-w6bqf\") pod \"network-check-target-rcvp4\" (UID: \"b14ce8d1-3df8-4b0c-b255-a3e5bafe232b\") " pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:12.226388 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:12.226339 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 21:48:12.226434 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:12.226400 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-original-pull-secret podName:ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe nodeName:}" failed. No retries permitted until 2026-05-20 21:48:13.226378951 +0000 UTC m=+4.156195675 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-original-pull-secret") pod "global-pull-secret-syncer-cbqtt" (UID: "ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe") : object "kube-system"/"original-pull-secret" not registered May 20 21:48:12.226434 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:12.226399 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 21:48:12.226434 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:12.226426 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 21:48:12.226582 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:12.226473 2571 projected.go:194] Error preparing data for projected volume kube-api-access-w6bqf for pod openshift-network-diagnostics/network-check-target-rcvp4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:12.226582 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:12.226526 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b14ce8d1-3df8-4b0c-b255-a3e5bafe232b-kube-api-access-w6bqf podName:b14ce8d1-3df8-4b0c-b255-a3e5bafe232b nodeName:}" failed. No retries permitted until 2026-05-20 21:48:13.226515205 +0000 UTC m=+4.156331934 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-w6bqf" (UniqueName: "kubernetes.io/projected/b14ce8d1-3df8-4b0c-b255-a3e5bafe232b-kube-api-access-w6bqf") pod "network-check-target-rcvp4" (UID: "b14ce8d1-3df8-4b0c-b255-a3e5bafe232b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:12.582506 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:12.582247 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 21:43:10 +0000 UTC" deadline="2027-12-16 05:42:27.691271947 +0000 UTC" May 20 21:48:12.582506 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:12.582503 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13783h54m15.108774882s" May 20 21:48:12.636803 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:12.636768 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-82r6j" event={"ID":"8d148f13-1e0a-4f0d-9e34-69829d0e3a61","Type":"ContainerStarted","Data":"543d824e3a63e04ec2726d257794072bda796ee92e599a2817092e0135cc5ce7"} May 20 21:48:12.641650 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:12.641609 2571 generic.go:358] "Generic (PLEG): container finished" podID="c7aa3561d957a7f9779d8e4e0783c0ff" containerID="56c13c90012c92268c9ce3457a86f5bc524999dd8c306e67612d6156c3b46a7d" exitCode=0 May 20 21:48:12.641798 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:12.641693 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-24.ec2.internal" event={"ID":"c7aa3561d957a7f9779d8e4e0783c0ff","Type":"ContainerDied","Data":"56c13c90012c92268c9ce3457a86f5bc524999dd8c306e67612d6156c3b46a7d"} May 20 21:48:12.651430 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:12.651402 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-68fgb" event={"ID":"aec000a4-9bb5-43e5-b40a-cfe251c18da5","Type":"ContainerStarted","Data":"15f72b30999b29200fc96fb332fbd0036a0b4fec5857219e911d8553b09b8747"} May 20 21:48:12.659654 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:12.653798 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6wwrr" event={"ID":"cf000cdd-dfa0-43d2-9df8-84baf9a14af4","Type":"ContainerStarted","Data":"138685050f610ca7706dcca8f5296e39007e6a450825fc01e623bb790f0b03f2"} May 20 21:48:12.659654 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:12.658666 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kxb9x" event={"ID":"62c85ffa-9e66-41a9-a9b7-a3b21a050834","Type":"ContainerStarted","Data":"6117b075bab74222d739a19b84e8fe30e5a638aafdf095041f0ec1bba1d492c2"} May 20 21:48:12.669860 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:12.669811 2571 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 20 21:48:12.672900 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:12.672871 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-24.ec2.internal" event={"ID":"ec0c946b0168eebf1df2dbb6a8fd579a","Type":"ContainerStarted","Data":"a370ad8dabb9dd7f1c635539fbd22a33839cd840e6efc0a36e191a88f0c2b03c"} May 20 21:48:12.677683 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:12.677652 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" event={"ID":"4968fde8-82d9-448f-b530-e5893dd57d62","Type":"ContainerStarted","Data":"5b3b3bd2a76b6921cb7262b00d392576b3daf43ffdd1fbdfb4238f1a5803e1e5"} May 20 21:48:12.680242 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:12.680217 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d549q" event={"ID":"05e755d7-426f-4016-96a8-c1593d299301","Type":"ContainerStarted","Data":"e193f7c42195e83a461514e0daf086c6a2f7bd13fea434ad9992cdb67cde5b93"} May 20 21:48:12.683011 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:12.682929 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" event={"ID":"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0","Type":"ContainerStarted","Data":"7042bca5aae57610c77de820effb22562d82b72c41fdc35c8a931e0b6f6a59bd"} May 20 21:48:12.686664 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:12.686603 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dn8hq" event={"ID":"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d","Type":"ContainerStarted","Data":"4b82b8af0bb93a7d83481de83348026b560cb99b23b9d824f3eb04057e65ace5"} May 20 21:48:12.689388 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:12.688727 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-24.ec2.internal" podStartSLOduration=2.688714189 podStartE2EDuration="2.688714189s" podCreationTimestamp="2026-05-20 21:48:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:48:12.688179772 +0000 UTC m=+3.617996513" watchObservedRunningTime="2026-05-20 21:48:12.688714189 +0000 UTC m=+3.618530933" May 20 21:48:12.692937 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:12.692893 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76n7v" event={"ID":"28a7dd6d-170c-416f-95dc-24a6280778e7","Type":"ContainerStarted","Data":"4faf1497a6fd04d4134da27291f47248d9537dc28d4072e38594ab9d59b9b7f6"} May 20 21:48:13.133337 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:13.133301 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs\") pod \"network-metrics-daemon-hdgzt\" (UID: \"b785e9ea-de17-443e-b54a-ca50c16abeb6\") " pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:13.133583 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:13.133462 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:13.133583 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:13.133543 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs podName:b785e9ea-de17-443e-b54a-ca50c16abeb6 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:15.133522645 +0000 UTC m=+6.063339381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs") pod "network-metrics-daemon-hdgzt" (UID: "b785e9ea-de17-443e-b54a-ca50c16abeb6") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:13.234623 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:13.234589 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-original-pull-secret\") pod \"global-pull-secret-syncer-cbqtt\" (UID: \"ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe\") " pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:13.234821 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:13.234663 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6bqf\" (UniqueName: \"kubernetes.io/projected/b14ce8d1-3df8-4b0c-b255-a3e5bafe232b-kube-api-access-w6bqf\") pod \"network-check-target-rcvp4\" (UID: \"b14ce8d1-3df8-4b0c-b255-a3e5bafe232b\") " pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:13.234821 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:13.234760 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 21:48:13.234821 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:13.234792 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 21:48:13.234821 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:13.234808 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 21:48:13.234821 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:13.234819 2571 projected.go:194] Error preparing data for projected volume kube-api-access-w6bqf for pod openshift-network-diagnostics/network-check-target-rcvp4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:13.235064 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:13.234828 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-original-pull-secret podName:ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe nodeName:}" failed. No retries permitted until 2026-05-20 21:48:15.234809938 +0000 UTC m=+6.164626679 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-original-pull-secret") pod "global-pull-secret-syncer-cbqtt" (UID: "ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe") : object "kube-system"/"original-pull-secret" not registered May 20 21:48:13.235064 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:13.234855 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b14ce8d1-3df8-4b0c-b255-a3e5bafe232b-kube-api-access-w6bqf podName:b14ce8d1-3df8-4b0c-b255-a3e5bafe232b nodeName:}" failed. No retries permitted until 2026-05-20 21:48:15.234843684 +0000 UTC m=+6.164660417 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-w6bqf" (UniqueName: "kubernetes.io/projected/b14ce8d1-3df8-4b0c-b255-a3e5bafe232b-kube-api-access-w6bqf") pod "network-check-target-rcvp4" (UID: "b14ce8d1-3df8-4b0c-b255-a3e5bafe232b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:13.625853 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:13.624577 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:13.625853 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:13.624720 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbqtt" podUID="ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe" May 20 21:48:13.625853 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:13.625209 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:13.625853 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:13.625312 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdgzt" podUID="b785e9ea-de17-443e-b54a-ca50c16abeb6" May 20 21:48:13.625853 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:13.625726 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:13.625853 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:13.625816 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvp4" podUID="b14ce8d1-3df8-4b0c-b255-a3e5bafe232b" May 20 21:48:13.719726 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:13.719697 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-24.ec2.internal" event={"ID":"c7aa3561d957a7f9779d8e4e0783c0ff","Type":"ContainerStarted","Data":"53b13c3acfdb3a1f2ab8e7054a366eec3a1a9858467e3d9fd1872ac1572a89ee"} May 20 21:48:15.151106 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:15.151073 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs\") pod \"network-metrics-daemon-hdgzt\" (UID: \"b785e9ea-de17-443e-b54a-ca50c16abeb6\") " pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:15.151553 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:15.151286 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:15.151553 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:15.151357 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs podName:b785e9ea-de17-443e-b54a-ca50c16abeb6 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:19.151337495 +0000 UTC m=+10.081154217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs") pod "network-metrics-daemon-hdgzt" (UID: "b785e9ea-de17-443e-b54a-ca50c16abeb6") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:15.252402 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:15.252365 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-original-pull-secret\") pod \"global-pull-secret-syncer-cbqtt\" (UID: \"ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe\") " pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:15.252578 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:15.252429 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6bqf\" (UniqueName: \"kubernetes.io/projected/b14ce8d1-3df8-4b0c-b255-a3e5bafe232b-kube-api-access-w6bqf\") pod \"network-check-target-rcvp4\" (UID: \"b14ce8d1-3df8-4b0c-b255-a3e5bafe232b\") " pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:15.252578 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:15.252546 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 21:48:15.252797 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:15.252610 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 21:48:15.252797 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:15.252623 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-original-pull-secret podName:ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe nodeName:}" failed. No retries permitted until 2026-05-20 21:48:19.252602622 +0000 UTC m=+10.182419356 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-original-pull-secret") pod "global-pull-secret-syncer-cbqtt" (UID: "ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe") : object "kube-system"/"original-pull-secret" not registered May 20 21:48:15.252797 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:15.252633 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 21:48:15.252797 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:15.252685 2571 projected.go:194] Error preparing data for projected volume kube-api-access-w6bqf for pod openshift-network-diagnostics/network-check-target-rcvp4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:15.252797 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:15.252733 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b14ce8d1-3df8-4b0c-b255-a3e5bafe232b-kube-api-access-w6bqf podName:b14ce8d1-3df8-4b0c-b255-a3e5bafe232b nodeName:}" failed. No retries permitted until 2026-05-20 21:48:19.252717363 +0000 UTC m=+10.182534095 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-w6bqf" (UniqueName: "kubernetes.io/projected/b14ce8d1-3df8-4b0c-b255-a3e5bafe232b-kube-api-access-w6bqf") pod "network-check-target-rcvp4" (UID: "b14ce8d1-3df8-4b0c-b255-a3e5bafe232b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:15.626202 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:15.626172 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:15.626380 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:15.626307 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdgzt" podUID="b785e9ea-de17-443e-b54a-ca50c16abeb6" May 20 21:48:15.626701 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:15.626681 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:15.626825 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:15.626772 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvp4" podUID="b14ce8d1-3df8-4b0c-b255-a3e5bafe232b" May 20 21:48:15.626886 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:15.626826 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:15.626937 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:15.626893 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbqtt" podUID="ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe" May 20 21:48:17.623584 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:17.623550 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:17.624084 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:17.623731 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdgzt" podUID="b785e9ea-de17-443e-b54a-ca50c16abeb6" May 20 21:48:17.624084 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:17.623966 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:17.624084 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:17.624067 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvp4" podUID="b14ce8d1-3df8-4b0c-b255-a3e5bafe232b" May 20 21:48:17.624084 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:17.624084 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:17.624340 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:17.624159 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbqtt" podUID="ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe" May 20 21:48:19.186086 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:19.185969 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs\") pod \"network-metrics-daemon-hdgzt\" (UID: \"b785e9ea-de17-443e-b54a-ca50c16abeb6\") " pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:19.186524 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:19.186128 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:19.186524 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:19.186193 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs podName:b785e9ea-de17-443e-b54a-ca50c16abeb6 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:27.186172177 +0000 UTC m=+18.115988942 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs") pod "network-metrics-daemon-hdgzt" (UID: "b785e9ea-de17-443e-b54a-ca50c16abeb6") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:19.286325 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:19.286287 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6bqf\" (UniqueName: \"kubernetes.io/projected/b14ce8d1-3df8-4b0c-b255-a3e5bafe232b-kube-api-access-w6bqf\") pod \"network-check-target-rcvp4\" (UID: \"b14ce8d1-3df8-4b0c-b255-a3e5bafe232b\") " pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:19.286480 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:19.286381 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-original-pull-secret\") pod \"global-pull-secret-syncer-cbqtt\" (UID: \"ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe\") " pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:19.286550 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:19.286505 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 21:48:19.286609 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:19.286566 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-original-pull-secret podName:ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe nodeName:}" failed. No retries permitted until 2026-05-20 21:48:27.286546192 +0000 UTC m=+18.216362918 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-original-pull-secret") pod "global-pull-secret-syncer-cbqtt" (UID: "ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe") : object "kube-system"/"original-pull-secret" not registered May 20 21:48:19.286994 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:19.286975 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 21:48:19.287077 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:19.287000 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 21:48:19.287077 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:19.287012 2571 projected.go:194] Error preparing data for projected volume kube-api-access-w6bqf for pod openshift-network-diagnostics/network-check-target-rcvp4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:19.287077 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:19.287058 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b14ce8d1-3df8-4b0c-b255-a3e5bafe232b-kube-api-access-w6bqf podName:b14ce8d1-3df8-4b0c-b255-a3e5bafe232b nodeName:}" failed. No retries permitted until 2026-05-20 21:48:27.287043754 +0000 UTC m=+18.216860481 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-w6bqf" (UniqueName: "kubernetes.io/projected/b14ce8d1-3df8-4b0c-b255-a3e5bafe232b-kube-api-access-w6bqf") pod "network-check-target-rcvp4" (UID: "b14ce8d1-3df8-4b0c-b255-a3e5bafe232b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:19.625766 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:19.624956 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:19.625766 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:19.625080 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdgzt" podUID="b785e9ea-de17-443e-b54a-ca50c16abeb6" May 20 21:48:19.625766 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:19.625494 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:19.625766 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:19.625594 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvp4" podUID="b14ce8d1-3df8-4b0c-b255-a3e5bafe232b" May 20 21:48:19.625766 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:19.625656 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:19.625766 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:19.625725 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbqtt" podUID="ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe" May 20 21:48:21.623955 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:21.623910 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:21.624475 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:21.624032 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:21.624475 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:21.624141 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbqtt" podUID="ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe" May 20 21:48:21.624475 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:21.624038 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdgzt" podUID="b785e9ea-de17-443e-b54a-ca50c16abeb6" May 20 21:48:21.624475 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:21.624192 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:21.624475 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:21.624268 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvp4" podUID="b14ce8d1-3df8-4b0c-b255-a3e5bafe232b" May 20 21:48:23.623790 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:23.623756 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:23.624233 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:23.623756 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:23.624233 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:23.623886 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbqtt" podUID="ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe" May 20 21:48:23.624233 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:23.623756 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:23.624233 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:23.623945 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdgzt" podUID="b785e9ea-de17-443e-b54a-ca50c16abeb6" May 20 21:48:23.624233 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:23.623978 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvp4" podUID="b14ce8d1-3df8-4b0c-b255-a3e5bafe232b" May 20 21:48:25.624499 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:25.624466 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:25.624978 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:25.624466 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:25.624978 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:25.624471 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:25.624978 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:25.624568 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvp4" podUID="b14ce8d1-3df8-4b0c-b255-a3e5bafe232b" May 20 21:48:25.624978 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:25.624773 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdgzt" podUID="b785e9ea-de17-443e-b54a-ca50c16abeb6" May 20 21:48:25.624978 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:25.624868 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbqtt" podUID="ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe" May 20 21:48:27.240498 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:27.240451 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs\") pod \"network-metrics-daemon-hdgzt\" (UID: \"b785e9ea-de17-443e-b54a-ca50c16abeb6\") " pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:27.241067 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:27.240578 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:27.241067 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:27.240669 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs podName:b785e9ea-de17-443e-b54a-ca50c16abeb6 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:43.240630692 +0000 UTC m=+34.170447414 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs") pod "network-metrics-daemon-hdgzt" (UID: "b785e9ea-de17-443e-b54a-ca50c16abeb6") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:27.341302 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:27.341264 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-original-pull-secret\") pod \"global-pull-secret-syncer-cbqtt\" (UID: \"ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe\") " pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:27.341498 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:27.341323 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6bqf\" (UniqueName: \"kubernetes.io/projected/b14ce8d1-3df8-4b0c-b255-a3e5bafe232b-kube-api-access-w6bqf\") pod \"network-check-target-rcvp4\" (UID: \"b14ce8d1-3df8-4b0c-b255-a3e5bafe232b\") " pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:27.341498 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:27.341414 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 21:48:27.341498 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:27.341455 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 21:48:27.341498 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:27.341477 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 21:48:27.341498 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:27.341489 2571 projected.go:194] Error preparing data for projected volume kube-api-access-w6bqf for pod openshift-network-diagnostics/network-check-target-rcvp4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:27.341773 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:27.341490 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-original-pull-secret podName:ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe nodeName:}" failed. No retries permitted until 2026-05-20 21:48:43.341470597 +0000 UTC m=+34.271287332 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-original-pull-secret") pod "global-pull-secret-syncer-cbqtt" (UID: "ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe") : object "kube-system"/"original-pull-secret" not registered May 20 21:48:27.341773 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:27.341558 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b14ce8d1-3df8-4b0c-b255-a3e5bafe232b-kube-api-access-w6bqf podName:b14ce8d1-3df8-4b0c-b255-a3e5bafe232b nodeName:}" failed. No retries permitted until 2026-05-20 21:48:43.341540495 +0000 UTC m=+34.271357221 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-w6bqf" (UniqueName: "kubernetes.io/projected/b14ce8d1-3df8-4b0c-b255-a3e5bafe232b-kube-api-access-w6bqf") pod "network-check-target-rcvp4" (UID: "b14ce8d1-3df8-4b0c-b255-a3e5bafe232b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:27.624278 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:27.624243 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:27.624278 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:27.624269 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:27.624278 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:27.624277 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:27.624534 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:27.624389 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdgzt" podUID="b785e9ea-de17-443e-b54a-ca50c16abeb6" May 20 21:48:27.624534 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:27.624468 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvp4" podUID="b14ce8d1-3df8-4b0c-b255-a3e5bafe232b" May 20 21:48:27.624623 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:27.624559 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbqtt" podUID="ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe" May 20 21:48:29.624963 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:29.624935 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:29.625393 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:29.625033 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdgzt" podUID="b785e9ea-de17-443e-b54a-ca50c16abeb6" May 20 21:48:29.625393 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:29.625124 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:29.625393 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:29.625235 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbqtt" podUID="ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe" May 20 21:48:29.625393 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:29.625271 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:29.625393 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:29.625381 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvp4" podUID="b14ce8d1-3df8-4b0c-b255-a3e5bafe232b" May 20 21:48:30.750369 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:30.749968 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-68fgb" event={"ID":"aec000a4-9bb5-43e5-b40a-cfe251c18da5","Type":"ContainerStarted","Data":"7dd8a5369ed17647a01d4b09fca14f098a7b0a91bf0ae0bccb74c72f0d4a143b"} May 20 21:48:30.751460 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:30.751437 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6wwrr" event={"ID":"cf000cdd-dfa0-43d2-9df8-84baf9a14af4","Type":"ContainerStarted","Data":"28e3fa0b0d4b65c590ebb3268005952d43e348ca8d7e7924ede19c14624a3da6"} May 20 21:48:30.752882 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:30.752857 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" event={"ID":"4968fde8-82d9-448f-b530-e5893dd57d62","Type":"ContainerStarted","Data":"bffc0fd2b4f4d7142b73cd8a8c95bec892c7deeffceadd504ff0f19ae80a3422"} May 20 21:48:30.754218 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:30.754198 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d549q" event={"ID":"05e755d7-426f-4016-96a8-c1593d299301","Type":"ContainerStarted","Data":"7226e5a0a62aa7321a8770304e64e40484825bf88bdeab81dc781a6c0b3f8d0d"} May 20 21:48:30.758464 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:30.758439 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" event={"ID":"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0","Type":"ContainerStarted","Data":"9831ebeeeee72a1185351979c5b71d425fa2d39d8a26abd2c56f10b7920902d8"} May 20 21:48:30.758547 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:30.758474 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" event={"ID":"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0","Type":"ContainerStarted","Data":"eef465a0737bca813c81abe6fa6ff6791b8633e3a445881dd9b1a84c84cb1423"} May 20 21:48:30.759875 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:30.759849 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dn8hq" event={"ID":"d8a62d5e-8a30-41db-ba35-c34cf1c2e56d","Type":"ContainerStarted","Data":"59272fd76e25231945357c596803662e0416252f744d604b64d5ba4598883568"} May 20 21:48:30.762030 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:30.762002 2571 generic.go:358] "Generic (PLEG): container finished" podID="28a7dd6d-170c-416f-95dc-24a6280778e7" containerID="4a9973da4ce02e75c75a47bbf7aa6991445b3f0933acf3f32066dd95f3e147dc" exitCode=0 May 20 21:48:30.762142 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:30.762085 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76n7v" event={"ID":"28a7dd6d-170c-416f-95dc-24a6280778e7","Type":"ContainerDied","Data":"4a9973da4ce02e75c75a47bbf7aa6991445b3f0933acf3f32066dd95f3e147dc"} May 20 21:48:30.762935 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:30.762843 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-24.ec2.internal" podStartSLOduration=20.762810421 podStartE2EDuration="20.762810421s" podCreationTimestamp="2026-05-20 21:48:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:48:13.733873851 +0000 UTC m=+4.663690598" watchObservedRunningTime="2026-05-20 21:48:30.762810421 +0000 UTC m=+21.692627165" May 20 21:48:30.763327 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:30.763290 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-68fgb" podStartSLOduration=4.026697751 podStartE2EDuration="21.763282137s" podCreationTimestamp="2026-05-20 21:48:09 +0000 UTC" firstStartedPulling="2026-05-20 21:48:12.237904612 +0000 UTC m=+3.167721338" lastFinishedPulling="2026-05-20 21:48:29.974488999 +0000 UTC m=+20.904305724" observedRunningTime="2026-05-20 21:48:30.762460776 +0000 UTC m=+21.692277520" watchObservedRunningTime="2026-05-20 21:48:30.763282137 +0000 UTC m=+21.693098881" May 20 21:48:30.764052 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:30.764024 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-82r6j" event={"ID":"8d148f13-1e0a-4f0d-9e34-69829d0e3a61","Type":"ContainerStarted","Data":"af9f87fbae6329aeddb2cdccea6edc4d1524a9b96b7d05caa2722b9e3f1dc82d"} May 20 21:48:30.778272 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:30.777154 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d549q" podStartSLOduration=3.694249895 podStartE2EDuration="21.777137079s" podCreationTimestamp="2026-05-20 21:48:09 +0000 UTC" firstStartedPulling="2026-05-20 21:48:12.237745359 +0000 UTC m=+3.167562093" lastFinishedPulling="2026-05-20 21:48:30.320632542 +0000 UTC m=+21.250449277" observedRunningTime="2026-05-20 21:48:30.776888578 +0000 UTC m=+21.706705322" watchObservedRunningTime="2026-05-20 21:48:30.777137079 +0000 UTC m=+21.706953821" May 20 21:48:30.832381 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:30.832337 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-6wwrr" podStartSLOduration=3.700521302 podStartE2EDuration="21.83232359s" podCreationTimestamp="2026-05-20 21:48:09 +0000 UTC" firstStartedPulling="2026-05-20 21:48:12.211490289 +0000 UTC m=+3.141307013" lastFinishedPulling="2026-05-20 21:48:30.343292578 +0000 UTC m=+21.273109301" observedRunningTime="2026-05-20 21:48:30.831781954 +0000 UTC m=+21.761598697" watchObservedRunningTime="2026-05-20 21:48:30.83232359 +0000 UTC m=+21.762140333" May 20 21:48:30.895931 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:30.895878 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-dn8hq" podStartSLOduration=3.563826431 podStartE2EDuration="21.895861227s" podCreationTimestamp="2026-05-20 21:48:09 +0000 UTC" firstStartedPulling="2026-05-20 21:48:12.213587236 +0000 UTC m=+3.143403960" lastFinishedPulling="2026-05-20 21:48:30.545622029 +0000 UTC m=+21.475438756" observedRunningTime="2026-05-20 21:48:30.867884253 +0000 UTC m=+21.797700995" watchObservedRunningTime="2026-05-20 21:48:30.895861227 +0000 UTC m=+21.825677972" May 20 21:48:31.624070 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:31.624039 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:31.624226 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:31.624139 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbqtt" podUID="ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe" May 20 21:48:31.624226 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:31.624167 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:31.624355 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:31.624287 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdgzt" podUID="b785e9ea-de17-443e-b54a-ca50c16abeb6" May 20 21:48:31.624355 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:31.624333 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:31.624457 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:31.624393 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvp4" podUID="b14ce8d1-3df8-4b0c-b255-a3e5bafe232b" May 20 21:48:31.768319 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:31.768292 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" event={"ID":"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0","Type":"ContainerStarted","Data":"3ddc350e96ec8392409884ca89b0d3eead0c4954e95de6e1c80347ed6a51d334"} May 20 21:48:31.768672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:31.768330 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" event={"ID":"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0","Type":"ContainerStarted","Data":"e8df1a74d329c3867b55a873565f25b8ac175452dc3125c0491dce0c41c184f1"} May 20 21:48:31.768672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:31.768347 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" event={"ID":"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0","Type":"ContainerStarted","Data":"27bae7ea5f9e4bd0cc940ad3921b5f39a59fe02874e79de8d3908428a95db85d"} May 20 21:48:31.768672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:31.768362 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" event={"ID":"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0","Type":"ContainerStarted","Data":"226298a908b68265673e680bbdd4f6b0fcddc199256716a80a1f093956915840"} May 20 21:48:31.769627 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:31.769572 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kxb9x" event={"ID":"62c85ffa-9e66-41a9-a9b7-a3b21a050834","Type":"ContainerStarted","Data":"78f55f64e0809cc866a6a98d18f6b766ba05626085144f50992faa562cf36aa5"} May 20 21:48:31.832818 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:31.832739 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kxb9x" podStartSLOduration=4.75004729 podStartE2EDuration="22.832721661s" podCreationTimestamp="2026-05-20 21:48:09 +0000 UTC" firstStartedPulling="2026-05-20 21:48:12.207721212 +0000 UTC m=+3.137537942" lastFinishedPulling="2026-05-20 21:48:30.290395584 +0000 UTC m=+21.220212313" observedRunningTime="2026-05-20 21:48:31.83267726 +0000 UTC m=+22.762494006" watchObservedRunningTime="2026-05-20 21:48:31.832721661 +0000 UTC m=+22.762538407" May 20 21:48:31.833034 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:31.833005 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-82r6j" podStartSLOduration=4.698986046 podStartE2EDuration="22.832999127s" podCreationTimestamp="2026-05-20 21:48:09 +0000 UTC" firstStartedPulling="2026-05-20 21:48:12.208854519 +0000 UTC m=+3.138671253" lastFinishedPulling="2026-05-20 21:48:30.342867597 +0000 UTC m=+21.272684334" observedRunningTime="2026-05-20 21:48:30.896242851 +0000 UTC m=+21.826059595" watchObservedRunningTime="2026-05-20 21:48:31.832999127 +0000 UTC m=+22.762815869" May 20 21:48:31.896363 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:31.896340 2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 20 21:48:32.580321 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:32.580209 2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-20T21:48:31.896359612Z","UUID":"dad2d3e3-91e8-4801-bff9-edda85479ebf","Handler":null,"Name":"","Endpoint":""} May 20 21:48:32.582719 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:32.582381 2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 20 21:48:32.582719 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:32.582411 2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 20 21:48:32.773694 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:32.773658 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" event={"ID":"4968fde8-82d9-448f-b530-e5893dd57d62","Type":"ContainerStarted","Data":"ed1784ba301445ee176280f737268384d633efabe3654b8126088d1d3c6ef7eb"} May 20 21:48:33.626861 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:33.626835 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:33.627040 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:33.626835 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:33.627040 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:33.626835 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:33.627149 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:33.627027 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbqtt" podUID="ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe" May 20 21:48:33.627149 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:33.627122 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdgzt" podUID="b785e9ea-de17-443e-b54a-ca50c16abeb6" May 20 21:48:33.627149 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:33.626925 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvp4" podUID="b14ce8d1-3df8-4b0c-b255-a3e5bafe232b" May 20 21:48:33.777624 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:33.777588 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" event={"ID":"4968fde8-82d9-448f-b530-e5893dd57d62","Type":"ContainerStarted","Data":"67098e9409accc9d692174daeac6d61c0956a9b8d4384d3fcb0c4581be420a43"} May 20 21:48:33.796477 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:33.796433 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfs4k" podStartSLOduration=4.033083057 podStartE2EDuration="24.79641961s" podCreationTimestamp="2026-05-20 21:48:09 +0000 UTC" firstStartedPulling="2026-05-20 21:48:12.237579419 +0000 UTC m=+3.167396141" lastFinishedPulling="2026-05-20 21:48:33.00091597 +0000 UTC m=+23.930732694" observedRunningTime="2026-05-20 21:48:33.796411666 +0000 UTC m=+24.726228409" watchObservedRunningTime="2026-05-20 21:48:33.79641961 +0000 UTC m=+24.726236354" May 20 21:48:34.800681 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:34.800446 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d549q" May 20 21:48:34.801086 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:34.801038 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d549q" May 20 21:48:35.623875 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:35.623845 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:35.624039 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:35.623894 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:35.624039 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:35.623981 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvp4" podUID="b14ce8d1-3df8-4b0c-b255-a3e5bafe232b" May 20 21:48:35.624164 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:35.624028 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdgzt" podUID="b785e9ea-de17-443e-b54a-ca50c16abeb6" May 20 21:48:35.624164 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:35.624054 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:35.624164 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:35.624111 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbqtt" podUID="ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe" May 20 21:48:35.783423 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:35.783390 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" event={"ID":"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0","Type":"ContainerStarted","Data":"6637a2714d1c953c9e0b54f76fb67eea15a7ad375bffa0779fed45a40e2b1fe7"} May 20 21:48:35.784807 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:35.784783 2571 generic.go:358] "Generic (PLEG): container finished" podID="28a7dd6d-170c-416f-95dc-24a6280778e7" containerID="9057831ebac3ec392be7db96d49538c700067e52f1e42de50f8dc0f5460a7ec0" exitCode=0 May 20 21:48:35.784941 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:35.784872 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76n7v" event={"ID":"28a7dd6d-170c-416f-95dc-24a6280778e7","Type":"ContainerDied","Data":"9057831ebac3ec392be7db96d49538c700067e52f1e42de50f8dc0f5460a7ec0"} May 20 21:48:35.785001 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:35.784963 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d549q" May 20 21:48:35.785441 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:35.785420 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d549q" May 20 21:48:37.623774 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:37.623553 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:37.624352 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:37.623570 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:37.624352 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:37.623855 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbqtt" podUID="ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe" May 20 21:48:37.624352 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:37.623618 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:37.624352 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:37.623928 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdgzt" podUID="b785e9ea-de17-443e-b54a-ca50c16abeb6" May 20 21:48:37.624352 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:37.624021 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvp4" podUID="b14ce8d1-3df8-4b0c-b255-a3e5bafe232b" May 20 21:48:37.791784 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:37.791746 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" event={"ID":"a06608b6-fae0-4a42-a0c6-98d3f9cec1b0","Type":"ContainerStarted","Data":"f6d42cd5edf91505c09852672efc6a06df3f286cf16dc9878feb3edc879b76a5"} May 20 21:48:37.792098 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:37.792063 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:37.793663 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:37.793624 2571 generic.go:358] "Generic (PLEG): container finished" podID="28a7dd6d-170c-416f-95dc-24a6280778e7" containerID="4a958b849c3749f22d76ec42afa4a65c1b722a0bc2daa2fa701374c2c5c8da62" exitCode=0 May 20 21:48:37.793793 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:37.793667 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76n7v" event={"ID":"28a7dd6d-170c-416f-95dc-24a6280778e7","Type":"ContainerDied","Data":"4a958b849c3749f22d76ec42afa4a65c1b722a0bc2daa2fa701374c2c5c8da62"} May 20 21:48:37.808409 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:37.808390 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:37.819826 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:37.819786 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" podStartSLOduration=10.673373977 podStartE2EDuration="28.819773965s" podCreationTimestamp="2026-05-20 21:48:09 +0000 UTC" firstStartedPulling="2026-05-20 21:48:12.214738284 +0000 UTC m=+3.144555020" lastFinishedPulling="2026-05-20 21:48:30.361138287 +0000 UTC m=+21.290955008" observedRunningTime="2026-05-20 21:48:37.818282535 +0000 UTC m=+28.748099278" watchObservedRunningTime="2026-05-20 21:48:37.819773965 +0000 UTC m=+28.749590735" May 20 21:48:38.798339 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:38.798256 2571 generic.go:358] "Generic (PLEG): container finished" podID="28a7dd6d-170c-416f-95dc-24a6280778e7" containerID="b1fdafa213eabf8d471e1151b4fbd896339284fe1388201bd0a067a31ed2d0ee" exitCode=0 May 20 21:48:38.798777 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:38.798340 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76n7v" event={"ID":"28a7dd6d-170c-416f-95dc-24a6280778e7","Type":"ContainerDied","Data":"b1fdafa213eabf8d471e1151b4fbd896339284fe1388201bd0a067a31ed2d0ee"} May 20 21:48:38.799099 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:38.799078 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:38.799157 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:38.799106 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:38.814914 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:38.814892 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:48:39.022847 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:39.022786 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cbqtt"] May 20 21:48:39.023027 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:39.022913 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:39.023027 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:39.023013 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbqtt" podUID="ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe" May 20 21:48:39.023855 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:39.023806 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rcvp4"] May 20 21:48:39.024006 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:39.023927 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:39.024072 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:39.024017 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvp4" podUID="b14ce8d1-3df8-4b0c-b255-a3e5bafe232b" May 20 21:48:39.024627 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:39.024584 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hdgzt"] May 20 21:48:39.024755 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:39.024718 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:39.024894 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:39.024818 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdgzt" podUID="b785e9ea-de17-443e-b54a-ca50c16abeb6" May 20 21:48:40.623719 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:40.623496 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:40.624335 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:40.623537 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:40.624335 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:40.623812 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbqtt" podUID="ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe" May 20 21:48:40.624335 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:40.623496 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:40.624335 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:40.623884 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvp4" podUID="b14ce8d1-3df8-4b0c-b255-a3e5bafe232b" May 20 21:48:40.624335 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:40.623942 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdgzt" podUID="b785e9ea-de17-443e-b54a-ca50c16abeb6" May 20 21:48:42.623958 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:42.623927 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:42.624430 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:42.623924 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:42.624430 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:42.624062 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hdgzt" podUID="b785e9ea-de17-443e-b54a-ca50c16abeb6" May 20 21:48:42.624430 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:42.623927 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:42.624430 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:42.624143 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbqtt" podUID="ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe" May 20 21:48:42.624430 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:42.624185 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvp4" podUID="b14ce8d1-3df8-4b0c-b255-a3e5bafe232b" May 20 21:48:43.269406 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.269320 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs\") pod \"network-metrics-daemon-hdgzt\" (UID: \"b785e9ea-de17-443e-b54a-ca50c16abeb6\") " pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:43.269562 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:43.269495 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:43.269633 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:43.269595 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs podName:b785e9ea-de17-443e-b54a-ca50c16abeb6 nodeName:}" failed. No retries permitted until 2026-05-20 21:49:15.269560929 +0000 UTC m=+66.199377656 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs") pod "network-metrics-daemon-hdgzt" (UID: "b785e9ea-de17-443e-b54a-ca50c16abeb6") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:43.370391 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.370359 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-original-pull-secret\") pod \"global-pull-secret-syncer-cbqtt\" (UID: \"ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe\") " pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:43.370548 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.370412 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6bqf\" (UniqueName: \"kubernetes.io/projected/b14ce8d1-3df8-4b0c-b255-a3e5bafe232b-kube-api-access-w6bqf\") pod \"network-check-target-rcvp4\" (UID: \"b14ce8d1-3df8-4b0c-b255-a3e5bafe232b\") " pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:43.370594 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:43.370543 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 21:48:43.370654 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:43.370622 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-original-pull-secret podName:ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe nodeName:}" failed. No retries permitted until 2026-05-20 21:49:15.370606928 +0000 UTC m=+66.300423665 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-original-pull-secret") pod "global-pull-secret-syncer-cbqtt" (UID: "ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe") : object "kube-system"/"original-pull-secret" not registered May 20 21:48:43.370715 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:43.370547 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 21:48:43.370715 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:43.370674 2571 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 21:48:43.370715 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:43.370689 2571 projected.go:194] Error preparing data for projected volume kube-api-access-w6bqf for pod openshift-network-diagnostics/network-check-target-rcvp4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:43.370849 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:43.370750 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b14ce8d1-3df8-4b0c-b255-a3e5bafe232b-kube-api-access-w6bqf podName:b14ce8d1-3df8-4b0c-b255-a3e5bafe232b nodeName:}" failed. No retries permitted until 2026-05-20 21:49:15.370733262 +0000 UTC m=+66.300549986 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-w6bqf" (UniqueName: "kubernetes.io/projected/b14ce8d1-3df8-4b0c-b255-a3e5bafe232b-kube-api-access-w6bqf") pod "network-check-target-rcvp4" (UID: "b14ce8d1-3df8-4b0c-b255-a3e5bafe232b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:43.389151 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.389126 2571 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-24.ec2.internal" event="NodeReady" May 20 21:48:43.389309 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.389296 2571 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 20 21:48:43.515520 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.515482 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nxnd2"] May 20 21:48:43.561790 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.561762 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rnmkn"] May 20 21:48:43.561969 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.561946 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nxnd2" May 20 21:48:43.564492 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.564466 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 20 21:48:43.565106 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.565083 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 20 21:48:43.565829 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.565809 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2fk4m\"" May 20 21:48:43.575922 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.575905 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nxnd2"] May 20 21:48:43.575922 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.575926 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rnmkn"] May 20 21:48:43.576054 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.576019 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rnmkn" May 20 21:48:43.578356 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.578331 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 20 21:48:43.578605 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.578589 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n5njn\"" May 20 21:48:43.578726 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.578708 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 20 21:48:43.578796 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.578718 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 20 21:48:43.673205 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.673174 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/53d29758-e039-4bd4-93ed-9848d16a4bb8-config-volume\") pod \"dns-default-nxnd2\" (UID: \"53d29758-e039-4bd4-93ed-9848d16a4bb8\") " pod="openshift-dns/dns-default-nxnd2" May 20 21:48:43.673774 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.673214 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv7fc\" (UniqueName: \"kubernetes.io/projected/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-kube-api-access-wv7fc\") pod \"ingress-canary-rnmkn\" (UID: \"3099afb3-7f12-4cc5-9916-e30f1ce42c8b\") " pod="openshift-ingress-canary/ingress-canary-rnmkn" May 20 21:48:43.673774 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.673242 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert\") pod \"ingress-canary-rnmkn\" (UID: \"3099afb3-7f12-4cc5-9916-e30f1ce42c8b\") " pod="openshift-ingress-canary/ingress-canary-rnmkn" May 20 21:48:43.673774 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.673333 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53d29758-e039-4bd4-93ed-9848d16a4bb8-tmp-dir\") pod \"dns-default-nxnd2\" (UID: \"53d29758-e039-4bd4-93ed-9848d16a4bb8\") " pod="openshift-dns/dns-default-nxnd2" May 20 21:48:43.673774 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.673383 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdvzl\" (UniqueName: \"kubernetes.io/projected/53d29758-e039-4bd4-93ed-9848d16a4bb8-kube-api-access-gdvzl\") pod \"dns-default-nxnd2\" (UID: \"53d29758-e039-4bd4-93ed-9848d16a4bb8\") " pod="openshift-dns/dns-default-nxnd2" May 20 21:48:43.673774 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.673430 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls\") pod \"dns-default-nxnd2\" (UID: \"53d29758-e039-4bd4-93ed-9848d16a4bb8\") " pod="openshift-dns/dns-default-nxnd2" May 20 21:48:43.774502 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.774469 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53d29758-e039-4bd4-93ed-9848d16a4bb8-tmp-dir\") pod \"dns-default-nxnd2\" (UID: \"53d29758-e039-4bd4-93ed-9848d16a4bb8\") " pod="openshift-dns/dns-default-nxnd2" May 20 21:48:43.774814 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.774529 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gdvzl\" (UniqueName: \"kubernetes.io/projected/53d29758-e039-4bd4-93ed-9848d16a4bb8-kube-api-access-gdvzl\") pod \"dns-default-nxnd2\" (UID: \"53d29758-e039-4bd4-93ed-9848d16a4bb8\") " pod="openshift-dns/dns-default-nxnd2" May 20 21:48:43.774814 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.774565 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls\") pod \"dns-default-nxnd2\" (UID: \"53d29758-e039-4bd4-93ed-9848d16a4bb8\") " pod="openshift-dns/dns-default-nxnd2" May 20 21:48:43.774814 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:43.774729 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 21:48:43.774814 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.774768 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/53d29758-e039-4bd4-93ed-9848d16a4bb8-config-volume\") pod \"dns-default-nxnd2\" (UID: \"53d29758-e039-4bd4-93ed-9848d16a4bb8\") " pod="openshift-dns/dns-default-nxnd2" May 20 21:48:43.774814 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:43.774794 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls podName:53d29758-e039-4bd4-93ed-9848d16a4bb8 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:44.274775935 +0000 UTC m=+35.204592673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls") pod "dns-default-nxnd2" (UID: "53d29758-e039-4bd4-93ed-9848d16a4bb8") : secret "dns-default-metrics-tls" not found May 20 21:48:43.775093 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.774828 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wv7fc\" (UniqueName: \"kubernetes.io/projected/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-kube-api-access-wv7fc\") pod \"ingress-canary-rnmkn\" (UID: \"3099afb3-7f12-4cc5-9916-e30f1ce42c8b\") " pod="openshift-ingress-canary/ingress-canary-rnmkn" May 20 21:48:43.775093 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.774853 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert\") pod \"ingress-canary-rnmkn\" (UID: \"3099afb3-7f12-4cc5-9916-e30f1ce42c8b\") " pod="openshift-ingress-canary/ingress-canary-rnmkn" May 20 21:48:43.775093 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.774868 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53d29758-e039-4bd4-93ed-9848d16a4bb8-tmp-dir\") pod \"dns-default-nxnd2\" (UID: \"53d29758-e039-4bd4-93ed-9848d16a4bb8\") " pod="openshift-dns/dns-default-nxnd2" May 20 21:48:43.775093 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:43.775039 2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 21:48:43.775263 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:43.775103 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert podName:3099afb3-7f12-4cc5-9916-e30f1ce42c8b nodeName:}" failed. No retries permitted until 2026-05-20 21:48:44.275087431 +0000 UTC m=+35.204904151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert") pod "ingress-canary-rnmkn" (UID: "3099afb3-7f12-4cc5-9916-e30f1ce42c8b") : secret "canary-serving-cert" not found May 20 21:48:43.775263 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.775253 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/53d29758-e039-4bd4-93ed-9848d16a4bb8-config-volume\") pod \"dns-default-nxnd2\" (UID: \"53d29758-e039-4bd4-93ed-9848d16a4bb8\") " pod="openshift-dns/dns-default-nxnd2" May 20 21:48:43.786547 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.786520 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdvzl\" (UniqueName: \"kubernetes.io/projected/53d29758-e039-4bd4-93ed-9848d16a4bb8-kube-api-access-gdvzl\") pod \"dns-default-nxnd2\" (UID: \"53d29758-e039-4bd4-93ed-9848d16a4bb8\") " pod="openshift-dns/dns-default-nxnd2" May 20 21:48:43.786701 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:43.786679 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv7fc\" (UniqueName: \"kubernetes.io/projected/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-kube-api-access-wv7fc\") pod \"ingress-canary-rnmkn\" (UID: \"3099afb3-7f12-4cc5-9916-e30f1ce42c8b\") " pod="openshift-ingress-canary/ingress-canary-rnmkn" May 20 21:48:44.278830 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:44.278796 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert\") pod \"ingress-canary-rnmkn\" (UID: \"3099afb3-7f12-4cc5-9916-e30f1ce42c8b\") " pod="openshift-ingress-canary/ingress-canary-rnmkn" May 20 21:48:44.279087 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:44.278876 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls\") pod \"dns-default-nxnd2\" (UID: \"53d29758-e039-4bd4-93ed-9848d16a4bb8\") " pod="openshift-dns/dns-default-nxnd2" May 20 21:48:44.279087 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:44.278957 2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 21:48:44.279087 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:44.278982 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 21:48:44.279087 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:44.279025 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert podName:3099afb3-7f12-4cc5-9916-e30f1ce42c8b nodeName:}" failed. No retries permitted until 2026-05-20 21:48:45.279003918 +0000 UTC m=+36.208820641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert") pod "ingress-canary-rnmkn" (UID: "3099afb3-7f12-4cc5-9916-e30f1ce42c8b") : secret "canary-serving-cert" not found May 20 21:48:44.279087 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:44.279044 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls podName:53d29758-e039-4bd4-93ed-9848d16a4bb8 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:45.279034114 +0000 UTC m=+36.208850836 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls") pod "dns-default-nxnd2" (UID: "53d29758-e039-4bd4-93ed-9848d16a4bb8") : secret "dns-default-metrics-tls" not found May 20 21:48:44.624071 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:44.624040 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:48:44.624246 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:44.624040 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:48:44.624313 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:44.624043 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:48:44.626755 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:44.626734 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 20 21:48:44.627906 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:44.627883 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 20 21:48:44.628022 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:44.627959 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 20 21:48:44.628022 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:44.627965 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 20 21:48:44.628022 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:44.627965 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5n7z5\"" May 20 21:48:44.628022 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:44.628019 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6x7hr\"" May 20 21:48:45.286401 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:45.286373 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls\") pod \"dns-default-nxnd2\" (UID: \"53d29758-e039-4bd4-93ed-9848d16a4bb8\") " pod="openshift-dns/dns-default-nxnd2" May 20 21:48:45.286898 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:45.286433 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert\") pod \"ingress-canary-rnmkn\" (UID: \"3099afb3-7f12-4cc5-9916-e30f1ce42c8b\") " pod="openshift-ingress-canary/ingress-canary-rnmkn" May 20 21:48:45.286898 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:45.286531 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 21:48:45.286898 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:45.286597 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls podName:53d29758-e039-4bd4-93ed-9848d16a4bb8 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:47.286572972 +0000 UTC m=+38.216389697 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls") pod "dns-default-nxnd2" (UID: "53d29758-e039-4bd4-93ed-9848d16a4bb8") : secret "dns-default-metrics-tls" not found May 20 21:48:45.286898 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:45.286536 2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 21:48:45.286898 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:45.286688 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert podName:3099afb3-7f12-4cc5-9916-e30f1ce42c8b nodeName:}" failed. No retries permitted until 2026-05-20 21:48:47.28667413 +0000 UTC m=+38.216490871 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert") pod "ingress-canary-rnmkn" (UID: "3099afb3-7f12-4cc5-9916-e30f1ce42c8b") : secret "canary-serving-cert" not found May 20 21:48:45.813539 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:45.813503 2571 generic.go:358] "Generic (PLEG): container finished" podID="28a7dd6d-170c-416f-95dc-24a6280778e7" containerID="e3b49bc7a9807cd28d172ab6acd1ca8569c5aea734928afa50954705bfe32362" exitCode=0 May 20 21:48:45.813727 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:45.813553 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76n7v" event={"ID":"28a7dd6d-170c-416f-95dc-24a6280778e7","Type":"ContainerDied","Data":"e3b49bc7a9807cd28d172ab6acd1ca8569c5aea734928afa50954705bfe32362"} May 20 21:48:46.817811 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:46.817779 2571 generic.go:358] "Generic (PLEG): container finished" podID="28a7dd6d-170c-416f-95dc-24a6280778e7" containerID="04fcd3e43cf0ce9641ba8c77a1459241fb4c2d2ed53963c770243c0b5acc271f" exitCode=0 May 20 21:48:46.818296 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:46.817829 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76n7v" event={"ID":"28a7dd6d-170c-416f-95dc-24a6280778e7","Type":"ContainerDied","Data":"04fcd3e43cf0ce9641ba8c77a1459241fb4c2d2ed53963c770243c0b5acc271f"} May 20 21:48:47.300134 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:47.299886 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert\") pod \"ingress-canary-rnmkn\" (UID: \"3099afb3-7f12-4cc5-9916-e30f1ce42c8b\") " pod="openshift-ingress-canary/ingress-canary-rnmkn" May 20 21:48:47.300134 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:47.300098 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls\") pod \"dns-default-nxnd2\" (UID: \"53d29758-e039-4bd4-93ed-9848d16a4bb8\") " pod="openshift-dns/dns-default-nxnd2" May 20 21:48:47.300134 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:47.300033 2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 21:48:47.300356 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:47.300208 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert podName:3099afb3-7f12-4cc5-9916-e30f1ce42c8b nodeName:}" failed. No retries permitted until 2026-05-20 21:48:51.300191946 +0000 UTC m=+42.230008673 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert") pod "ingress-canary-rnmkn" (UID: "3099afb3-7f12-4cc5-9916-e30f1ce42c8b") : secret "canary-serving-cert" not found May 20 21:48:47.300356 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:47.300210 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 21:48:47.300356 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:47.300257 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls podName:53d29758-e039-4bd4-93ed-9848d16a4bb8 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:51.300242853 +0000 UTC m=+42.230059594 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls") pod "dns-default-nxnd2" (UID: "53d29758-e039-4bd4-93ed-9848d16a4bb8") : secret "dns-default-metrics-tls" not found May 20 21:48:47.822505 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:47.822474 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76n7v" event={"ID":"28a7dd6d-170c-416f-95dc-24a6280778e7","Type":"ContainerStarted","Data":"f5e6e6cac9ea4841c1c126db0eff974b610356f1a92d253b5f077648a449e358"} May 20 21:48:47.849167 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:47.849114 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-76n7v" podStartSLOduration=6.083440297 podStartE2EDuration="38.849098159s" podCreationTimestamp="2026-05-20 21:48:09 +0000 UTC" firstStartedPulling="2026-05-20 21:48:12.212157945 +0000 UTC m=+3.141974669" lastFinishedPulling="2026-05-20 21:48:44.977815806 +0000 UTC m=+35.907632531" observedRunningTime="2026-05-20 21:48:47.847748722 +0000 UTC m=+38.777565464" watchObservedRunningTime="2026-05-20 21:48:47.849098159 +0000 UTC m=+38.778914905" May 20 21:48:51.331276 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:51.331241 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls\") pod \"dns-default-nxnd2\" (UID: \"53d29758-e039-4bd4-93ed-9848d16a4bb8\") " pod="openshift-dns/dns-default-nxnd2" May 20 21:48:51.331678 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:51.331316 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert\") pod \"ingress-canary-rnmkn\" (UID: \"3099afb3-7f12-4cc5-9916-e30f1ce42c8b\") " pod="openshift-ingress-canary/ingress-canary-rnmkn" May 20 21:48:51.331678 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:51.331416 2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 21:48:51.331678 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:51.331489 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert podName:3099afb3-7f12-4cc5-9916-e30f1ce42c8b nodeName:}" failed. No retries permitted until 2026-05-20 21:48:59.331472529 +0000 UTC m=+50.261289255 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert") pod "ingress-canary-rnmkn" (UID: "3099afb3-7f12-4cc5-9916-e30f1ce42c8b") : secret "canary-serving-cert" not found May 20 21:48:51.331678 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:51.331416 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 21:48:51.331678 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:51.331530 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls podName:53d29758-e039-4bd4-93ed-9848d16a4bb8 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:59.33152059 +0000 UTC m=+50.261337321 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls") pod "dns-default-nxnd2" (UID: "53d29758-e039-4bd4-93ed-9848d16a4bb8") : secret "dns-default-metrics-tls" not found May 20 21:48:59.386425 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:59.386378 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert\") pod \"ingress-canary-rnmkn\" (UID: \"3099afb3-7f12-4cc5-9916-e30f1ce42c8b\") " pod="openshift-ingress-canary/ingress-canary-rnmkn" May 20 21:48:59.386924 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:48:59.386450 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls\") pod \"dns-default-nxnd2\" (UID: \"53d29758-e039-4bd4-93ed-9848d16a4bb8\") " pod="openshift-dns/dns-default-nxnd2" May 20 21:48:59.386924 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:59.386555 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 21:48:59.386924 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:59.386562 2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 21:48:59.386924 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:59.386634 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls podName:53d29758-e039-4bd4-93ed-9848d16a4bb8 nodeName:}" failed. No retries permitted until 2026-05-20 21:49:15.386593745 +0000 UTC m=+66.316410466 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls") pod "dns-default-nxnd2" (UID: "53d29758-e039-4bd4-93ed-9848d16a4bb8") : secret "dns-default-metrics-tls" not found May 20 21:48:59.386924 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:48:59.386696 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert podName:3099afb3-7f12-4cc5-9916-e30f1ce42c8b nodeName:}" failed. No retries permitted until 2026-05-20 21:49:15.38667583 +0000 UTC m=+66.316492568 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert") pod "ingress-canary-rnmkn" (UID: "3099afb3-7f12-4cc5-9916-e30f1ce42c8b") : secret "canary-serving-cert" not found May 20 21:49:10.811752 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:10.811725 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-shgjs" May 20 21:49:15.291580 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:15.291545 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs\") pod \"network-metrics-daemon-hdgzt\" (UID: \"b785e9ea-de17-443e-b54a-ca50c16abeb6\") " pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:49:15.294215 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:15.294198 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 20 21:49:15.302234 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:49:15.302219 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 20 21:49:15.302299 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:49:15.302284 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs podName:b785e9ea-de17-443e-b54a-ca50c16abeb6 nodeName:}" failed. No retries permitted until 2026-05-20 21:50:19.302267445 +0000 UTC m=+130.232084172 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs") pod "network-metrics-daemon-hdgzt" (UID: "b785e9ea-de17-443e-b54a-ca50c16abeb6") : secret "metrics-daemon-secret" not found May 20 21:49:15.392660 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:15.392624 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls\") pod \"dns-default-nxnd2\" (UID: \"53d29758-e039-4bd4-93ed-9848d16a4bb8\") " pod="openshift-dns/dns-default-nxnd2" May 20 21:49:15.392754 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:15.392671 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6bqf\" (UniqueName: \"kubernetes.io/projected/b14ce8d1-3df8-4b0c-b255-a3e5bafe232b-kube-api-access-w6bqf\") pod \"network-check-target-rcvp4\" (UID: \"b14ce8d1-3df8-4b0c-b255-a3e5bafe232b\") " pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:49:15.392754 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:15.392705 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert\") pod \"ingress-canary-rnmkn\" (UID: \"3099afb3-7f12-4cc5-9916-e30f1ce42c8b\") " pod="openshift-ingress-canary/ingress-canary-rnmkn" May 20 21:49:15.392754 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:15.392730 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-original-pull-secret\") pod \"global-pull-secret-syncer-cbqtt\" (UID: \"ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe\") " pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:49:15.392904 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:49:15.392774 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 21:49:15.392904 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:49:15.392837 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls podName:53d29758-e039-4bd4-93ed-9848d16a4bb8 nodeName:}" failed. No retries permitted until 2026-05-20 21:49:47.392818587 +0000 UTC m=+98.322635308 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls") pod "dns-default-nxnd2" (UID: "53d29758-e039-4bd4-93ed-9848d16a4bb8") : secret "dns-default-metrics-tls" not found May 20 21:49:15.392904 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:49:15.392850 2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 21:49:15.393024 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:49:15.392910 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert podName:3099afb3-7f12-4cc5-9916-e30f1ce42c8b nodeName:}" failed. No retries permitted until 2026-05-20 21:49:47.392892756 +0000 UTC m=+98.322709530 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert") pod "ingress-canary-rnmkn" (UID: "3099afb3-7f12-4cc5-9916-e30f1ce42c8b") : secret "canary-serving-cert" not found May 20 21:49:15.395341 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:15.395323 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 20 21:49:15.395401 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:15.395365 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 20 21:49:15.405650 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:15.405619 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 20 21:49:15.406516 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:15.406497 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe-original-pull-secret\") pod \"global-pull-secret-syncer-cbqtt\" (UID: \"ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe\") " pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:49:15.415791 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:15.415774 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6bqf\" (UniqueName: \"kubernetes.io/projected/b14ce8d1-3df8-4b0c-b255-a3e5bafe232b-kube-api-access-w6bqf\") pod \"network-check-target-rcvp4\" (UID: \"b14ce8d1-3df8-4b0c-b255-a3e5bafe232b\") " pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:49:15.536385 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:15.536359 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6x7hr\"" May 20 21:49:15.539358 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:15.539340 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbqtt" May 20 21:49:15.545082 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:15.545039 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:49:15.718994 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:15.718960 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rcvp4"] May 20 21:49:15.719615 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:15.719595 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cbqtt"] May 20 21:49:15.722814 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:49:15.722786 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb14ce8d1_3df8_4b0c_b255_a3e5bafe232b.slice/crio-00905c64a8a72e4fde123454e27e90553c56ac96ada3ba9596be361bcf7a803f WatchSource:0}: Error finding container 00905c64a8a72e4fde123454e27e90553c56ac96ada3ba9596be361bcf7a803f: Status 404 returned error can't find the container with id 00905c64a8a72e4fde123454e27e90553c56ac96ada3ba9596be361bcf7a803f May 20 21:49:15.723383 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:49:15.723338 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba1d0d2b_e3d1_456b_be6f_4165fb2f2bfe.slice/crio-df0e87657a24ffc2d85469e1abd37fa6b54d507dde0e7587c0174fced116b04b WatchSource:0}: Error finding container df0e87657a24ffc2d85469e1abd37fa6b54d507dde0e7587c0174fced116b04b: Status 404 returned error can't find the container with id df0e87657a24ffc2d85469e1abd37fa6b54d507dde0e7587c0174fced116b04b May 20 21:49:15.867966 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:15.867938 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rcvp4" event={"ID":"b14ce8d1-3df8-4b0c-b255-a3e5bafe232b","Type":"ContainerStarted","Data":"00905c64a8a72e4fde123454e27e90553c56ac96ada3ba9596be361bcf7a803f"} May 20 21:49:15.868829 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:15.868810 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cbqtt" event={"ID":"ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe","Type":"ContainerStarted","Data":"df0e87657a24ffc2d85469e1abd37fa6b54d507dde0e7587c0174fced116b04b"} May 20 21:49:20.880173 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:20.880139 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rcvp4" event={"ID":"b14ce8d1-3df8-4b0c-b255-a3e5bafe232b","Type":"ContainerStarted","Data":"6b7e77bdde175656ba6643cb86369a95895bf16eef35fff61b183fe18823b2c6"} May 20 21:49:20.880658 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:20.880248 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:49:20.881348 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:20.881326 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cbqtt" event={"ID":"ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe","Type":"ContainerStarted","Data":"50db87979dd2009de1ac41dc54834e7959169d9423d0571cb6a1bb2d531d9713"} May 20 21:49:20.898084 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:20.896633 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rcvp4" podStartSLOduration=67.673905584 podStartE2EDuration="1m11.896617619s" podCreationTimestamp="2026-05-20 21:48:09 +0000 UTC" firstStartedPulling="2026-05-20 21:49:15.724559612 +0000 UTC m=+66.654376336" lastFinishedPulling="2026-05-20 21:49:19.94727165 +0000 UTC m=+70.877088371" observedRunningTime="2026-05-20 21:49:20.895462723 +0000 UTC m=+71.825279468" watchObservedRunningTime="2026-05-20 21:49:20.896617619 +0000 UTC m=+71.826434363" May 20 21:49:20.910588 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:20.910553 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cbqtt" podStartSLOduration=66.685300887 podStartE2EDuration="1m10.910541896s" podCreationTimestamp="2026-05-20 21:48:10 +0000 UTC" firstStartedPulling="2026-05-20 21:49:15.724962211 +0000 UTC m=+66.654778933" lastFinishedPulling="2026-05-20 21:49:19.950203219 +0000 UTC m=+70.880019942" observedRunningTime="2026-05-20 21:49:20.910295882 +0000 UTC m=+71.840112625" watchObservedRunningTime="2026-05-20 21:49:20.910541896 +0000 UTC m=+71.840358638" May 20 21:49:47.402792 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:47.402583 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert\") pod \"ingress-canary-rnmkn\" (UID: \"3099afb3-7f12-4cc5-9916-e30f1ce42c8b\") " pod="openshift-ingress-canary/ingress-canary-rnmkn" May 20 21:49:47.402792 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:47.402675 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls\") pod \"dns-default-nxnd2\" (UID: \"53d29758-e039-4bd4-93ed-9848d16a4bb8\") " pod="openshift-dns/dns-default-nxnd2" May 20 21:49:47.402792 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:49:47.402736 2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 21:49:47.402792 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:49:47.402793 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 21:49:47.402792 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:49:47.402802 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert podName:3099afb3-7f12-4cc5-9916-e30f1ce42c8b nodeName:}" failed. No retries permitted until 2026-05-20 21:50:51.402787678 +0000 UTC m=+162.332604403 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert") pod "ingress-canary-rnmkn" (UID: "3099afb3-7f12-4cc5-9916-e30f1ce42c8b") : secret "canary-serving-cert" not found May 20 21:49:47.403317 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:49:47.402858 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls podName:53d29758-e039-4bd4-93ed-9848d16a4bb8 nodeName:}" failed. No retries permitted until 2026-05-20 21:50:51.402840306 +0000 UTC m=+162.332657045 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls") pod "dns-default-nxnd2" (UID: "53d29758-e039-4bd4-93ed-9848d16a4bb8") : secret "dns-default-metrics-tls" not found May 20 21:49:51.886428 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:49:51.886400 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rcvp4" May 20 21:50:19.303308 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:19.303274 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs\") pod \"network-metrics-daemon-hdgzt\" (UID: \"b785e9ea-de17-443e-b54a-ca50c16abeb6\") " pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:50:19.303708 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:19.303381 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 20 21:50:19.303708 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:19.303442 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs podName:b785e9ea-de17-443e-b54a-ca50c16abeb6 nodeName:}" failed. No retries permitted until 2026-05-20 21:52:21.303426853 +0000 UTC m=+252.233243574 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs") pod "network-metrics-daemon-hdgzt" (UID: "b785e9ea-de17-443e-b54a-ca50c16abeb6") : secret "metrics-daemon-secret" not found May 20 21:50:46.573417 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:46.573367 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nxnd2" podUID="53d29758-e039-4bd4-93ed-9848d16a4bb8" May 20 21:50:46.585553 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:46.585524 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-rnmkn" podUID="3099afb3-7f12-4cc5-9916-e30f1ce42c8b" May 20 21:50:47.028563 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:47.028488 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nxnd2" May 20 21:50:47.643593 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:47.643556 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hdgzt" podUID="b785e9ea-de17-443e-b54a-ca50c16abeb6" May 20 21:50:51.418059 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:51.418009 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert\") pod \"ingress-canary-rnmkn\" (UID: \"3099afb3-7f12-4cc5-9916-e30f1ce42c8b\") " pod="openshift-ingress-canary/ingress-canary-rnmkn" May 20 21:50:51.418059 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:51.418069 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls\") pod \"dns-default-nxnd2\" (UID: \"53d29758-e039-4bd4-93ed-9848d16a4bb8\") " pod="openshift-dns/dns-default-nxnd2" May 20 21:50:51.418568 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:51.418156 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 21:50:51.418568 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:51.418169 2571 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 21:50:51.418568 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:51.418216 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls podName:53d29758-e039-4bd4-93ed-9848d16a4bb8 nodeName:}" failed. No retries permitted until 2026-05-20 21:52:53.418201732 +0000 UTC m=+284.348018452 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls") pod "dns-default-nxnd2" (UID: "53d29758-e039-4bd4-93ed-9848d16a4bb8") : secret "dns-default-metrics-tls" not found May 20 21:50:51.418568 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:51.418244 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert podName:3099afb3-7f12-4cc5-9916-e30f1ce42c8b nodeName:}" failed. No retries permitted until 2026-05-20 21:52:53.41822492 +0000 UTC m=+284.348041655 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert") pod "ingress-canary-rnmkn" (UID: "3099afb3-7f12-4cc5-9916-e30f1ce42c8b") : secret "canary-serving-cert" not found May 20 21:50:53.028550 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.028518 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-5k5cf"] May 20 21:50:53.030233 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.030217 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" May 20 21:50:53.032894 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.032867 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-2fql2"] May 20 21:50:53.033033 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.032917 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 20 21:50:53.033232 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.033206 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-zgqw8\"" May 20 21:50:53.033975 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.033958 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 20 21:50:53.034051 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.033993 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 20 21:50:53.034384 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.034368 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-k6p4v"] May 20 21:50:53.034509 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.034494 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-2fql2" May 20 21:50:53.034967 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.034948 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 20 21:50:53.036078 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.036060 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-79b4479bfb-qqx5p"] May 20 21:50:53.036504 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.036487 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-k6p4v" May 20 21:50:53.038792 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.038768 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 20 21:50:53.039154 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.039133 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:50:53.039554 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.039534 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-sr5x5\"" May 20 21:50:53.040273 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.040245 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 20 21:50:53.040458 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.040439 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 20 21:50:53.040654 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.040620 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 20 21:50:53.040967 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.040916 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 20 21:50:53.041079 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.040796 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 20 21:50:53.043102 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.043083 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 20 21:50:53.043209 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.043192 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-46499\"" May 20 21:50:53.043594 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.043575 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 20 21:50:53.044691 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.044671 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 20 21:50:53.044885 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.044868 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 20 21:50:53.045072 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.044910 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 20 21:50:53.045181 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.045071 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 20 21:50:53.045181 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.044938 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 20 21:50:53.045181 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.045057 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-m7pj4\"" May 20 21:50:53.045935 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.045914 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 20 21:50:53.047546 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.047523 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 20 21:50:53.047664 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.047523 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 20 21:50:53.048464 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.048442 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-5k5cf"] May 20 21:50:53.049158 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.049139 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-2fql2"] May 20 21:50:53.051722 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.051706 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-k6p4v"] May 20 21:50:53.055570 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.055549 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79b4479bfb-qqx5p"] May 20 21:50:53.128046 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.128022 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19896b49-a875-4842-82b1-58df8c94a12f-trusted-ca\") pod \"console-operator-76dff48d59-5k5cf\" (UID: \"19896b49-a875-4842-82b1-58df8c94a12f\") " pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" May 20 21:50:53.128148 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.128054 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19896b49-a875-4842-82b1-58df8c94a12f-config\") pod \"console-operator-76dff48d59-5k5cf\" (UID: \"19896b49-a875-4842-82b1-58df8c94a12f\") " pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" May 20 21:50:53.128148 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.128071 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-metrics-certs\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:50:53.128148 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.128093 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc-tmp\") pod \"insights-operator-78bdfb888c-2fql2\" (UID: \"4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc\") " pod="openshift-insights/insights-operator-78bdfb888c-2fql2" May 20 21:50:53.128148 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.128118 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-2fql2\" (UID: \"4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc\") " pod="openshift-insights/insights-operator-78bdfb888c-2fql2" May 20 21:50:53.128275 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.128156 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19896b49-a875-4842-82b1-58df8c94a12f-serving-cert\") pod \"console-operator-76dff48d59-5k5cf\" (UID: \"19896b49-a875-4842-82b1-58df8c94a12f\") " pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" May 20 21:50:53.128275 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.128173 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6dsq\" (UniqueName: \"kubernetes.io/projected/19896b49-a875-4842-82b1-58df8c94a12f-kube-api-access-j6dsq\") pod \"console-operator-76dff48d59-5k5cf\" (UID: \"19896b49-a875-4842-82b1-58df8c94a12f\") " pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" May 20 21:50:53.128275 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.128192 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-k6p4v\" (UID: \"68adcd35-40d1-4ced-95ff-bb6dd6ded88d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-k6p4v" May 20 21:50:53.128275 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.128209 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc-snapshots\") pod \"insights-operator-78bdfb888c-2fql2\" (UID: \"4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc\") " pod="openshift-insights/insights-operator-78bdfb888c-2fql2" May 20 21:50:53.128275 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.128264 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-stats-auth\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:50:53.128463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.128324 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p526n\" (UniqueName: \"kubernetes.io/projected/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-kube-api-access-p526n\") pod \"cluster-monitoring-operator-6c75959455-k6p4v\" (UID: \"68adcd35-40d1-4ced-95ff-bb6dd6ded88d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-k6p4v" May 20 21:50:53.128463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.128347 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-default-certificate\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:50:53.128463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.128368 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpgn9\" (UniqueName: \"kubernetes.io/projected/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-kube-api-access-qpgn9\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:50:53.128463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.128421 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-service-ca-bundle\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:50:53.128463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.128437 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df48p\" (UniqueName: \"kubernetes.io/projected/4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc-kube-api-access-df48p\") pod \"insights-operator-78bdfb888c-2fql2\" (UID: \"4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc\") " pod="openshift-insights/insights-operator-78bdfb888c-2fql2" May 20 21:50:53.128463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.128457 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc-serving-cert\") pod \"insights-operator-78bdfb888c-2fql2\" (UID: \"4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc\") " pod="openshift-insights/insights-operator-78bdfb888c-2fql2" May 20 21:50:53.128691 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.128504 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-k6p4v\" (UID: \"68adcd35-40d1-4ced-95ff-bb6dd6ded88d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-k6p4v" May 20 21:50:53.128691 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.128527 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc-service-ca-bundle\") pod \"insights-operator-78bdfb888c-2fql2\" (UID: \"4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc\") " pod="openshift-insights/insights-operator-78bdfb888c-2fql2" May 20 21:50:53.129928 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.129902 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-fxjlj"] May 20 21:50:53.131509 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.131495 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-fxjlj" May 20 21:50:53.134750 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.134732 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4p89t\"" May 20 21:50:53.151802 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.151779 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-fxjlj"] May 20 21:50:53.229189 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.229164 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-stats-auth\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:50:53.229305 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.229194 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p526n\" (UniqueName: \"kubernetes.io/projected/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-kube-api-access-p526n\") pod \"cluster-monitoring-operator-6c75959455-k6p4v\" (UID: \"68adcd35-40d1-4ced-95ff-bb6dd6ded88d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-k6p4v" May 20 21:50:53.229305 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.229219 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-default-certificate\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:50:53.229305 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.229236 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qpgn9\" (UniqueName: \"kubernetes.io/projected/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-kube-api-access-qpgn9\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:50:53.229463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.229442 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snmbw\" (UniqueName: \"kubernetes.io/projected/0264616e-fcd3-49e2-a1ec-0338ed2f738d-kube-api-access-snmbw\") pod \"network-check-source-7f44b6dd87-fxjlj\" (UID: \"0264616e-fcd3-49e2-a1ec-0338ed2f738d\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-fxjlj" May 20 21:50:53.229573 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.229552 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-service-ca-bundle\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:50:53.229608 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.229585 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-df48p\" (UniqueName: \"kubernetes.io/projected/4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc-kube-api-access-df48p\") pod \"insights-operator-78bdfb888c-2fql2\" (UID: \"4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc\") " pod="openshift-insights/insights-operator-78bdfb888c-2fql2" May 20 21:50:53.229687 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.229617 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc-serving-cert\") pod \"insights-operator-78bdfb888c-2fql2\" (UID: \"4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc\") " pod="openshift-insights/insights-operator-78bdfb888c-2fql2" May 20 21:50:53.229687 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.229679 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-k6p4v\" (UID: \"68adcd35-40d1-4ced-95ff-bb6dd6ded88d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-k6p4v" May 20 21:50:53.229787 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.229709 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc-service-ca-bundle\") pod \"insights-operator-78bdfb888c-2fql2\" (UID: \"4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc\") " pod="openshift-insights/insights-operator-78bdfb888c-2fql2" May 20 21:50:53.229787 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:53.229730 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-service-ca-bundle podName:3d9fa4f6-b0e6-4d16-bc9a-c659362811db nodeName:}" failed. No retries permitted until 2026-05-20 21:50:53.729709452 +0000 UTC m=+164.659526188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-service-ca-bundle") pod "router-default-79b4479bfb-qqx5p" (UID: "3d9fa4f6-b0e6-4d16-bc9a-c659362811db") : configmap references non-existent config key: service-ca.crt May 20 21:50:53.229787 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.229771 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19896b49-a875-4842-82b1-58df8c94a12f-trusted-ca\") pod \"console-operator-76dff48d59-5k5cf\" (UID: \"19896b49-a875-4842-82b1-58df8c94a12f\") " pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" May 20 21:50:53.229941 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.229811 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19896b49-a875-4842-82b1-58df8c94a12f-config\") pod \"console-operator-76dff48d59-5k5cf\" (UID: \"19896b49-a875-4842-82b1-58df8c94a12f\") " pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" May 20 21:50:53.229941 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:53.229821 2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 20 21:50:53.229941 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.229837 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-metrics-certs\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:50:53.229941 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.229864 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc-tmp\") pod \"insights-operator-78bdfb888c-2fql2\" (UID: \"4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc\") " pod="openshift-insights/insights-operator-78bdfb888c-2fql2" May 20 21:50:53.229941 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:53.229883 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-cluster-monitoring-operator-tls podName:68adcd35-40d1-4ced-95ff-bb6dd6ded88d nodeName:}" failed. No retries permitted until 2026-05-20 21:50:53.729866097 +0000 UTC m=+164.659682835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-k6p4v" (UID: "68adcd35-40d1-4ced-95ff-bb6dd6ded88d") : secret "cluster-monitoring-operator-tls" not found May 20 21:50:53.229941 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.229917 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-2fql2\" (UID: \"4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc\") " pod="openshift-insights/insights-operator-78bdfb888c-2fql2" May 20 21:50:53.230227 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.229953 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19896b49-a875-4842-82b1-58df8c94a12f-serving-cert\") pod \"console-operator-76dff48d59-5k5cf\" (UID: \"19896b49-a875-4842-82b1-58df8c94a12f\") " pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" May 20 21:50:53.230227 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.229981 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j6dsq\" (UniqueName: \"kubernetes.io/projected/19896b49-a875-4842-82b1-58df8c94a12f-kube-api-access-j6dsq\") pod \"console-operator-76dff48d59-5k5cf\" (UID: \"19896b49-a875-4842-82b1-58df8c94a12f\") " pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" May 20 21:50:53.230227 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.230011 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-k6p4v\" (UID: \"68adcd35-40d1-4ced-95ff-bb6dd6ded88d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-k6p4v" May 20 21:50:53.230227 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.230036 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc-snapshots\") pod \"insights-operator-78bdfb888c-2fql2\" (UID: \"4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc\") " pod="openshift-insights/insights-operator-78bdfb888c-2fql2" May 20 21:50:53.230433 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.230326 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc-service-ca-bundle\") pod \"insights-operator-78bdfb888c-2fql2\" (UID: \"4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc\") " pod="openshift-insights/insights-operator-78bdfb888c-2fql2" May 20 21:50:53.230433 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:53.230395 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 20 21:50:53.230527 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:53.230446 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-metrics-certs podName:3d9fa4f6-b0e6-4d16-bc9a-c659362811db nodeName:}" failed. No retries permitted until 2026-05-20 21:50:53.730430183 +0000 UTC m=+164.660246929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-metrics-certs") pod "router-default-79b4479bfb-qqx5p" (UID: "3d9fa4f6-b0e6-4d16-bc9a-c659362811db") : secret "router-metrics-certs-default" not found May 20 21:50:53.230765 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.230744 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc-snapshots\") pod \"insights-operator-78bdfb888c-2fql2\" (UID: \"4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc\") " pod="openshift-insights/insights-operator-78bdfb888c-2fql2" May 20 21:50:53.230845 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.230801 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19896b49-a875-4842-82b1-58df8c94a12f-trusted-ca\") pod \"console-operator-76dff48d59-5k5cf\" (UID: \"19896b49-a875-4842-82b1-58df8c94a12f\") " pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" May 20 21:50:53.231087 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.231049 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc-tmp\") pod \"insights-operator-78bdfb888c-2fql2\" (UID: \"4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc\") " pod="openshift-insights/insights-operator-78bdfb888c-2fql2" May 20 21:50:53.231279 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.231198 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-k6p4v\" (UID: \"68adcd35-40d1-4ced-95ff-bb6dd6ded88d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-k6p4v" May 20 21:50:53.231406 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.231274 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-2fql2\" (UID: \"4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc\") " pod="openshift-insights/insights-operator-78bdfb888c-2fql2" May 20 21:50:53.231406 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.231335 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19896b49-a875-4842-82b1-58df8c94a12f-config\") pod \"console-operator-76dff48d59-5k5cf\" (UID: \"19896b49-a875-4842-82b1-58df8c94a12f\") " pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" May 20 21:50:53.232199 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.232180 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-stats-auth\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:50:53.232268 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.232245 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-default-certificate\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:50:53.232583 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.232565 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc-serving-cert\") pod \"insights-operator-78bdfb888c-2fql2\" (UID: \"4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc\") " pod="openshift-insights/insights-operator-78bdfb888c-2fql2" May 20 21:50:53.233406 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.233390 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19896b49-a875-4842-82b1-58df8c94a12f-serving-cert\") pod \"console-operator-76dff48d59-5k5cf\" (UID: \"19896b49-a875-4842-82b1-58df8c94a12f\") " pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" May 20 21:50:53.238830 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.238529 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6dsq\" (UniqueName: \"kubernetes.io/projected/19896b49-a875-4842-82b1-58df8c94a12f-kube-api-access-j6dsq\") pod \"console-operator-76dff48d59-5k5cf\" (UID: \"19896b49-a875-4842-82b1-58df8c94a12f\") " pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" May 20 21:50:53.238830 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.238568 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p526n\" (UniqueName: \"kubernetes.io/projected/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-kube-api-access-p526n\") pod \"cluster-monitoring-operator-6c75959455-k6p4v\" (UID: \"68adcd35-40d1-4ced-95ff-bb6dd6ded88d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-k6p4v" May 20 21:50:53.238830 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.238791 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df48p\" (UniqueName: \"kubernetes.io/projected/4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc-kube-api-access-df48p\") pod \"insights-operator-78bdfb888c-2fql2\" (UID: \"4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc\") " pod="openshift-insights/insights-operator-78bdfb888c-2fql2" May 20 21:50:53.239198 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.239176 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpgn9\" (UniqueName: \"kubernetes.io/projected/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-kube-api-access-qpgn9\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:50:53.330351 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.330309 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snmbw\" (UniqueName: \"kubernetes.io/projected/0264616e-fcd3-49e2-a1ec-0338ed2f738d-kube-api-access-snmbw\") pod \"network-check-source-7f44b6dd87-fxjlj\" (UID: \"0264616e-fcd3-49e2-a1ec-0338ed2f738d\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-fxjlj" May 20 21:50:53.338090 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.338071 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snmbw\" (UniqueName: \"kubernetes.io/projected/0264616e-fcd3-49e2-a1ec-0338ed2f738d-kube-api-access-snmbw\") pod \"network-check-source-7f44b6dd87-fxjlj\" (UID: \"0264616e-fcd3-49e2-a1ec-0338ed2f738d\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-fxjlj" May 20 21:50:53.346903 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.346881 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" May 20 21:50:53.353784 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.353581 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-2fql2" May 20 21:50:53.439994 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.439939 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-fxjlj" May 20 21:50:53.469154 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.469119 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-5k5cf"] May 20 21:50:53.471951 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:50:53.471916 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19896b49_a875_4842_82b1_58df8c94a12f.slice/crio-8d51beb63b2ab7e87e59451ad2fd3e6afed9f04e6f8f5645b89d11fbb350d499 WatchSource:0}: Error finding container 8d51beb63b2ab7e87e59451ad2fd3e6afed9f04e6f8f5645b89d11fbb350d499: Status 404 returned error can't find the container with id 8d51beb63b2ab7e87e59451ad2fd3e6afed9f04e6f8f5645b89d11fbb350d499 May 20 21:50:53.487419 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.487261 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-2fql2"] May 20 21:50:53.490263 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:50:53.490220 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bb6cdfb_f9d6_4abd_afdc_98075e9ca4bc.slice/crio-fd4076a5104b9a15eae7fe51f3c84fd5105c685b715231d3269eb4b34c73e515 WatchSource:0}: Error finding container fd4076a5104b9a15eae7fe51f3c84fd5105c685b715231d3269eb4b34c73e515: Status 404 returned error can't find the container with id fd4076a5104b9a15eae7fe51f3c84fd5105c685b715231d3269eb4b34c73e515 May 20 21:50:53.559836 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.559806 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-fxjlj"] May 20 21:50:53.562820 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:50:53.562795 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0264616e_fcd3_49e2_a1ec_0338ed2f738d.slice/crio-a28cd604e486f30b3eb611aa45ff9194b79ec275f5b0e98379c5e6f0accb2032 WatchSource:0}: Error finding container a28cd604e486f30b3eb611aa45ff9194b79ec275f5b0e98379c5e6f0accb2032: Status 404 returned error can't find the container with id a28cd604e486f30b3eb611aa45ff9194b79ec275f5b0e98379c5e6f0accb2032 May 20 21:50:53.734037 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.733994 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-service-ca-bundle\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:50:53.734187 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:53.734121 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-service-ca-bundle podName:3d9fa4f6-b0e6-4d16-bc9a-c659362811db nodeName:}" failed. No retries permitted until 2026-05-20 21:50:54.734106557 +0000 UTC m=+165.663923278 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-service-ca-bundle") pod "router-default-79b4479bfb-qqx5p" (UID: "3d9fa4f6-b0e6-4d16-bc9a-c659362811db") : configmap references non-existent config key: service-ca.crt May 20 21:50:53.734187 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.734144 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-k6p4v\" (UID: \"68adcd35-40d1-4ced-95ff-bb6dd6ded88d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-k6p4v" May 20 21:50:53.734187 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:53.734174 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-metrics-certs\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:50:53.734368 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:53.734262 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 20 21:50:53.734368 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:53.734270 2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 20 21:50:53.734368 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:53.734303 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-metrics-certs podName:3d9fa4f6-b0e6-4d16-bc9a-c659362811db nodeName:}" failed. No retries permitted until 2026-05-20 21:50:54.73429192 +0000 UTC m=+165.664108643 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-metrics-certs") pod "router-default-79b4479bfb-qqx5p" (UID: "3d9fa4f6-b0e6-4d16-bc9a-c659362811db") : secret "router-metrics-certs-default" not found May 20 21:50:53.734368 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:53.734329 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-cluster-monitoring-operator-tls podName:68adcd35-40d1-4ced-95ff-bb6dd6ded88d nodeName:}" failed. No retries permitted until 2026-05-20 21:50:54.734312451 +0000 UTC m=+165.664129188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-k6p4v" (UID: "68adcd35-40d1-4ced-95ff-bb6dd6ded88d") : secret "cluster-monitoring-operator-tls" not found May 20 21:50:54.047032 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:54.046942 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" event={"ID":"19896b49-a875-4842-82b1-58df8c94a12f","Type":"ContainerStarted","Data":"8d51beb63b2ab7e87e59451ad2fd3e6afed9f04e6f8f5645b89d11fbb350d499"} May 20 21:50:54.048473 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:54.048433 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-fxjlj" event={"ID":"0264616e-fcd3-49e2-a1ec-0338ed2f738d","Type":"ContainerStarted","Data":"82ff2afd3dd1c3e4bfa09be4348e4d9305dbfc4054893f33b0aa16e853e6a830"} May 20 21:50:54.048473 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:54.048469 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-fxjlj" event={"ID":"0264616e-fcd3-49e2-a1ec-0338ed2f738d","Type":"ContainerStarted","Data":"a28cd604e486f30b3eb611aa45ff9194b79ec275f5b0e98379c5e6f0accb2032"} May 20 21:50:54.049556 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:54.049528 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-2fql2" event={"ID":"4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc","Type":"ContainerStarted","Data":"fd4076a5104b9a15eae7fe51f3c84fd5105c685b715231d3269eb4b34c73e515"} May 20 21:50:54.064500 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:54.064448 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-fxjlj" podStartSLOduration=1.064434498 podStartE2EDuration="1.064434498s" podCreationTimestamp="2026-05-20 21:50:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:50:54.063862104 +0000 UTC m=+164.993678852" watchObservedRunningTime="2026-05-20 21:50:54.064434498 +0000 UTC m=+164.994251242" May 20 21:50:54.741765 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:54.741721 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-service-ca-bundle\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:50:54.741957 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:54.741798 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-k6p4v\" (UID: \"68adcd35-40d1-4ced-95ff-bb6dd6ded88d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-k6p4v" May 20 21:50:54.741957 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:54.741843 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-metrics-certs\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:50:54.741957 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:54.741935 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-service-ca-bundle podName:3d9fa4f6-b0e6-4d16-bc9a-c659362811db nodeName:}" failed. No retries permitted until 2026-05-20 21:50:56.741910496 +0000 UTC m=+167.671727234 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-service-ca-bundle") pod "router-default-79b4479bfb-qqx5p" (UID: "3d9fa4f6-b0e6-4d16-bc9a-c659362811db") : configmap references non-existent config key: service-ca.crt May 20 21:50:54.741957 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:54.741953 2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 20 21:50:54.742143 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:54.741986 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 20 21:50:54.742143 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:54.742002 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-cluster-monitoring-operator-tls podName:68adcd35-40d1-4ced-95ff-bb6dd6ded88d nodeName:}" failed. No retries permitted until 2026-05-20 21:50:56.741989634 +0000 UTC m=+167.671806359 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-k6p4v" (UID: "68adcd35-40d1-4ced-95ff-bb6dd6ded88d") : secret "cluster-monitoring-operator-tls" not found May 20 21:50:54.742143 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:54.742039 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-metrics-certs podName:3d9fa4f6-b0e6-4d16-bc9a-c659362811db nodeName:}" failed. No retries permitted until 2026-05-20 21:50:56.742019846 +0000 UTC m=+167.671836576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-metrics-certs") pod "router-default-79b4479bfb-qqx5p" (UID: "3d9fa4f6-b0e6-4d16-bc9a-c659362811db") : secret "router-metrics-certs-default" not found May 20 21:50:56.054835 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:56.054800 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-2fql2" event={"ID":"4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc","Type":"ContainerStarted","Data":"ca873a696b15ecc2184ddf352821581d448f59ecc4d5964e485a31e829274d78"} May 20 21:50:56.056476 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:56.056453 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/0.log" May 20 21:50:56.056601 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:56.056494 2571 generic.go:358] "Generic (PLEG): container finished" podID="19896b49-a875-4842-82b1-58df8c94a12f" containerID="eeb8496ed83a1a6371079ac9b040754ed343c8958e07c473920487796bc7a663" exitCode=255 May 20 21:50:56.056601 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:56.056544 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" event={"ID":"19896b49-a875-4842-82b1-58df8c94a12f","Type":"ContainerDied","Data":"eeb8496ed83a1a6371079ac9b040754ed343c8958e07c473920487796bc7a663"} May 20 21:50:56.056817 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:56.056801 2571 scope.go:117] "RemoveContainer" containerID="eeb8496ed83a1a6371079ac9b040754ed343c8958e07c473920487796bc7a663" May 20 21:50:56.072178 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:56.072134 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-2fql2" podStartSLOduration=0.74109493 podStartE2EDuration="3.072116395s" podCreationTimestamp="2026-05-20 21:50:53 +0000 UTC" firstStartedPulling="2026-05-20 21:50:53.492631644 +0000 UTC m=+164.422448365" lastFinishedPulling="2026-05-20 21:50:55.823653096 +0000 UTC m=+166.753469830" observedRunningTime="2026-05-20 21:50:56.071447734 +0000 UTC m=+167.001264490" watchObservedRunningTime="2026-05-20 21:50:56.072116395 +0000 UTC m=+167.001933132" May 20 21:50:56.757776 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:56.757729 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-service-ca-bundle\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:50:56.757948 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:56.757798 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-k6p4v\" (UID: \"68adcd35-40d1-4ced-95ff-bb6dd6ded88d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-k6p4v" May 20 21:50:56.757948 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:56.757843 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-metrics-certs\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:50:56.757948 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:56.757903 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-service-ca-bundle podName:3d9fa4f6-b0e6-4d16-bc9a-c659362811db nodeName:}" failed. No retries permitted until 2026-05-20 21:51:00.757882769 +0000 UTC m=+171.687699509 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-service-ca-bundle") pod "router-default-79b4479bfb-qqx5p" (UID: "3d9fa4f6-b0e6-4d16-bc9a-c659362811db") : configmap references non-existent config key: service-ca.crt May 20 21:50:56.757948 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:56.757944 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 20 21:50:56.758115 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:56.757946 2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 20 21:50:56.758115 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:56.757988 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-metrics-certs podName:3d9fa4f6-b0e6-4d16-bc9a-c659362811db nodeName:}" failed. No retries permitted until 2026-05-20 21:51:00.757976833 +0000 UTC m=+171.687793568 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-metrics-certs") pod "router-default-79b4479bfb-qqx5p" (UID: "3d9fa4f6-b0e6-4d16-bc9a-c659362811db") : secret "router-metrics-certs-default" not found May 20 21:50:56.758115 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:56.758005 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-cluster-monitoring-operator-tls podName:68adcd35-40d1-4ced-95ff-bb6dd6ded88d nodeName:}" failed. No retries permitted until 2026-05-20 21:51:00.757996022 +0000 UTC m=+171.687812747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-k6p4v" (UID: "68adcd35-40d1-4ced-95ff-bb6dd6ded88d") : secret "cluster-monitoring-operator-tls" not found May 20 21:50:57.060653 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:57.060623 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/1.log" May 20 21:50:57.061072 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:57.061052 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/0.log" May 20 21:50:57.061137 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:57.061094 2571 generic.go:358] "Generic (PLEG): container finished" podID="19896b49-a875-4842-82b1-58df8c94a12f" containerID="857a4c661aedd147a3e76c8bd1e96ed2fa5f3753e869ae3479a55cea87bebe27" exitCode=255 May 20 21:50:57.061190 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:57.061172 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" event={"ID":"19896b49-a875-4842-82b1-58df8c94a12f","Type":"ContainerDied","Data":"857a4c661aedd147a3e76c8bd1e96ed2fa5f3753e869ae3479a55cea87bebe27"} May 20 21:50:57.061240 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:57.061210 2571 scope.go:117] "RemoveContainer" containerID="eeb8496ed83a1a6371079ac9b040754ed343c8958e07c473920487796bc7a663" May 20 21:50:57.061383 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:57.061367 2571 scope.go:117] "RemoveContainer" containerID="857a4c661aedd147a3e76c8bd1e96ed2fa5f3753e869ae3479a55cea87bebe27" May 20 21:50:57.061589 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:57.061559 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-5k5cf_openshift-console-operator(19896b49-a875-4842-82b1-58df8c94a12f)\"" pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" podUID="19896b49-a875-4842-82b1-58df8c94a12f" May 20 21:50:58.064699 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:58.064670 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/1.log" May 20 21:50:58.065099 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:58.064998 2571 scope.go:117] "RemoveContainer" containerID="857a4c661aedd147a3e76c8bd1e96ed2fa5f3753e869ae3479a55cea87bebe27" May 20 21:50:58.065166 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:50:58.065148 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-5k5cf_openshift-console-operator(19896b49-a875-4842-82b1-58df8c94a12f)\"" pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" podUID="19896b49-a875-4842-82b1-58df8c94a12f" May 20 21:50:58.435363 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:58.435291 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6wwrr_cf000cdd-dfa0-43d2-9df8-84baf9a14af4/dns-node-resolver/0.log" May 20 21:50:59.430406 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:50:59.430327 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-68fgb_aec000a4-9bb5-43e5-b40a-cfe251c18da5/node-ca/0.log" May 20 21:51:00.623947 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:00.623920 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rnmkn" May 20 21:51:00.787687 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:00.787654 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-service-ca-bundle\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:51:00.787832 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:00.787709 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-k6p4v\" (UID: \"68adcd35-40d1-4ced-95ff-bb6dd6ded88d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-k6p4v" May 20 21:51:00.787832 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:00.787740 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-metrics-certs\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:51:00.787902 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:51:00.787832 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-service-ca-bundle podName:3d9fa4f6-b0e6-4d16-bc9a-c659362811db nodeName:}" failed. No retries permitted until 2026-05-20 21:51:08.787809983 +0000 UTC m=+179.717626727 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-service-ca-bundle") pod "router-default-79b4479bfb-qqx5p" (UID: "3d9fa4f6-b0e6-4d16-bc9a-c659362811db") : configmap references non-existent config key: service-ca.crt May 20 21:51:00.787902 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:51:00.787835 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 20 21:51:00.787902 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:51:00.787884 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-metrics-certs podName:3d9fa4f6-b0e6-4d16-bc9a-c659362811db nodeName:}" failed. No retries permitted until 2026-05-20 21:51:08.78787283 +0000 UTC m=+179.717689568 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-metrics-certs") pod "router-default-79b4479bfb-qqx5p" (UID: "3d9fa4f6-b0e6-4d16-bc9a-c659362811db") : secret "router-metrics-certs-default" not found May 20 21:51:00.787902 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:51:00.787835 2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 20 21:51:00.788027 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:51:00.787928 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-cluster-monitoring-operator-tls podName:68adcd35-40d1-4ced-95ff-bb6dd6ded88d nodeName:}" failed. No retries permitted until 2026-05-20 21:51:08.7879188 +0000 UTC m=+179.717735525 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-k6p4v" (UID: "68adcd35-40d1-4ced-95ff-bb6dd6ded88d") : secret "cluster-monitoring-operator-tls" not found May 20 21:51:02.624000 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:02.623966 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:51:03.347488 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:03.347446 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" May 20 21:51:03.347675 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:03.347536 2571 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" May 20 21:51:03.347823 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:03.347810 2571 scope.go:117] "RemoveContainer" containerID="857a4c661aedd147a3e76c8bd1e96ed2fa5f3753e869ae3479a55cea87bebe27" May 20 21:51:03.347998 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:51:03.347981 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-5k5cf_openshift-console-operator(19896b49-a875-4842-82b1-58df8c94a12f)\"" pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" podUID="19896b49-a875-4842-82b1-58df8c94a12f" May 20 21:51:04.076720 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:04.076695 2571 scope.go:117] "RemoveContainer" containerID="857a4c661aedd147a3e76c8bd1e96ed2fa5f3753e869ae3479a55cea87bebe27" May 20 21:51:04.077064 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:51:04.076893 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-5k5cf_openshift-console-operator(19896b49-a875-4842-82b1-58df8c94a12f)\"" pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" podUID="19896b49-a875-4842-82b1-58df8c94a12f" May 20 21:51:08.849932 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:08.849896 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-service-ca-bundle\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:51:08.850316 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:08.849944 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-k6p4v\" (UID: \"68adcd35-40d1-4ced-95ff-bb6dd6ded88d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-k6p4v" May 20 21:51:08.850316 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:08.849973 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-metrics-certs\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:51:08.850316 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:51:08.850095 2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 20 21:51:08.850316 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:51:08.850170 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-cluster-monitoring-operator-tls podName:68adcd35-40d1-4ced-95ff-bb6dd6ded88d nodeName:}" failed. No retries permitted until 2026-05-20 21:51:24.850154207 +0000 UTC m=+195.779970937 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-k6p4v" (UID: "68adcd35-40d1-4ced-95ff-bb6dd6ded88d") : secret "cluster-monitoring-operator-tls" not found May 20 21:51:08.850481 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:08.850431 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-service-ca-bundle\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:51:08.852069 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:08.852051 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d9fa4f6-b0e6-4d16-bc9a-c659362811db-metrics-certs\") pod \"router-default-79b4479bfb-qqx5p\" (UID: \"3d9fa4f6-b0e6-4d16-bc9a-c659362811db\") " pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:51:08.965556 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:08.965522 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:51:09.086003 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:09.085974 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79b4479bfb-qqx5p"] May 20 21:51:09.089264 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:51:09.089236 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d9fa4f6_b0e6_4d16_bc9a_c659362811db.slice/crio-600bc29145e00979253044562a5eecfaac4f9b140fbcd9ee50a994069fd671b7 WatchSource:0}: Error finding container 600bc29145e00979253044562a5eecfaac4f9b140fbcd9ee50a994069fd671b7: Status 404 returned error can't find the container with id 600bc29145e00979253044562a5eecfaac4f9b140fbcd9ee50a994069fd671b7 May 20 21:51:10.090752 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:10.090714 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79b4479bfb-qqx5p" event={"ID":"3d9fa4f6-b0e6-4d16-bc9a-c659362811db","Type":"ContainerStarted","Data":"69037c287201654305d9d015a5e96050ef01caf07674733a1bbaf9412296ed07"} May 20 21:51:10.090752 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:10.090754 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79b4479bfb-qqx5p" event={"ID":"3d9fa4f6-b0e6-4d16-bc9a-c659362811db","Type":"ContainerStarted","Data":"600bc29145e00979253044562a5eecfaac4f9b140fbcd9ee50a994069fd671b7"} May 20 21:51:10.109538 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:10.109492 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-79b4479bfb-qqx5p" podStartSLOduration=17.109479633 podStartE2EDuration="17.109479633s" podCreationTimestamp="2026-05-20 21:50:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:51:10.108949695 +0000 UTC m=+181.038766438" watchObservedRunningTime="2026-05-20 21:51:10.109479633 +0000 UTC m=+181.039296376" May 20 21:51:10.966745 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:10.966710 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:51:10.969077 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:10.969055 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:51:11.093201 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:11.093174 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:51:11.094344 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:11.094321 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-79b4479bfb-qqx5p" May 20 21:51:18.624524 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.624496 2571 scope.go:117] "RemoveContainer" containerID="857a4c661aedd147a3e76c8bd1e96ed2fa5f3753e869ae3479a55cea87bebe27" May 20 21:51:18.764603 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.764570 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wrb8d"] May 20 21:51:18.768046 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.768027 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wrb8d" May 20 21:51:18.771878 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.771848 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 20 21:51:18.772091 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.772077 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4kzp2\"" May 20 21:51:18.775623 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.775220 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f4bddfcf6-8tts7"] May 20 21:51:18.776260 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.776241 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 20 21:51:18.778144 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.778126 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:18.784566 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.784265 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wrb8d"] May 20 21:51:18.786227 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.786209 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 20 21:51:18.786387 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.786370 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n8st6\"" May 20 21:51:18.787053 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.787037 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 20 21:51:18.787146 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.787054 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 20 21:51:18.794950 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.794933 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 20 21:51:18.805925 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.805898 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f4bddfcf6-8tts7"] May 20 21:51:18.823543 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.823517 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d92c9a24-562d-4c33-bf6d-20a6a30063cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wrb8d\" (UID: \"d92c9a24-562d-4c33-bf6d-20a6a30063cc\") " pod="openshift-insights/insights-runtime-extractor-wrb8d" May 20 21:51:18.823679 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.823548 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc88s\" (UniqueName: \"kubernetes.io/projected/d92c9a24-562d-4c33-bf6d-20a6a30063cc-kube-api-access-sc88s\") pod \"insights-runtime-extractor-wrb8d\" (UID: \"d92c9a24-562d-4c33-bf6d-20a6a30063cc\") " pod="openshift-insights/insights-runtime-extractor-wrb8d" May 20 21:51:18.823679 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.823577 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f076b995-22bf-420a-aa9b-a1d15f41c868-bound-sa-token\") pod \"image-registry-f4bddfcf6-8tts7\" (UID: \"f076b995-22bf-420a-aa9b-a1d15f41c868\") " pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:18.823679 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.823668 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d92c9a24-562d-4c33-bf6d-20a6a30063cc-data-volume\") pod \"insights-runtime-extractor-wrb8d\" (UID: \"d92c9a24-562d-4c33-bf6d-20a6a30063cc\") " pod="openshift-insights/insights-runtime-extractor-wrb8d" May 20 21:51:18.823793 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.823690 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f076b995-22bf-420a-aa9b-a1d15f41c868-image-registry-private-configuration\") pod \"image-registry-f4bddfcf6-8tts7\" (UID: \"f076b995-22bf-420a-aa9b-a1d15f41c868\") " pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:18.823793 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.823706 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f076b995-22bf-420a-aa9b-a1d15f41c868-trusted-ca\") pod \"image-registry-f4bddfcf6-8tts7\" (UID: \"f076b995-22bf-420a-aa9b-a1d15f41c868\") " pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:18.823863 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.823777 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4tg9\" (UniqueName: \"kubernetes.io/projected/f076b995-22bf-420a-aa9b-a1d15f41c868-kube-api-access-h4tg9\") pod \"image-registry-f4bddfcf6-8tts7\" (UID: \"f076b995-22bf-420a-aa9b-a1d15f41c868\") " pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:18.823863 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.823824 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d92c9a24-562d-4c33-bf6d-20a6a30063cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wrb8d\" (UID: \"d92c9a24-562d-4c33-bf6d-20a6a30063cc\") " pod="openshift-insights/insights-runtime-extractor-wrb8d" May 20 21:51:18.823863 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.823846 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f076b995-22bf-420a-aa9b-a1d15f41c868-installation-pull-secrets\") pod \"image-registry-f4bddfcf6-8tts7\" (UID: \"f076b995-22bf-420a-aa9b-a1d15f41c868\") " pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:18.823863 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.823861 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f076b995-22bf-420a-aa9b-a1d15f41c868-registry-tls\") pod \"image-registry-f4bddfcf6-8tts7\" (UID: \"f076b995-22bf-420a-aa9b-a1d15f41c868\") " pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:18.823992 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.823923 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f076b995-22bf-420a-aa9b-a1d15f41c868-registry-certificates\") pod \"image-registry-f4bddfcf6-8tts7\" (UID: \"f076b995-22bf-420a-aa9b-a1d15f41c868\") " pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:18.823992 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.823942 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f076b995-22bf-420a-aa9b-a1d15f41c868-ca-trust-extracted\") pod \"image-registry-f4bddfcf6-8tts7\" (UID: \"f076b995-22bf-420a-aa9b-a1d15f41c868\") " pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:18.823992 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.823965 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d92c9a24-562d-4c33-bf6d-20a6a30063cc-crio-socket\") pod \"insights-runtime-extractor-wrb8d\" (UID: \"d92c9a24-562d-4c33-bf6d-20a6a30063cc\") " pod="openshift-insights/insights-runtime-extractor-wrb8d" May 20 21:51:18.924335 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.924266 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f076b995-22bf-420a-aa9b-a1d15f41c868-registry-certificates\") pod \"image-registry-f4bddfcf6-8tts7\" (UID: \"f076b995-22bf-420a-aa9b-a1d15f41c868\") " pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:18.924335 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.924297 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f076b995-22bf-420a-aa9b-a1d15f41c868-ca-trust-extracted\") pod \"image-registry-f4bddfcf6-8tts7\" (UID: \"f076b995-22bf-420a-aa9b-a1d15f41c868\") " pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:18.924335 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.924316 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d92c9a24-562d-4c33-bf6d-20a6a30063cc-crio-socket\") pod \"insights-runtime-extractor-wrb8d\" (UID: \"d92c9a24-562d-4c33-bf6d-20a6a30063cc\") " pod="openshift-insights/insights-runtime-extractor-wrb8d" May 20 21:51:18.924552 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.924525 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d92c9a24-562d-4c33-bf6d-20a6a30063cc-crio-socket\") pod \"insights-runtime-extractor-wrb8d\" (UID: \"d92c9a24-562d-4c33-bf6d-20a6a30063cc\") " pod="openshift-insights/insights-runtime-extractor-wrb8d" May 20 21:51:18.924552 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.924541 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d92c9a24-562d-4c33-bf6d-20a6a30063cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wrb8d\" (UID: \"d92c9a24-562d-4c33-bf6d-20a6a30063cc\") " pod="openshift-insights/insights-runtime-extractor-wrb8d" May 20 21:51:18.924678 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.924572 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sc88s\" (UniqueName: \"kubernetes.io/projected/d92c9a24-562d-4c33-bf6d-20a6a30063cc-kube-api-access-sc88s\") pod \"insights-runtime-extractor-wrb8d\" (UID: \"d92c9a24-562d-4c33-bf6d-20a6a30063cc\") " pod="openshift-insights/insights-runtime-extractor-wrb8d" May 20 21:51:18.924678 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.924617 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f076b995-22bf-420a-aa9b-a1d15f41c868-bound-sa-token\") pod \"image-registry-f4bddfcf6-8tts7\" (UID: \"f076b995-22bf-420a-aa9b-a1d15f41c868\") " pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:18.924787 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.924692 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d92c9a24-562d-4c33-bf6d-20a6a30063cc-data-volume\") pod \"insights-runtime-extractor-wrb8d\" (UID: \"d92c9a24-562d-4c33-bf6d-20a6a30063cc\") " pod="openshift-insights/insights-runtime-extractor-wrb8d" May 20 21:51:18.924787 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.924723 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f076b995-22bf-420a-aa9b-a1d15f41c868-image-registry-private-configuration\") pod \"image-registry-f4bddfcf6-8tts7\" (UID: \"f076b995-22bf-420a-aa9b-a1d15f41c868\") " pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:18.924787 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.924747 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f076b995-22bf-420a-aa9b-a1d15f41c868-trusted-ca\") pod \"image-registry-f4bddfcf6-8tts7\" (UID: \"f076b995-22bf-420a-aa9b-a1d15f41c868\") " pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:18.924914 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.924796 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f076b995-22bf-420a-aa9b-a1d15f41c868-ca-trust-extracted\") pod \"image-registry-f4bddfcf6-8tts7\" (UID: \"f076b995-22bf-420a-aa9b-a1d15f41c868\") " pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:18.925353 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.924916 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h4tg9\" (UniqueName: \"kubernetes.io/projected/f076b995-22bf-420a-aa9b-a1d15f41c868-kube-api-access-h4tg9\") pod \"image-registry-f4bddfcf6-8tts7\" (UID: \"f076b995-22bf-420a-aa9b-a1d15f41c868\") " pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:18.925453 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.925415 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d92c9a24-562d-4c33-bf6d-20a6a30063cc-data-volume\") pod \"insights-runtime-extractor-wrb8d\" (UID: \"d92c9a24-562d-4c33-bf6d-20a6a30063cc\") " pod="openshift-insights/insights-runtime-extractor-wrb8d" May 20 21:51:18.925507 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.925415 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d92c9a24-562d-4c33-bf6d-20a6a30063cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wrb8d\" (UID: \"d92c9a24-562d-4c33-bf6d-20a6a30063cc\") " pod="openshift-insights/insights-runtime-extractor-wrb8d" May 20 21:51:18.925507 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.925467 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f076b995-22bf-420a-aa9b-a1d15f41c868-registry-certificates\") pod \"image-registry-f4bddfcf6-8tts7\" (UID: \"f076b995-22bf-420a-aa9b-a1d15f41c868\") " pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:18.925507 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.925498 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f076b995-22bf-420a-aa9b-a1d15f41c868-installation-pull-secrets\") pod \"image-registry-f4bddfcf6-8tts7\" (UID: \"f076b995-22bf-420a-aa9b-a1d15f41c868\") " pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:18.925665 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.925597 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f076b995-22bf-420a-aa9b-a1d15f41c868-registry-tls\") pod \"image-registry-f4bddfcf6-8tts7\" (UID: \"f076b995-22bf-420a-aa9b-a1d15f41c868\") " pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:18.926100 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.926070 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d92c9a24-562d-4c33-bf6d-20a6a30063cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wrb8d\" (UID: \"d92c9a24-562d-4c33-bf6d-20a6a30063cc\") " pod="openshift-insights/insights-runtime-extractor-wrb8d" May 20 21:51:18.926767 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.926745 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f076b995-22bf-420a-aa9b-a1d15f41c868-trusted-ca\") pod \"image-registry-f4bddfcf6-8tts7\" (UID: \"f076b995-22bf-420a-aa9b-a1d15f41c868\") " pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:18.930252 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.927914 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d92c9a24-562d-4c33-bf6d-20a6a30063cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wrb8d\" (UID: \"d92c9a24-562d-4c33-bf6d-20a6a30063cc\") " pod="openshift-insights/insights-runtime-extractor-wrb8d" May 20 21:51:18.930252 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.928896 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f076b995-22bf-420a-aa9b-a1d15f41c868-image-registry-private-configuration\") pod \"image-registry-f4bddfcf6-8tts7\" (UID: \"f076b995-22bf-420a-aa9b-a1d15f41c868\") " pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:18.931057 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.931038 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f076b995-22bf-420a-aa9b-a1d15f41c868-registry-tls\") pod \"image-registry-f4bddfcf6-8tts7\" (UID: \"f076b995-22bf-420a-aa9b-a1d15f41c868\") " pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:18.931144 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.931100 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f076b995-22bf-420a-aa9b-a1d15f41c868-installation-pull-secrets\") pod \"image-registry-f4bddfcf6-8tts7\" (UID: \"f076b995-22bf-420a-aa9b-a1d15f41c868\") " pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:18.934097 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.934073 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc88s\" (UniqueName: \"kubernetes.io/projected/d92c9a24-562d-4c33-bf6d-20a6a30063cc-kube-api-access-sc88s\") pod \"insights-runtime-extractor-wrb8d\" (UID: \"d92c9a24-562d-4c33-bf6d-20a6a30063cc\") " pod="openshift-insights/insights-runtime-extractor-wrb8d" May 20 21:51:18.934497 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.934475 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f076b995-22bf-420a-aa9b-a1d15f41c868-bound-sa-token\") pod \"image-registry-f4bddfcf6-8tts7\" (UID: \"f076b995-22bf-420a-aa9b-a1d15f41c868\") " pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:18.934704 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:18.934687 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4tg9\" (UniqueName: \"kubernetes.io/projected/f076b995-22bf-420a-aa9b-a1d15f41c868-kube-api-access-h4tg9\") pod \"image-registry-f4bddfcf6-8tts7\" (UID: \"f076b995-22bf-420a-aa9b-a1d15f41c868\") " pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:19.078598 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:19.078566 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wrb8d" May 20 21:51:19.087946 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:19.087898 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:19.114079 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:19.114054 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/2.log" May 20 21:51:19.114478 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:19.114461 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/1.log" May 20 21:51:19.114555 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:19.114498 2571 generic.go:358] "Generic (PLEG): container finished" podID="19896b49-a875-4842-82b1-58df8c94a12f" containerID="432bdb35f513ce22cf87e49cbb3cde0fafff24a68cb79212d05be19d028b3ad4" exitCode=255 May 20 21:51:19.114555 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:19.114544 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" event={"ID":"19896b49-a875-4842-82b1-58df8c94a12f","Type":"ContainerDied","Data":"432bdb35f513ce22cf87e49cbb3cde0fafff24a68cb79212d05be19d028b3ad4"} May 20 21:51:19.114673 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:19.114583 2571 scope.go:117] "RemoveContainer" containerID="857a4c661aedd147a3e76c8bd1e96ed2fa5f3753e869ae3479a55cea87bebe27" May 20 21:51:19.115001 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:19.114980 2571 scope.go:117] "RemoveContainer" containerID="432bdb35f513ce22cf87e49cbb3cde0fafff24a68cb79212d05be19d028b3ad4" May 20 21:51:19.115230 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:51:19.115204 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-5k5cf_openshift-console-operator(19896b49-a875-4842-82b1-58df8c94a12f)\"" pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" podUID="19896b49-a875-4842-82b1-58df8c94a12f" May 20 21:51:19.213100 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:19.213073 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wrb8d"] May 20 21:51:19.216221 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:51:19.216199 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd92c9a24_562d_4c33_bf6d_20a6a30063cc.slice/crio-96eab2f0076b3e91ffac00c122ca8fb0bae2f1da0aaa8a0d9d656b96deec5cba WatchSource:0}: Error finding container 96eab2f0076b3e91ffac00c122ca8fb0bae2f1da0aaa8a0d9d656b96deec5cba: Status 404 returned error can't find the container with id 96eab2f0076b3e91ffac00c122ca8fb0bae2f1da0aaa8a0d9d656b96deec5cba May 20 21:51:19.229012 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:19.228988 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f4bddfcf6-8tts7"] May 20 21:51:19.231973 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:51:19.231953 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf076b995_22bf_420a_aa9b_a1d15f41c868.slice/crio-03250f73418279627e47b44e10efa916cef386404230bdddf1e22046163536e8 WatchSource:0}: Error finding container 03250f73418279627e47b44e10efa916cef386404230bdddf1e22046163536e8: Status 404 returned error can't find the container with id 03250f73418279627e47b44e10efa916cef386404230bdddf1e22046163536e8 May 20 21:51:20.119146 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:20.119124 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/2.log" May 20 21:51:20.120420 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:20.120392 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" event={"ID":"f076b995-22bf-420a-aa9b-a1d15f41c868","Type":"ContainerStarted","Data":"9dbb009764171ced82546d59c66411804a172b8b7cf1881fb4fc6e2cacae26ed"} May 20 21:51:20.120506 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:20.120427 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" event={"ID":"f076b995-22bf-420a-aa9b-a1d15f41c868","Type":"ContainerStarted","Data":"03250f73418279627e47b44e10efa916cef386404230bdddf1e22046163536e8"} May 20 21:51:20.120506 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:20.120468 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:20.121895 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:20.121879 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wrb8d" event={"ID":"d92c9a24-562d-4c33-bf6d-20a6a30063cc","Type":"ContainerStarted","Data":"abf7b70f8416c91d3e3fc383f3a65631a508d9f269bfd265cf2373b48ea8a42e"} May 20 21:51:20.121959 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:20.121900 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wrb8d" event={"ID":"d92c9a24-562d-4c33-bf6d-20a6a30063cc","Type":"ContainerStarted","Data":"b8370e3b62eaf3e7e2c247fcfc497a9ab1c69f64b8b360f911572f2ab1ff685e"} May 20 21:51:20.121959 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:20.121909 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wrb8d" event={"ID":"d92c9a24-562d-4c33-bf6d-20a6a30063cc","Type":"ContainerStarted","Data":"96eab2f0076b3e91ffac00c122ca8fb0bae2f1da0aaa8a0d9d656b96deec5cba"} May 20 21:51:20.140212 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:20.140174 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" podStartSLOduration=2.140164556 podStartE2EDuration="2.140164556s" podCreationTimestamp="2026-05-20 21:51:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:51:20.139541777 +0000 UTC m=+191.069358520" watchObservedRunningTime="2026-05-20 21:51:20.140164556 +0000 UTC m=+191.069981299" May 20 21:51:22.132447 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:22.132410 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wrb8d" event={"ID":"d92c9a24-562d-4c33-bf6d-20a6a30063cc","Type":"ContainerStarted","Data":"c2ac02a0024f0a27641caa4780a8f455774365c328ec25a29f848fb65e327bfe"} May 20 21:51:22.151319 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:22.151272 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wrb8d" podStartSLOduration=1.986591695 podStartE2EDuration="4.151260002s" podCreationTimestamp="2026-05-20 21:51:18 +0000 UTC" firstStartedPulling="2026-05-20 21:51:19.271400597 +0000 UTC m=+190.201217318" lastFinishedPulling="2026-05-20 21:51:21.436068901 +0000 UTC m=+192.365885625" observedRunningTime="2026-05-20 21:51:22.149126681 +0000 UTC m=+193.078943437" watchObservedRunningTime="2026-05-20 21:51:22.151260002 +0000 UTC m=+193.081076744" May 20 21:51:23.347600 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:23.347551 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" May 20 21:51:23.347600 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:23.347601 2571 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" May 20 21:51:23.348029 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:23.347923 2571 scope.go:117] "RemoveContainer" containerID="432bdb35f513ce22cf87e49cbb3cde0fafff24a68cb79212d05be19d028b3ad4" May 20 21:51:23.348098 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:51:23.348079 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-5k5cf_openshift-console-operator(19896b49-a875-4842-82b1-58df8c94a12f)\"" pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" podUID="19896b49-a875-4842-82b1-58df8c94a12f" May 20 21:51:24.869912 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:24.869878 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-k6p4v\" (UID: \"68adcd35-40d1-4ced-95ff-bb6dd6ded88d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-k6p4v" May 20 21:51:24.872184 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:24.872162 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/68adcd35-40d1-4ced-95ff-bb6dd6ded88d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-k6p4v\" (UID: \"68adcd35-40d1-4ced-95ff-bb6dd6ded88d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-k6p4v" May 20 21:51:25.162965 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:25.162893 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-46499\"" May 20 21:51:25.170477 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:25.170459 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-k6p4v" May 20 21:51:25.285253 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:25.285176 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-k6p4v"] May 20 21:51:25.287687 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:51:25.287656 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68adcd35_40d1_4ced_95ff_bb6dd6ded88d.slice/crio-397b7010a17e3d5906e942e08e7df1bd47d0a57df074959cec07ee31150162d2 WatchSource:0}: Error finding container 397b7010a17e3d5906e942e08e7df1bd47d0a57df074959cec07ee31150162d2: Status 404 returned error can't find the container with id 397b7010a17e3d5906e942e08e7df1bd47d0a57df074959cec07ee31150162d2 May 20 21:51:26.143654 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:26.143591 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-k6p4v" event={"ID":"68adcd35-40d1-4ced-95ff-bb6dd6ded88d","Type":"ContainerStarted","Data":"397b7010a17e3d5906e942e08e7df1bd47d0a57df074959cec07ee31150162d2"} May 20 21:51:27.147169 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:27.147135 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-k6p4v" event={"ID":"68adcd35-40d1-4ced-95ff-bb6dd6ded88d","Type":"ContainerStarted","Data":"bb26066a30cf52cba1740f9cb91374bc68f67797d08cac8b1bf85ac456e480f3"} May 20 21:51:27.164603 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:27.164558 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-k6p4v" podStartSLOduration=32.738548092 podStartE2EDuration="34.164545573s" podCreationTimestamp="2026-05-20 21:50:53 +0000 UTC" firstStartedPulling="2026-05-20 21:51:25.289517488 +0000 UTC m=+196.219334209" lastFinishedPulling="2026-05-20 21:51:26.71551497 +0000 UTC m=+197.645331690" observedRunningTime="2026-05-20 21:51:27.164114108 +0000 UTC m=+198.093930852" watchObservedRunningTime="2026-05-20 21:51:27.164545573 +0000 UTC m=+198.094362313" May 20 21:51:34.605514 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.605481 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-wss9v"] May 20 21:51:34.608653 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.608621 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-wss9v" May 20 21:51:34.613075 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.613049 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 20 21:51:34.613206 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.613096 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-cxlsz\"" May 20 21:51:34.613206 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.613108 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 20 21:51:34.613206 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.613166 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 20 21:51:34.622400 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.622373 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-wss9v"] May 20 21:51:34.643983 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.643959 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gx57\" (UniqueName: \"kubernetes.io/projected/dd691911-058c-4ebb-8eeb-c7bcb972f144-kube-api-access-6gx57\") pod \"openshift-state-metrics-9c959559f-wss9v\" (UID: \"dd691911-058c-4ebb-8eeb-c7bcb972f144\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wss9v" May 20 21:51:34.644123 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.644022 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd691911-058c-4ebb-8eeb-c7bcb972f144-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-wss9v\" (UID: \"dd691911-058c-4ebb-8eeb-c7bcb972f144\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wss9v" May 20 21:51:34.644123 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.644088 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd691911-058c-4ebb-8eeb-c7bcb972f144-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-wss9v\" (UID: \"dd691911-058c-4ebb-8eeb-c7bcb972f144\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wss9v" May 20 21:51:34.644221 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.644154 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd691911-058c-4ebb-8eeb-c7bcb972f144-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-wss9v\" (UID: \"dd691911-058c-4ebb-8eeb-c7bcb972f144\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wss9v" May 20 21:51:34.662078 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.662057 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t4tlq"] May 20 21:51:34.665048 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.665030 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.668485 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.668466 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 20 21:51:34.668661 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.668629 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 20 21:51:34.668735 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.668722 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tp2js\"" May 20 21:51:34.669251 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.669236 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 20 21:51:34.744455 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.744422 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd691911-058c-4ebb-8eeb-c7bcb972f144-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-wss9v\" (UID: \"dd691911-058c-4ebb-8eeb-c7bcb972f144\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wss9v" May 20 21:51:34.744585 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.744476 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dabab527-5248-49e1-862e-b9292ee3a982-node-exporter-wtmp\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.744585 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.744515 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd691911-058c-4ebb-8eeb-c7bcb972f144-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-wss9v\" (UID: \"dd691911-058c-4ebb-8eeb-c7bcb972f144\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wss9v" May 20 21:51:34.744585 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.744546 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dabab527-5248-49e1-862e-b9292ee3a982-metrics-client-ca\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.744585 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.744578 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dabab527-5248-49e1-862e-b9292ee3a982-node-exporter-textfile\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.744777 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.744631 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dabab527-5248-49e1-862e-b9292ee3a982-sys\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.744777 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:51:34.744684 2571 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 20 21:51:34.744777 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.744720 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd691911-058c-4ebb-8eeb-c7bcb972f144-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-wss9v\" (UID: \"dd691911-058c-4ebb-8eeb-c7bcb972f144\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wss9v" May 20 21:51:34.744777 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:51:34.744744 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd691911-058c-4ebb-8eeb-c7bcb972f144-openshift-state-metrics-tls podName:dd691911-058c-4ebb-8eeb-c7bcb972f144 nodeName:}" failed. No retries permitted until 2026-05-20 21:51:35.244723287 +0000 UTC m=+206.174540011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/dd691911-058c-4ebb-8eeb-c7bcb972f144-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-wss9v" (UID: "dd691911-058c-4ebb-8eeb-c7bcb972f144") : secret "openshift-state-metrics-tls" not found May 20 21:51:34.744977 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.744824 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dabab527-5248-49e1-862e-b9292ee3a982-node-exporter-tls\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.745101 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.745080 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6gx57\" (UniqueName: \"kubernetes.io/projected/dd691911-058c-4ebb-8eeb-c7bcb972f144-kube-api-access-6gx57\") pod \"openshift-state-metrics-9c959559f-wss9v\" (UID: \"dd691911-058c-4ebb-8eeb-c7bcb972f144\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wss9v" May 20 21:51:34.745180 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.745158 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xrp6\" (UniqueName: \"kubernetes.io/projected/dabab527-5248-49e1-862e-b9292ee3a982-kube-api-access-9xrp6\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.745231 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.745200 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dabab527-5248-49e1-862e-b9292ee3a982-root\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.745308 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.745286 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dabab527-5248-49e1-862e-b9292ee3a982-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.745379 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.745361 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dabab527-5248-49e1-862e-b9292ee3a982-node-exporter-accelerators-collector-config\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.745444 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.745382 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd691911-058c-4ebb-8eeb-c7bcb972f144-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-wss9v\" (UID: \"dd691911-058c-4ebb-8eeb-c7bcb972f144\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wss9v" May 20 21:51:34.747021 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.747000 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd691911-058c-4ebb-8eeb-c7bcb972f144-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-wss9v\" (UID: \"dd691911-058c-4ebb-8eeb-c7bcb972f144\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wss9v" May 20 21:51:34.757013 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.756988 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gx57\" (UniqueName: \"kubernetes.io/projected/dd691911-058c-4ebb-8eeb-c7bcb972f144-kube-api-access-6gx57\") pod \"openshift-state-metrics-9c959559f-wss9v\" (UID: \"dd691911-058c-4ebb-8eeb-c7bcb972f144\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wss9v" May 20 21:51:34.846524 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.846494 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dabab527-5248-49e1-862e-b9292ee3a982-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.846660 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.846530 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dabab527-5248-49e1-862e-b9292ee3a982-node-exporter-accelerators-collector-config\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.846731 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.846671 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dabab527-5248-49e1-862e-b9292ee3a982-node-exporter-wtmp\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.846782 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.846731 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dabab527-5248-49e1-862e-b9292ee3a982-metrics-client-ca\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.846782 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.846764 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dabab527-5248-49e1-862e-b9292ee3a982-node-exporter-textfile\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.846887 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.846791 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dabab527-5248-49e1-862e-b9292ee3a982-sys\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.846887 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.846822 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dabab527-5248-49e1-862e-b9292ee3a982-node-exporter-wtmp\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.846887 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.846864 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dabab527-5248-49e1-862e-b9292ee3a982-sys\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.847030 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.846902 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dabab527-5248-49e1-862e-b9292ee3a982-node-exporter-tls\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.847030 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.846994 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9xrp6\" (UniqueName: \"kubernetes.io/projected/dabab527-5248-49e1-862e-b9292ee3a982-kube-api-access-9xrp6\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.847030 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.847026 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dabab527-5248-49e1-862e-b9292ee3a982-root\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.847168 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:51:34.847043 2571 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 20 21:51:34.847168 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.847092 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dabab527-5248-49e1-862e-b9292ee3a982-node-exporter-textfile\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.847168 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.847106 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dabab527-5248-49e1-862e-b9292ee3a982-node-exporter-accelerators-collector-config\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.847168 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:51:34.847126 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dabab527-5248-49e1-862e-b9292ee3a982-node-exporter-tls podName:dabab527-5248-49e1-862e-b9292ee3a982 nodeName:}" failed. No retries permitted until 2026-05-20 21:51:35.347102584 +0000 UTC m=+206.276919320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/dabab527-5248-49e1-862e-b9292ee3a982-node-exporter-tls") pod "node-exporter-t4tlq" (UID: "dabab527-5248-49e1-862e-b9292ee3a982") : secret "node-exporter-tls" not found May 20 21:51:34.847337 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.847184 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dabab527-5248-49e1-862e-b9292ee3a982-root\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.847337 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.847257 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dabab527-5248-49e1-862e-b9292ee3a982-metrics-client-ca\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.848755 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.848728 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dabab527-5248-49e1-862e-b9292ee3a982-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:34.859565 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:34.859512 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xrp6\" (UniqueName: \"kubernetes.io/projected/dabab527-5248-49e1-862e-b9292ee3a982-kube-api-access-9xrp6\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:35.250287 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.250201 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd691911-058c-4ebb-8eeb-c7bcb972f144-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-wss9v\" (UID: \"dd691911-058c-4ebb-8eeb-c7bcb972f144\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wss9v" May 20 21:51:35.252531 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.252513 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd691911-058c-4ebb-8eeb-c7bcb972f144-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-wss9v\" (UID: \"dd691911-058c-4ebb-8eeb-c7bcb972f144\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wss9v" May 20 21:51:35.350761 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.350736 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dabab527-5248-49e1-862e-b9292ee3a982-node-exporter-tls\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:35.352960 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.352943 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dabab527-5248-49e1-862e-b9292ee3a982-node-exporter-tls\") pod \"node-exporter-t4tlq\" (UID: \"dabab527-5248-49e1-862e-b9292ee3a982\") " pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:35.521408 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.521336 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-wss9v" May 20 21:51:35.573374 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.573346 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t4tlq" May 20 21:51:35.583955 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:51:35.583916 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddabab527_5248_49e1_862e_b9292ee3a982.slice/crio-3970535e54530ff17cee592691769b9ebbde90fe51e5c2db79d2c29b36b66f0c WatchSource:0}: Error finding container 3970535e54530ff17cee592691769b9ebbde90fe51e5c2db79d2c29b36b66f0c: Status 404 returned error can't find the container with id 3970535e54530ff17cee592691769b9ebbde90fe51e5c2db79d2c29b36b66f0c May 20 21:51:35.629569 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.628942 2571 scope.go:117] "RemoveContainer" containerID="432bdb35f513ce22cf87e49cbb3cde0fafff24a68cb79212d05be19d028b3ad4" May 20 21:51:35.629569 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:51:35.629157 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-5k5cf_openshift-console-operator(19896b49-a875-4842-82b1-58df8c94a12f)\"" pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" podUID="19896b49-a875-4842-82b1-58df8c94a12f" May 20 21:51:35.665755 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.665730 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-wss9v"] May 20 21:51:35.668117 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:51:35.668086 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd691911_058c_4ebb_8eeb_c7bcb972f144.slice/crio-498e7ab03321306c64b04d04a6c5d96aaab8904a91d725be080bbd3ea031ba1f WatchSource:0}: Error finding container 498e7ab03321306c64b04d04a6c5d96aaab8904a91d725be080bbd3ea031ba1f: Status 404 returned error can't find the container with id 498e7ab03321306c64b04d04a6c5d96aaab8904a91d725be080bbd3ea031ba1f May 20 21:51:35.751170 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.751143 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 21:51:35.755050 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.754978 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.757568 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.757517 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 20 21:51:35.757703 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.757603 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 20 21:51:35.757703 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.757681 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 20 21:51:35.757810 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.757605 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mkvt6\"" May 20 21:51:35.758026 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.757999 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 20 21:51:35.758111 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.758005 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 20 21:51:35.758111 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.758005 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 20 21:51:35.758217 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.758009 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 20 21:51:35.758217 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.758009 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 20 21:51:35.763190 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.763166 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 20 21:51:35.770015 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.769994 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 21:51:35.855688 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.855651 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-config-volume\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.855827 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.855701 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7393362-2329-4e6a-b697-0ca4c0108e7a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.855827 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.855735 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7393362-2329-4e6a-b697-0ca4c0108e7a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.855827 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.855768 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.855827 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.855798 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7393362-2329-4e6a-b697-0ca4c0108e7a-config-out\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.856021 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.855845 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.856021 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.855900 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e7393362-2329-4e6a-b697-0ca4c0108e7a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.856021 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.855972 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-web-config\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.856021 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.856010 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7393362-2329-4e6a-b697-0ca4c0108e7a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.856252 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.856039 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.856252 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.856076 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bht59\" (UniqueName: \"kubernetes.io/projected/e7393362-2329-4e6a-b697-0ca4c0108e7a-kube-api-access-bht59\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.856252 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.856116 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.856252 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.856144 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.957418 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.957384 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-config-volume\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.957418 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.957417 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7393362-2329-4e6a-b697-0ca4c0108e7a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.957683 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.957445 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7393362-2329-4e6a-b697-0ca4c0108e7a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.957683 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.957556 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.958517 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.957688 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7393362-2329-4e6a-b697-0ca4c0108e7a-config-out\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.958517 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.957748 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.958517 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.957878 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e7393362-2329-4e6a-b697-0ca4c0108e7a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.958517 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.957956 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-web-config\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.958517 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.958007 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7393362-2329-4e6a-b697-0ca4c0108e7a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.958517 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.958039 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.958517 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.958079 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bht59\" (UniqueName: \"kubernetes.io/projected/e7393362-2329-4e6a-b697-0ca4c0108e7a-kube-api-access-bht59\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.958517 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.958111 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.958517 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.958142 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.958517 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.958251 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7393362-2329-4e6a-b697-0ca4c0108e7a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.958517 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.958305 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e7393362-2329-4e6a-b697-0ca4c0108e7a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.959366 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.959338 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7393362-2329-4e6a-b697-0ca4c0108e7a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.960869 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.960824 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.961085 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.961059 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-web-config\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.961715 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.961595 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7393362-2329-4e6a-b697-0ca4c0108e7a-config-out\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.961715 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.961669 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7393362-2329-4e6a-b697-0ca4c0108e7a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.961878 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.961774 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.961878 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.961800 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.962177 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.962158 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-config-volume\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.962244 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.962228 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.963274 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.963252 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:35.965592 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:35.965572 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bht59\" (UniqueName: \"kubernetes.io/projected/e7393362-2329-4e6a-b697-0ca4c0108e7a-kube-api-access-bht59\") pod \"alertmanager-main-0\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:36.082330 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.082296 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 20 21:51:36.173103 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.173069 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t4tlq" event={"ID":"dabab527-5248-49e1-862e-b9292ee3a982","Type":"ContainerStarted","Data":"3970535e54530ff17cee592691769b9ebbde90fe51e5c2db79d2c29b36b66f0c"} May 20 21:51:36.175332 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.175269 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-wss9v" event={"ID":"dd691911-058c-4ebb-8eeb-c7bcb972f144","Type":"ContainerStarted","Data":"806d284b67fe4ad6e3df1912cfcbb3b01be1159f8778a325c8718094aae3aaa4"} May 20 21:51:36.175332 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.175302 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-wss9v" event={"ID":"dd691911-058c-4ebb-8eeb-c7bcb972f144","Type":"ContainerStarted","Data":"0e04cd2c0d86ccc23110ffea2eef175085482e816c091fb4b278fef617bd89db"} May 20 21:51:36.175332 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.175316 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-wss9v" event={"ID":"dd691911-058c-4ebb-8eeb-c7bcb972f144","Type":"ContainerStarted","Data":"498e7ab03321306c64b04d04a6c5d96aaab8904a91d725be080bbd3ea031ba1f"} May 20 21:51:36.237098 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.231914 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 21:51:36.646064 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.646036 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5485f79869-fsfcl"] May 20 21:51:36.649508 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.649489 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.652413 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.652375 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 20 21:51:36.652413 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.652389 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 20 21:51:36.652597 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.652434 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 20 21:51:36.652597 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.652477 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9svvt8nf03gb8\"" May 20 21:51:36.652917 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.652896 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 20 21:51:36.653004 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.652953 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 20 21:51:36.653004 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.652956 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-kzj5h\"" May 20 21:51:36.659378 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.659359 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5485f79869-fsfcl"] May 20 21:51:36.766897 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.766867 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f56ad553-52af-4cc6-8843-12b4991f98f0-secret-thanos-querier-tls\") pod \"thanos-querier-5485f79869-fsfcl\" (UID: \"f56ad553-52af-4cc6-8843-12b4991f98f0\") " pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.767029 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.766917 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f56ad553-52af-4cc6-8843-12b4991f98f0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5485f79869-fsfcl\" (UID: \"f56ad553-52af-4cc6-8843-12b4991f98f0\") " pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.767029 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.766992 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f56ad553-52af-4cc6-8843-12b4991f98f0-metrics-client-ca\") pod \"thanos-querier-5485f79869-fsfcl\" (UID: \"f56ad553-52af-4cc6-8843-12b4991f98f0\") " pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.767029 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.767021 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f56ad553-52af-4cc6-8843-12b4991f98f0-secret-grpc-tls\") pod \"thanos-querier-5485f79869-fsfcl\" (UID: \"f56ad553-52af-4cc6-8843-12b4991f98f0\") " pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.767168 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.767090 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9fdx\" (UniqueName: \"kubernetes.io/projected/f56ad553-52af-4cc6-8843-12b4991f98f0-kube-api-access-x9fdx\") pod \"thanos-querier-5485f79869-fsfcl\" (UID: \"f56ad553-52af-4cc6-8843-12b4991f98f0\") " pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.767168 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.767156 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f56ad553-52af-4cc6-8843-12b4991f98f0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5485f79869-fsfcl\" (UID: \"f56ad553-52af-4cc6-8843-12b4991f98f0\") " pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.767258 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.767201 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f56ad553-52af-4cc6-8843-12b4991f98f0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5485f79869-fsfcl\" (UID: \"f56ad553-52af-4cc6-8843-12b4991f98f0\") " pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.767258 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.767230 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f56ad553-52af-4cc6-8843-12b4991f98f0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5485f79869-fsfcl\" (UID: \"f56ad553-52af-4cc6-8843-12b4991f98f0\") " pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.868145 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.868114 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x9fdx\" (UniqueName: \"kubernetes.io/projected/f56ad553-52af-4cc6-8843-12b4991f98f0-kube-api-access-x9fdx\") pod \"thanos-querier-5485f79869-fsfcl\" (UID: \"f56ad553-52af-4cc6-8843-12b4991f98f0\") " pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.868304 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.868192 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f56ad553-52af-4cc6-8843-12b4991f98f0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5485f79869-fsfcl\" (UID: \"f56ad553-52af-4cc6-8843-12b4991f98f0\") " pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.868304 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.868234 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f56ad553-52af-4cc6-8843-12b4991f98f0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5485f79869-fsfcl\" (UID: \"f56ad553-52af-4cc6-8843-12b4991f98f0\") " pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.868304 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.868264 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f56ad553-52af-4cc6-8843-12b4991f98f0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5485f79869-fsfcl\" (UID: \"f56ad553-52af-4cc6-8843-12b4991f98f0\") " pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.868465 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.868303 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f56ad553-52af-4cc6-8843-12b4991f98f0-secret-thanos-querier-tls\") pod \"thanos-querier-5485f79869-fsfcl\" (UID: \"f56ad553-52af-4cc6-8843-12b4991f98f0\") " pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.868465 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.868342 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f56ad553-52af-4cc6-8843-12b4991f98f0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5485f79869-fsfcl\" (UID: \"f56ad553-52af-4cc6-8843-12b4991f98f0\") " pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.868465 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.868378 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f56ad553-52af-4cc6-8843-12b4991f98f0-metrics-client-ca\") pod \"thanos-querier-5485f79869-fsfcl\" (UID: \"f56ad553-52af-4cc6-8843-12b4991f98f0\") " pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.868880 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.868856 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f56ad553-52af-4cc6-8843-12b4991f98f0-secret-grpc-tls\") pod \"thanos-querier-5485f79869-fsfcl\" (UID: \"f56ad553-52af-4cc6-8843-12b4991f98f0\") " pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.870173 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.870110 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f56ad553-52af-4cc6-8843-12b4991f98f0-metrics-client-ca\") pod \"thanos-querier-5485f79869-fsfcl\" (UID: \"f56ad553-52af-4cc6-8843-12b4991f98f0\") " pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.871584 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.871534 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f56ad553-52af-4cc6-8843-12b4991f98f0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5485f79869-fsfcl\" (UID: \"f56ad553-52af-4cc6-8843-12b4991f98f0\") " pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.871705 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.871597 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f56ad553-52af-4cc6-8843-12b4991f98f0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5485f79869-fsfcl\" (UID: \"f56ad553-52af-4cc6-8843-12b4991f98f0\") " pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.872105 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.872077 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f56ad553-52af-4cc6-8843-12b4991f98f0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5485f79869-fsfcl\" (UID: \"f56ad553-52af-4cc6-8843-12b4991f98f0\") " pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.872306 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.872280 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f56ad553-52af-4cc6-8843-12b4991f98f0-secret-grpc-tls\") pod \"thanos-querier-5485f79869-fsfcl\" (UID: \"f56ad553-52af-4cc6-8843-12b4991f98f0\") " pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.875207 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.875183 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f56ad553-52af-4cc6-8843-12b4991f98f0-secret-thanos-querier-tls\") pod \"thanos-querier-5485f79869-fsfcl\" (UID: \"f56ad553-52af-4cc6-8843-12b4991f98f0\") " pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.875301 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.875247 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f56ad553-52af-4cc6-8843-12b4991f98f0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5485f79869-fsfcl\" (UID: \"f56ad553-52af-4cc6-8843-12b4991f98f0\") " pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.877226 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.877204 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9fdx\" (UniqueName: \"kubernetes.io/projected/f56ad553-52af-4cc6-8843-12b4991f98f0-kube-api-access-x9fdx\") pod \"thanos-querier-5485f79869-fsfcl\" (UID: \"f56ad553-52af-4cc6-8843-12b4991f98f0\") " pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:36.960133 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:36.959689 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:37.179305 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:37.179236 2571 generic.go:358] "Generic (PLEG): container finished" podID="dabab527-5248-49e1-862e-b9292ee3a982" containerID="d72e56d7013f25bb0c7bde02d5d319b1b8978781b663d320c7f6780a60990f18" exitCode=0 May 20 21:51:37.179456 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:37.179326 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t4tlq" event={"ID":"dabab527-5248-49e1-862e-b9292ee3a982","Type":"ContainerDied","Data":"d72e56d7013f25bb0c7bde02d5d319b1b8978781b663d320c7f6780a60990f18"} May 20 21:51:37.180541 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:37.180519 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7393362-2329-4e6a-b697-0ca4c0108e7a","Type":"ContainerStarted","Data":"982fa5bf1cd310e4527e932c20792b4687c232e5d58e886b1652a71aeb859b10"} May 20 21:51:37.549808 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:37.549619 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5485f79869-fsfcl"] May 20 21:51:37.575007 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:51:37.574979 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf56ad553_52af_4cc6_8843_12b4991f98f0.slice/crio-9a785f090b9188974cd0bf39ef363107b363bd32c776c584b0a8c418a95d3226 WatchSource:0}: Error finding container 9a785f090b9188974cd0bf39ef363107b363bd32c776c584b0a8c418a95d3226: Status 404 returned error can't find the container with id 9a785f090b9188974cd0bf39ef363107b363bd32c776c584b0a8c418a95d3226 May 20 21:51:38.184268 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:38.184232 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" event={"ID":"f56ad553-52af-4cc6-8843-12b4991f98f0","Type":"ContainerStarted","Data":"9a785f090b9188974cd0bf39ef363107b363bd32c776c584b0a8c418a95d3226"} May 20 21:51:38.186307 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:38.186278 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t4tlq" event={"ID":"dabab527-5248-49e1-862e-b9292ee3a982","Type":"ContainerStarted","Data":"9158499ba5967f5b5bdd0fb51331e15db6fb49fda998ad208382ab805348234f"} May 20 21:51:38.186438 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:38.186314 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t4tlq" event={"ID":"dabab527-5248-49e1-862e-b9292ee3a982","Type":"ContainerStarted","Data":"b7211ceb59b8bbe9862340fc0433edb40dfe33ffa843fc608c2b5764d84de922"} May 20 21:51:38.188248 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:38.188221 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-wss9v" event={"ID":"dd691911-058c-4ebb-8eeb-c7bcb972f144","Type":"ContainerStarted","Data":"e228b1d0d1522ebd22e4c40d6ae7c68db1f97777d0b10c85c720e8c7a910cd44"} May 20 21:51:38.189724 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:38.189698 2571 generic.go:358] "Generic (PLEG): container finished" podID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerID="d4b29c43d35d8aed7385a2987d12df7674dc6a6678f30fb5e5e52317b613d8b7" exitCode=0 May 20 21:51:38.189811 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:38.189776 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7393362-2329-4e6a-b697-0ca4c0108e7a","Type":"ContainerDied","Data":"d4b29c43d35d8aed7385a2987d12df7674dc6a6678f30fb5e5e52317b613d8b7"} May 20 21:51:38.206828 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:38.206768 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t4tlq" podStartSLOduration=3.24836911 podStartE2EDuration="4.206751554s" podCreationTimestamp="2026-05-20 21:51:34 +0000 UTC" firstStartedPulling="2026-05-20 21:51:35.585538067 +0000 UTC m=+206.515354791" lastFinishedPulling="2026-05-20 21:51:36.543920505 +0000 UTC m=+207.473737235" observedRunningTime="2026-05-20 21:51:38.205101373 +0000 UTC m=+209.134918118" watchObservedRunningTime="2026-05-20 21:51:38.206751554 +0000 UTC m=+209.136568292" May 20 21:51:38.245302 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:38.245253 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-wss9v" podStartSLOduration=2.640322435 podStartE2EDuration="4.245238673s" podCreationTimestamp="2026-05-20 21:51:34 +0000 UTC" firstStartedPulling="2026-05-20 21:51:35.80079427 +0000 UTC m=+206.730610998" lastFinishedPulling="2026-05-20 21:51:37.4057105 +0000 UTC m=+208.335527236" observedRunningTime="2026-05-20 21:51:38.244081594 +0000 UTC m=+209.173898360" watchObservedRunningTime="2026-05-20 21:51:38.245238673 +0000 UTC m=+209.175055416" May 20 21:51:39.093502 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.093462 2571 patch_prober.go:28] interesting pod/image-registry-f4bddfcf6-8tts7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 20 21:51:39.093702 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.093534 2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" podUID="f076b995-22bf-420a-aa9b-a1d15f41c868" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 20 21:51:39.399296 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.399218 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-pz686"] May 20 21:51:39.402873 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.402849 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-pz686" May 20 21:51:39.405290 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.405265 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 20 21:51:39.405396 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.405309 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-gs26w\"" May 20 21:51:39.410049 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.410027 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-pz686"] May 20 21:51:39.493562 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.493523 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8404b49b-0a27-4041-8187-fa4fe70abe6c-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-pz686\" (UID: \"8404b49b-0a27-4041-8187-fa4fe70abe6c\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-pz686" May 20 21:51:39.594292 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.594255 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8404b49b-0a27-4041-8187-fa4fe70abe6c-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-pz686\" (UID: \"8404b49b-0a27-4041-8187-fa4fe70abe6c\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-pz686" May 20 21:51:39.596917 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.596869 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8404b49b-0a27-4041-8187-fa4fe70abe6c-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-pz686\" (UID: \"8404b49b-0a27-4041-8187-fa4fe70abe6c\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-pz686" May 20 21:51:39.713806 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.713721 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-pz686" May 20 21:51:39.885816 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.885782 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-c54d897ff-nx9kr"] May 20 21:51:39.888888 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.888872 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:39.891511 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.891490 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 20 21:51:39.891511 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.891498 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 20 21:51:39.891713 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.891561 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 20 21:51:39.891713 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.891559 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 20 21:51:39.891837 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.891818 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 20 21:51:39.891909 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.891888 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-g452x\"" May 20 21:51:39.897169 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.897150 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 20 21:51:39.900429 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.900400 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-c54d897ff-nx9kr"] May 20 21:51:40.007877 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.999151 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzr2l\" (UniqueName: \"kubernetes.io/projected/64a698a8-9681-45dd-889f-fb503d49ef30-kube-api-access-nzr2l\") pod \"telemeter-client-c54d897ff-nx9kr\" (UID: \"64a698a8-9681-45dd-889f-fb503d49ef30\") " pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.007877 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.999242 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64a698a8-9681-45dd-889f-fb503d49ef30-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c54d897ff-nx9kr\" (UID: \"64a698a8-9681-45dd-889f-fb503d49ef30\") " pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.007877 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.999346 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/64a698a8-9681-45dd-889f-fb503d49ef30-telemeter-client-tls\") pod \"telemeter-client-c54d897ff-nx9kr\" (UID: \"64a698a8-9681-45dd-889f-fb503d49ef30\") " pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.007877 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.999380 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64a698a8-9681-45dd-889f-fb503d49ef30-serving-certs-ca-bundle\") pod \"telemeter-client-c54d897ff-nx9kr\" (UID: \"64a698a8-9681-45dd-889f-fb503d49ef30\") " pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.007877 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.999411 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/64a698a8-9681-45dd-889f-fb503d49ef30-secret-telemeter-client\") pod \"telemeter-client-c54d897ff-nx9kr\" (UID: \"64a698a8-9681-45dd-889f-fb503d49ef30\") " pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.007877 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.999510 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64a698a8-9681-45dd-889f-fb503d49ef30-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c54d897ff-nx9kr\" (UID: \"64a698a8-9681-45dd-889f-fb503d49ef30\") " pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.007877 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.999561 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/64a698a8-9681-45dd-889f-fb503d49ef30-federate-client-tls\") pod \"telemeter-client-c54d897ff-nx9kr\" (UID: \"64a698a8-9681-45dd-889f-fb503d49ef30\") " pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.007877 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:39.999594 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64a698a8-9681-45dd-889f-fb503d49ef30-metrics-client-ca\") pod \"telemeter-client-c54d897ff-nx9kr\" (UID: \"64a698a8-9681-45dd-889f-fb503d49ef30\") " pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.049163 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.049130 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-pz686"] May 20 21:51:40.050519 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:51:40.050494 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8404b49b_0a27_4041_8187_fa4fe70abe6c.slice/crio-04093be289a4d326e9c7ce0f3b25f61b448318cad5a36dd7e1a4253d4a4aa110 WatchSource:0}: Error finding container 04093be289a4d326e9c7ce0f3b25f61b448318cad5a36dd7e1a4253d4a4aa110: Status 404 returned error can't find the container with id 04093be289a4d326e9c7ce0f3b25f61b448318cad5a36dd7e1a4253d4a4aa110 May 20 21:51:40.100368 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.100344 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/64a698a8-9681-45dd-889f-fb503d49ef30-telemeter-client-tls\") pod \"telemeter-client-c54d897ff-nx9kr\" (UID: \"64a698a8-9681-45dd-889f-fb503d49ef30\") " pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.100508 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.100494 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64a698a8-9681-45dd-889f-fb503d49ef30-serving-certs-ca-bundle\") pod \"telemeter-client-c54d897ff-nx9kr\" (UID: \"64a698a8-9681-45dd-889f-fb503d49ef30\") " pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.100577 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.100567 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/64a698a8-9681-45dd-889f-fb503d49ef30-secret-telemeter-client\") pod \"telemeter-client-c54d897ff-nx9kr\" (UID: \"64a698a8-9681-45dd-889f-fb503d49ef30\") " pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.100666 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.100653 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64a698a8-9681-45dd-889f-fb503d49ef30-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c54d897ff-nx9kr\" (UID: \"64a698a8-9681-45dd-889f-fb503d49ef30\") " pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.100767 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.100758 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/64a698a8-9681-45dd-889f-fb503d49ef30-federate-client-tls\") pod \"telemeter-client-c54d897ff-nx9kr\" (UID: \"64a698a8-9681-45dd-889f-fb503d49ef30\") " pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.100833 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.100823 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64a698a8-9681-45dd-889f-fb503d49ef30-metrics-client-ca\") pod \"telemeter-client-c54d897ff-nx9kr\" (UID: \"64a698a8-9681-45dd-889f-fb503d49ef30\") " pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.101725 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.100902 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nzr2l\" (UniqueName: \"kubernetes.io/projected/64a698a8-9681-45dd-889f-fb503d49ef30-kube-api-access-nzr2l\") pod \"telemeter-client-c54d897ff-nx9kr\" (UID: \"64a698a8-9681-45dd-889f-fb503d49ef30\") " pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.101725 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.100965 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64a698a8-9681-45dd-889f-fb503d49ef30-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c54d897ff-nx9kr\" (UID: \"64a698a8-9681-45dd-889f-fb503d49ef30\") " pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.101725 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.101248 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64a698a8-9681-45dd-889f-fb503d49ef30-serving-certs-ca-bundle\") pod \"telemeter-client-c54d897ff-nx9kr\" (UID: \"64a698a8-9681-45dd-889f-fb503d49ef30\") " pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.101916 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.101735 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64a698a8-9681-45dd-889f-fb503d49ef30-metrics-client-ca\") pod \"telemeter-client-c54d897ff-nx9kr\" (UID: \"64a698a8-9681-45dd-889f-fb503d49ef30\") " pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.101916 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.101778 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64a698a8-9681-45dd-889f-fb503d49ef30-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c54d897ff-nx9kr\" (UID: \"64a698a8-9681-45dd-889f-fb503d49ef30\") " pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.103519 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.103499 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/64a698a8-9681-45dd-889f-fb503d49ef30-secret-telemeter-client\") pod \"telemeter-client-c54d897ff-nx9kr\" (UID: \"64a698a8-9681-45dd-889f-fb503d49ef30\") " pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.103680 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.103632 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64a698a8-9681-45dd-889f-fb503d49ef30-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c54d897ff-nx9kr\" (UID: \"64a698a8-9681-45dd-889f-fb503d49ef30\") " pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.104077 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.104059 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/64a698a8-9681-45dd-889f-fb503d49ef30-telemeter-client-tls\") pod \"telemeter-client-c54d897ff-nx9kr\" (UID: \"64a698a8-9681-45dd-889f-fb503d49ef30\") " pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.105372 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.105330 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/64a698a8-9681-45dd-889f-fb503d49ef30-federate-client-tls\") pod \"telemeter-client-c54d897ff-nx9kr\" (UID: \"64a698a8-9681-45dd-889f-fb503d49ef30\") " pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.109699 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.109681 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzr2l\" (UniqueName: \"kubernetes.io/projected/64a698a8-9681-45dd-889f-fb503d49ef30-kube-api-access-nzr2l\") pod \"telemeter-client-c54d897ff-nx9kr\" (UID: \"64a698a8-9681-45dd-889f-fb503d49ef30\") " pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.197702 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.197675 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7393362-2329-4e6a-b697-0ca4c0108e7a","Type":"ContainerStarted","Data":"f0b6a014d35ac53327f8f0ae263031855004e49fefe057f4fc1bb69b3ec821da"} May 20 21:51:40.197799 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.197778 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7393362-2329-4e6a-b697-0ca4c0108e7a","Type":"ContainerStarted","Data":"c37bee8420363cadc6a3c9b6d391fa8124f329bbd9e8ebee696f018113b6862b"} May 20 21:51:40.197799 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.197793 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7393362-2329-4e6a-b697-0ca4c0108e7a","Type":"ContainerStarted","Data":"6dea6b9c416c0420a7caa0ef786d0ce8f2134305912c6d65a5d8fde2474d9a32"} May 20 21:51:40.197874 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.197801 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7393362-2329-4e6a-b697-0ca4c0108e7a","Type":"ContainerStarted","Data":"d0b932175d03b641ff6ab71677fced4cca5e6376002d3eb67080b80fa555e330"} May 20 21:51:40.198326 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.198305 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" May 20 21:51:40.199960 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.199928 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" event={"ID":"f56ad553-52af-4cc6-8843-12b4991f98f0","Type":"ContainerStarted","Data":"4d13fb0c450f74ab1fe2dc6eb40f54204ddd917bd7e6f7691c64c3b1f0d89603"} May 20 21:51:40.200022 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.199963 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" event={"ID":"f56ad553-52af-4cc6-8843-12b4991f98f0","Type":"ContainerStarted","Data":"2d1e09b9dfa4bce1efdf5a6e1e35230801b58db13bfed4754319e19c202c4e5d"} May 20 21:51:40.200022 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.199977 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" event={"ID":"f56ad553-52af-4cc6-8843-12b4991f98f0","Type":"ContainerStarted","Data":"3120cc57ef997bce60b6d5e15e9cc408c6329fd7b9b065e483c5822d3e3ae9a3"} May 20 21:51:40.200853 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.200831 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-pz686" event={"ID":"8404b49b-0a27-4041-8187-fa4fe70abe6c","Type":"ContainerStarted","Data":"04093be289a4d326e9c7ce0f3b25f61b448318cad5a36dd7e1a4253d4a4aa110"} May 20 21:51:40.329951 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:40.329914 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-c54d897ff-nx9kr"] May 20 21:51:40.332585 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:51:40.332562 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a698a8_9681_45dd_889f_fb503d49ef30.slice/crio-598dc5baf91b6502d51a939ab6faf3c8a213bf8d4323fc3b5edaea7b9b609269 WatchSource:0}: Error finding container 598dc5baf91b6502d51a939ab6faf3c8a213bf8d4323fc3b5edaea7b9b609269: Status 404 returned error can't find the container with id 598dc5baf91b6502d51a939ab6faf3c8a213bf8d4323fc3b5edaea7b9b609269 May 20 21:51:41.129492 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:41.129453 2571 patch_prober.go:28] interesting pod/image-registry-f4bddfcf6-8tts7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 20 21:51:41.129982 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:41.129513 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" podUID="f076b995-22bf-420a-aa9b-a1d15f41c868" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 20 21:51:41.208276 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:41.208240 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7393362-2329-4e6a-b697-0ca4c0108e7a","Type":"ContainerStarted","Data":"fc6c70e4b55f151c09d1c5c5c15227aaadc73fc8eab4de62a786e7d7588ee4ea"} May 20 21:51:41.209566 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:41.209528 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" event={"ID":"64a698a8-9681-45dd-889f-fb503d49ef30","Type":"ContainerStarted","Data":"598dc5baf91b6502d51a939ab6faf3c8a213bf8d4323fc3b5edaea7b9b609269"} May 20 21:51:42.215842 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:42.215757 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7393362-2329-4e6a-b697-0ca4c0108e7a","Type":"ContainerStarted","Data":"44c2a44fb00908b5ba76b3759e6e1d4d61f53d321e077841c446192ffaf3461f"} May 20 21:51:42.217583 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:42.217550 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" event={"ID":"64a698a8-9681-45dd-889f-fb503d49ef30","Type":"ContainerStarted","Data":"0f2236be9179c1afedd8bc7b98239f781608811cbff90ee69df82b1fcd213f09"} May 20 21:51:42.217704 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:42.217589 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" event={"ID":"64a698a8-9681-45dd-889f-fb503d49ef30","Type":"ContainerStarted","Data":"fa86ce15b98ce2747a44f2fa5f2faaac1e35f46a750ca084c59f004dcc89ab9b"} May 20 21:51:42.217704 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:42.217601 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" event={"ID":"64a698a8-9681-45dd-889f-fb503d49ef30","Type":"ContainerStarted","Data":"81952fe22798c63dc4711863307739c5c4572f6467a983b47fc20dfc5e8eb695"} May 20 21:51:42.220039 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:42.220019 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" event={"ID":"f56ad553-52af-4cc6-8843-12b4991f98f0","Type":"ContainerStarted","Data":"e18aa2e622656eeb2a3239c9bff1e50fd93f7bc7cbc8c9ce3dd63e1da973100d"} May 20 21:51:42.220039 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:42.220042 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" event={"ID":"f56ad553-52af-4cc6-8843-12b4991f98f0","Type":"ContainerStarted","Data":"878d8a36c420487db2cd38a96ab14f6ff62a890abb7c2eab2371d33b65ea7146"} May 20 21:51:42.220230 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:42.220053 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" event={"ID":"f56ad553-52af-4cc6-8843-12b4991f98f0","Type":"ContainerStarted","Data":"07b5fd053992c1a371e7d6c641f0583492ea9b2d7971ac1fb6fc6a8c8ddb3963"} May 20 21:51:42.220230 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:42.220161 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:42.226804 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:42.226779 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-pz686" event={"ID":"8404b49b-0a27-4041-8187-fa4fe70abe6c","Type":"ContainerStarted","Data":"24f2eba8de72a6125a452043f84e22c7c0547f711cdbfb5576b105c7cdb6258b"} May 20 21:51:42.226997 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:42.226980 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-pz686" May 20 21:51:42.231976 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:42.231956 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-pz686" May 20 21:51:42.246845 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:42.246806 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.114209702 podStartE2EDuration="7.246794967s" podCreationTimestamp="2026-05-20 21:51:35 +0000 UTC" firstStartedPulling="2026-05-20 21:51:36.238621358 +0000 UTC m=+207.168438082" lastFinishedPulling="2026-05-20 21:51:41.371206619 +0000 UTC m=+212.301023347" observedRunningTime="2026-05-20 21:51:42.244851296 +0000 UTC m=+213.174668040" watchObservedRunningTime="2026-05-20 21:51:42.246794967 +0000 UTC m=+213.176611709" May 20 21:51:42.261178 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:42.261137 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-pz686" podStartSLOduration=1.898469519 podStartE2EDuration="3.261124458s" podCreationTimestamp="2026-05-20 21:51:39 +0000 UTC" firstStartedPulling="2026-05-20 21:51:40.052892145 +0000 UTC m=+210.982708867" lastFinishedPulling="2026-05-20 21:51:41.415547074 +0000 UTC m=+212.345363806" observedRunningTime="2026-05-20 21:51:42.260853378 +0000 UTC m=+213.190670121" watchObservedRunningTime="2026-05-20 21:51:42.261124458 +0000 UTC m=+213.190941201" May 20 21:51:42.284346 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:42.284309 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" podStartSLOduration=2.491448203 podStartE2EDuration="6.284298096s" podCreationTimestamp="2026-05-20 21:51:36 +0000 UTC" firstStartedPulling="2026-05-20 21:51:37.576918903 +0000 UTC m=+208.506735624" lastFinishedPulling="2026-05-20 21:51:41.369768789 +0000 UTC m=+212.299585517" observedRunningTime="2026-05-20 21:51:42.283427975 +0000 UTC m=+213.213244718" watchObservedRunningTime="2026-05-20 21:51:42.284298096 +0000 UTC m=+213.214114840" May 20 21:51:42.302595 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:42.302559 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-c54d897ff-nx9kr" podStartSLOduration=1.642650476 podStartE2EDuration="3.302547913s" podCreationTimestamp="2026-05-20 21:51:39 +0000 UTC" firstStartedPulling="2026-05-20 21:51:40.334591995 +0000 UTC m=+211.264408721" lastFinishedPulling="2026-05-20 21:51:41.994489426 +0000 UTC m=+212.924306158" observedRunningTime="2026-05-20 21:51:42.302156619 +0000 UTC m=+213.231973373" watchObservedRunningTime="2026-05-20 21:51:42.302547913 +0000 UTC m=+213.232364701" May 20 21:51:47.624304 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:47.624270 2571 scope.go:117] "RemoveContainer" containerID="432bdb35f513ce22cf87e49cbb3cde0fafff24a68cb79212d05be19d028b3ad4" May 20 21:51:48.236731 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:48.236702 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5485f79869-fsfcl" May 20 21:51:48.245512 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:48.245488 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/2.log" May 20 21:51:48.245664 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:48.245552 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" event={"ID":"19896b49-a875-4842-82b1-58df8c94a12f","Type":"ContainerStarted","Data":"21feb89a03d94ddc771565153eeebe38885234bfa4ea88cbc55a0ab2f0eb55c6"} May 20 21:51:48.245820 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:48.245801 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" May 20 21:51:48.278737 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:48.278621 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" podStartSLOduration=52.929905877 podStartE2EDuration="55.278604716s" podCreationTimestamp="2026-05-20 21:50:53 +0000 UTC" firstStartedPulling="2026-05-20 21:50:53.473909678 +0000 UTC m=+164.403726403" lastFinishedPulling="2026-05-20 21:50:55.822608505 +0000 UTC m=+166.752425242" observedRunningTime="2026-05-20 21:51:48.277963128 +0000 UTC m=+219.207779872" watchObservedRunningTime="2026-05-20 21:51:48.278604716 +0000 UTC m=+219.208421461" May 20 21:51:48.721940 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:48.721910 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-5k5cf" May 20 21:51:48.927787 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:48.927759 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-br4g4"] May 20 21:51:48.931091 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:48.931065 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-br4g4" May 20 21:51:48.933823 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:48.933795 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-gb92s\"" May 20 21:51:48.934070 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:48.934053 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 20 21:51:48.934150 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:48.934100 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 20 21:51:48.941009 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:48.940986 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-br4g4"] May 20 21:51:49.078757 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:49.078725 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpx56\" (UniqueName: \"kubernetes.io/projected/9024a82d-d325-4287-abdd-00322b2dd160-kube-api-access-mpx56\") pod \"downloads-57bd96b888-br4g4\" (UID: \"9024a82d-d325-4287-abdd-00322b2dd160\") " pod="openshift-console/downloads-57bd96b888-br4g4" May 20 21:51:49.091915 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:49.091878 2571 patch_prober.go:28] interesting pod/image-registry-f4bddfcf6-8tts7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 20 21:51:49.092063 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:49.091935 2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" podUID="f076b995-22bf-420a-aa9b-a1d15f41c868" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 20 21:51:49.179604 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:49.179529 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mpx56\" (UniqueName: \"kubernetes.io/projected/9024a82d-d325-4287-abdd-00322b2dd160-kube-api-access-mpx56\") pod \"downloads-57bd96b888-br4g4\" (UID: \"9024a82d-d325-4287-abdd-00322b2dd160\") " pod="openshift-console/downloads-57bd96b888-br4g4" May 20 21:51:49.188509 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:49.188488 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpx56\" (UniqueName: \"kubernetes.io/projected/9024a82d-d325-4287-abdd-00322b2dd160-kube-api-access-mpx56\") pod \"downloads-57bd96b888-br4g4\" (UID: \"9024a82d-d325-4287-abdd-00322b2dd160\") " pod="openshift-console/downloads-57bd96b888-br4g4" May 20 21:51:49.240585 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:49.240558 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-br4g4" May 20 21:51:49.364232 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:49.364207 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-br4g4"] May 20 21:51:49.367419 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:51:49.367377 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9024a82d_d325_4287_abdd_00322b2dd160.slice/crio-683c4ac1b895d0443fe858ac47502b60fbd2613e26f0b392a545e388f71b5e44 WatchSource:0}: Error finding container 683c4ac1b895d0443fe858ac47502b60fbd2613e26f0b392a545e388f71b5e44: Status 404 returned error can't find the container with id 683c4ac1b895d0443fe858ac47502b60fbd2613e26f0b392a545e388f71b5e44 May 20 21:51:50.252805 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:50.252750 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-br4g4" event={"ID":"9024a82d-d325-4287-abdd-00322b2dd160","Type":"ContainerStarted","Data":"683c4ac1b895d0443fe858ac47502b60fbd2613e26f0b392a545e388f71b5e44"} May 20 21:51:51.129221 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:51.129186 2571 patch_prober.go:28] interesting pod/image-registry-f4bddfcf6-8tts7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 20 21:51:51.129397 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:51.129238 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" podUID="f076b995-22bf-420a-aa9b-a1d15f41c868" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 20 21:51:59.093219 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.093174 2571 patch_prober.go:28] interesting pod/image-registry-f4bddfcf6-8tts7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 20 21:51:59.093739 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.093235 2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" podUID="f076b995-22bf-420a-aa9b-a1d15f41c868" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 20 21:51:59.093739 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.093286 2571 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:51:59.093937 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.093886 2571 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"9dbb009764171ced82546d59c66411804a172b8b7cf1881fb4fc6e2cacae26ed"} pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" containerMessage="Container registry failed liveness probe, will be restarted" May 20 21:51:59.098082 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.098052 2571 patch_prober.go:28] interesting pod/image-registry-f4bddfcf6-8tts7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 20 21:51:59.098208 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.098091 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" podUID="f076b995-22bf-420a-aa9b-a1d15f41c868" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 20 21:51:59.228354 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.228321 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f9cbfb55b-zsqxn"] May 20 21:51:59.231904 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.231880 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9cbfb55b-zsqxn" May 20 21:51:59.234763 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.234723 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 20 21:51:59.234916 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.234768 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 20 21:51:59.236257 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.236217 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 20 21:51:59.236257 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.236237 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5l2z9\"" May 20 21:51:59.236517 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.236215 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 20 21:51:59.236517 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.236218 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 20 21:51:59.242071 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.242039 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f9cbfb55b-zsqxn"] May 20 21:51:59.373964 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.373886 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41943e5d-a07d-4d68-a5f9-c862968445cf-console-serving-cert\") pod \"console-5f9cbfb55b-zsqxn\" (UID: \"41943e5d-a07d-4d68-a5f9-c862968445cf\") " pod="openshift-console/console-5f9cbfb55b-zsqxn" May 20 21:51:59.373964 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.373939 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41943e5d-a07d-4d68-a5f9-c862968445cf-console-config\") pod \"console-5f9cbfb55b-zsqxn\" (UID: \"41943e5d-a07d-4d68-a5f9-c862968445cf\") " pod="openshift-console/console-5f9cbfb55b-zsqxn" May 20 21:51:59.373964 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.373963 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41943e5d-a07d-4d68-a5f9-c862968445cf-oauth-serving-cert\") pod \"console-5f9cbfb55b-zsqxn\" (UID: \"41943e5d-a07d-4d68-a5f9-c862968445cf\") " pod="openshift-console/console-5f9cbfb55b-zsqxn" May 20 21:51:59.374230 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.374033 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41943e5d-a07d-4d68-a5f9-c862968445cf-console-oauth-config\") pod \"console-5f9cbfb55b-zsqxn\" (UID: \"41943e5d-a07d-4d68-a5f9-c862968445cf\") " pod="openshift-console/console-5f9cbfb55b-zsqxn" May 20 21:51:59.374230 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.374081 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wxht\" (UniqueName: \"kubernetes.io/projected/41943e5d-a07d-4d68-a5f9-c862968445cf-kube-api-access-8wxht\") pod \"console-5f9cbfb55b-zsqxn\" (UID: \"41943e5d-a07d-4d68-a5f9-c862968445cf\") " pod="openshift-console/console-5f9cbfb55b-zsqxn" May 20 21:51:59.374230 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.374199 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41943e5d-a07d-4d68-a5f9-c862968445cf-service-ca\") pod \"console-5f9cbfb55b-zsqxn\" (UID: \"41943e5d-a07d-4d68-a5f9-c862968445cf\") " pod="openshift-console/console-5f9cbfb55b-zsqxn" May 20 21:51:59.474791 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.474759 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41943e5d-a07d-4d68-a5f9-c862968445cf-console-oauth-config\") pod \"console-5f9cbfb55b-zsqxn\" (UID: \"41943e5d-a07d-4d68-a5f9-c862968445cf\") " pod="openshift-console/console-5f9cbfb55b-zsqxn" May 20 21:51:59.474982 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.474816 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8wxht\" (UniqueName: \"kubernetes.io/projected/41943e5d-a07d-4d68-a5f9-c862968445cf-kube-api-access-8wxht\") pod \"console-5f9cbfb55b-zsqxn\" (UID: \"41943e5d-a07d-4d68-a5f9-c862968445cf\") " pod="openshift-console/console-5f9cbfb55b-zsqxn" May 20 21:51:59.474982 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.474844 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41943e5d-a07d-4d68-a5f9-c862968445cf-service-ca\") pod \"console-5f9cbfb55b-zsqxn\" (UID: \"41943e5d-a07d-4d68-a5f9-c862968445cf\") " pod="openshift-console/console-5f9cbfb55b-zsqxn" May 20 21:51:59.474982 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.474892 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41943e5d-a07d-4d68-a5f9-c862968445cf-console-serving-cert\") pod \"console-5f9cbfb55b-zsqxn\" (UID: \"41943e5d-a07d-4d68-a5f9-c862968445cf\") " pod="openshift-console/console-5f9cbfb55b-zsqxn" May 20 21:51:59.474982 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.474935 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41943e5d-a07d-4d68-a5f9-c862968445cf-console-config\") pod \"console-5f9cbfb55b-zsqxn\" (UID: \"41943e5d-a07d-4d68-a5f9-c862968445cf\") " pod="openshift-console/console-5f9cbfb55b-zsqxn" May 20 21:51:59.474982 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.474963 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41943e5d-a07d-4d68-a5f9-c862968445cf-oauth-serving-cert\") pod \"console-5f9cbfb55b-zsqxn\" (UID: \"41943e5d-a07d-4d68-a5f9-c862968445cf\") " pod="openshift-console/console-5f9cbfb55b-zsqxn" May 20 21:51:59.475722 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.475661 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41943e5d-a07d-4d68-a5f9-c862968445cf-service-ca\") pod \"console-5f9cbfb55b-zsqxn\" (UID: \"41943e5d-a07d-4d68-a5f9-c862968445cf\") " pod="openshift-console/console-5f9cbfb55b-zsqxn" May 20 21:51:59.475874 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.475811 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41943e5d-a07d-4d68-a5f9-c862968445cf-oauth-serving-cert\") pod \"console-5f9cbfb55b-zsqxn\" (UID: \"41943e5d-a07d-4d68-a5f9-c862968445cf\") " pod="openshift-console/console-5f9cbfb55b-zsqxn" May 20 21:51:59.475945 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.475870 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41943e5d-a07d-4d68-a5f9-c862968445cf-console-config\") pod \"console-5f9cbfb55b-zsqxn\" (UID: \"41943e5d-a07d-4d68-a5f9-c862968445cf\") " pod="openshift-console/console-5f9cbfb55b-zsqxn" May 20 21:51:59.477531 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.477507 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41943e5d-a07d-4d68-a5f9-c862968445cf-console-oauth-config\") pod \"console-5f9cbfb55b-zsqxn\" (UID: \"41943e5d-a07d-4d68-a5f9-c862968445cf\") " pod="openshift-console/console-5f9cbfb55b-zsqxn" May 20 21:51:59.477681 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.477609 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41943e5d-a07d-4d68-a5f9-c862968445cf-console-serving-cert\") pod \"console-5f9cbfb55b-zsqxn\" (UID: \"41943e5d-a07d-4d68-a5f9-c862968445cf\") " pod="openshift-console/console-5f9cbfb55b-zsqxn" May 20 21:51:59.485854 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.485835 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wxht\" (UniqueName: \"kubernetes.io/projected/41943e5d-a07d-4d68-a5f9-c862968445cf-kube-api-access-8wxht\") pod \"console-5f9cbfb55b-zsqxn\" (UID: \"41943e5d-a07d-4d68-a5f9-c862968445cf\") " pod="openshift-console/console-5f9cbfb55b-zsqxn" May 20 21:51:59.544305 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:51:59.544273 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9cbfb55b-zsqxn" May 20 21:52:02.209137 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.209095 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-67f88fc974-lwf64"] May 20 21:52:02.215203 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.215180 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:02.223628 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.223587 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67f88fc974-lwf64"] May 20 21:52:02.224867 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.224841 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 20 21:52:02.302813 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.302780 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cafcd8f-18d3-46af-9538-779f64259e2b-trusted-ca-bundle\") pod \"console-67f88fc974-lwf64\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:02.303015 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.302935 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cafcd8f-18d3-46af-9538-779f64259e2b-console-serving-cert\") pod \"console-67f88fc974-lwf64\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:02.303015 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.302998 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zfmw\" (UniqueName: \"kubernetes.io/projected/9cafcd8f-18d3-46af-9538-779f64259e2b-kube-api-access-8zfmw\") pod \"console-67f88fc974-lwf64\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:02.303152 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.303072 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cafcd8f-18d3-46af-9538-779f64259e2b-service-ca\") pod \"console-67f88fc974-lwf64\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:02.303152 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.303108 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cafcd8f-18d3-46af-9538-779f64259e2b-oauth-serving-cert\") pod \"console-67f88fc974-lwf64\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:02.303233 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.303180 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cafcd8f-18d3-46af-9538-779f64259e2b-console-oauth-config\") pod \"console-67f88fc974-lwf64\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:02.303233 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.303207 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cafcd8f-18d3-46af-9538-779f64259e2b-console-config\") pod \"console-67f88fc974-lwf64\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:02.404622 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.404584 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cafcd8f-18d3-46af-9538-779f64259e2b-trusted-ca-bundle\") pod \"console-67f88fc974-lwf64\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:02.404846 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.404821 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cafcd8f-18d3-46af-9538-779f64259e2b-console-serving-cert\") pod \"console-67f88fc974-lwf64\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:02.404925 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.404869 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8zfmw\" (UniqueName: \"kubernetes.io/projected/9cafcd8f-18d3-46af-9538-779f64259e2b-kube-api-access-8zfmw\") pod \"console-67f88fc974-lwf64\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:02.404925 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.404907 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cafcd8f-18d3-46af-9538-779f64259e2b-service-ca\") pod \"console-67f88fc974-lwf64\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:02.405028 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.404934 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cafcd8f-18d3-46af-9538-779f64259e2b-oauth-serving-cert\") pod \"console-67f88fc974-lwf64\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:02.405028 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.404982 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cafcd8f-18d3-46af-9538-779f64259e2b-console-oauth-config\") pod \"console-67f88fc974-lwf64\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:02.405267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.405232 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cafcd8f-18d3-46af-9538-779f64259e2b-console-config\") pod \"console-67f88fc974-lwf64\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:02.405698 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.405623 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cafcd8f-18d3-46af-9538-779f64259e2b-service-ca\") pod \"console-67f88fc974-lwf64\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:02.405698 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.405681 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cafcd8f-18d3-46af-9538-779f64259e2b-trusted-ca-bundle\") pod \"console-67f88fc974-lwf64\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:02.405866 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.405713 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cafcd8f-18d3-46af-9538-779f64259e2b-oauth-serving-cert\") pod \"console-67f88fc974-lwf64\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:02.405990 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.405970 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cafcd8f-18d3-46af-9538-779f64259e2b-console-config\") pod \"console-67f88fc974-lwf64\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:02.407939 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.407914 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cafcd8f-18d3-46af-9538-779f64259e2b-console-oauth-config\") pod \"console-67f88fc974-lwf64\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:02.408050 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.407981 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cafcd8f-18d3-46af-9538-779f64259e2b-console-serving-cert\") pod \"console-67f88fc974-lwf64\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:02.413691 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.413668 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zfmw\" (UniqueName: \"kubernetes.io/projected/9cafcd8f-18d3-46af-9538-779f64259e2b-kube-api-access-8zfmw\") pod \"console-67f88fc974-lwf64\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:02.528357 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:02.528268 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:04.730122 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:04.730039 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f9cbfb55b-zsqxn"] May 20 21:52:04.758047 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:04.758021 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67f88fc974-lwf64"] May 20 21:52:04.759721 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:52:04.759692 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cafcd8f_18d3_46af_9538_779f64259e2b.slice/crio-41cc210403dadce3ea53c72a314c927e86ad21da09cdcab50310cce5638e0de7 WatchSource:0}: Error finding container 41cc210403dadce3ea53c72a314c927e86ad21da09cdcab50310cce5638e0de7: Status 404 returned error can't find the container with id 41cc210403dadce3ea53c72a314c927e86ad21da09cdcab50310cce5638e0de7 May 20 21:52:05.314534 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:05.314494 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f88fc974-lwf64" event={"ID":"9cafcd8f-18d3-46af-9538-779f64259e2b","Type":"ContainerStarted","Data":"41cc210403dadce3ea53c72a314c927e86ad21da09cdcab50310cce5638e0de7"} May 20 21:52:05.317786 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:05.317737 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-br4g4" event={"ID":"9024a82d-d325-4287-abdd-00322b2dd160","Type":"ContainerStarted","Data":"e872eadec2b99302366991cc0502d9e1c72cca9c769b70c5a7fb7ec19f7d56bf"} May 20 21:52:05.318401 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:05.318366 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-br4g4" May 20 21:52:05.320669 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:05.320589 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9cbfb55b-zsqxn" event={"ID":"41943e5d-a07d-4d68-a5f9-c862968445cf","Type":"ContainerStarted","Data":"969505afd8f83f192a5b5fd59bacb9f32dccfcfc33ae3b04fad4f75d2f595e79"} May 20 21:52:05.331843 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:05.331805 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-br4g4" May 20 21:52:05.338371 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:05.337267 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-br4g4" podStartSLOduration=2.006450364 podStartE2EDuration="17.337251969s" podCreationTimestamp="2026-05-20 21:51:48 +0000 UTC" firstStartedPulling="2026-05-20 21:51:49.3696586 +0000 UTC m=+220.299475325" lastFinishedPulling="2026-05-20 21:52:04.700460207 +0000 UTC m=+235.630276930" observedRunningTime="2026-05-20 21:52:05.335016231 +0000 UTC m=+236.264832973" watchObservedRunningTime="2026-05-20 21:52:05.337251969 +0000 UTC m=+236.267068713" May 20 21:52:09.099126 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:09.099088 2571 patch_prober.go:28] interesting pod/image-registry-f4bddfcf6-8tts7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 20 21:52:09.099561 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:09.099152 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" podUID="f076b995-22bf-420a-aa9b-a1d15f41c868" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 20 21:52:09.337164 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:09.337126 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9cbfb55b-zsqxn" event={"ID":"41943e5d-a07d-4d68-a5f9-c862968445cf","Type":"ContainerStarted","Data":"4247bda6ae0de97c9669f68da12d0050aee1153189657187a5a5b7a3b2902867"} May 20 21:52:09.338892 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:09.338863 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f88fc974-lwf64" event={"ID":"9cafcd8f-18d3-46af-9538-779f64259e2b","Type":"ContainerStarted","Data":"2675515ae955ee8cd52898cefc8e49d63edd53835bdbf89c153a1f4d80e60db6"} May 20 21:52:09.356048 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:09.356002 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5f9cbfb55b-zsqxn" podStartSLOduration=6.26543779 podStartE2EDuration="10.3559882s" podCreationTimestamp="2026-05-20 21:51:59 +0000 UTC" firstStartedPulling="2026-05-20 21:52:04.750056071 +0000 UTC m=+235.679872803" lastFinishedPulling="2026-05-20 21:52:08.84060649 +0000 UTC m=+239.770423213" observedRunningTime="2026-05-20 21:52:09.354458093 +0000 UTC m=+240.284274838" watchObservedRunningTime="2026-05-20 21:52:09.3559882 +0000 UTC m=+240.285804942" May 20 21:52:09.373414 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:09.373362 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-67f88fc974-lwf64" podStartSLOduration=3.286845962 podStartE2EDuration="7.373352392s" podCreationTimestamp="2026-05-20 21:52:02 +0000 UTC" firstStartedPulling="2026-05-20 21:52:04.761553874 +0000 UTC m=+235.691370598" lastFinishedPulling="2026-05-20 21:52:08.848060293 +0000 UTC m=+239.777877028" observedRunningTime="2026-05-20 21:52:09.372155582 +0000 UTC m=+240.301972328" watchObservedRunningTime="2026-05-20 21:52:09.373352392 +0000 UTC m=+240.303169135" May 20 21:52:09.545364 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:09.545327 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f9cbfb55b-zsqxn" May 20 21:52:09.545364 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:09.545371 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f9cbfb55b-zsqxn" May 20 21:52:09.546938 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:09.546904 2571 patch_prober.go:28] interesting pod/console-5f9cbfb55b-zsqxn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= May 20 21:52:09.547082 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:09.546954 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5f9cbfb55b-zsqxn" podUID="41943e5d-a07d-4d68-a5f9-c862968445cf" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" May 20 21:52:12.528599 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:12.528563 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:12.529144 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:12.528612 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67f88fc974-lwf64" May 20 21:52:12.530067 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:12.530041 2571 patch_prober.go:28] interesting pod/console-67f88fc974-lwf64 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= May 20 21:52:12.530177 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:12.530103 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-67f88fc974-lwf64" podUID="9cafcd8f-18d3-46af-9538-779f64259e2b" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" May 20 21:52:19.099086 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:19.099055 2571 patch_prober.go:28] interesting pod/image-registry-f4bddfcf6-8tts7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 20 21:52:19.099556 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:19.099101 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" podUID="f076b995-22bf-420a-aa9b-a1d15f41c868" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 20 21:52:19.545467 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:19.545388 2571 patch_prober.go:28] interesting pod/console-5f9cbfb55b-zsqxn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= May 20 21:52:19.545467 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:19.545434 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5f9cbfb55b-zsqxn" podUID="41943e5d-a07d-4d68-a5f9-c862968445cf" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" May 20 21:52:21.313517 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:21.313475 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs\") pod \"network-metrics-daemon-hdgzt\" (UID: \"b785e9ea-de17-443e-b54a-ca50c16abeb6\") " pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:52:21.315706 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:21.315685 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b785e9ea-de17-443e-b54a-ca50c16abeb6-metrics-certs\") pod \"network-metrics-daemon-hdgzt\" (UID: \"b785e9ea-de17-443e-b54a-ca50c16abeb6\") " pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:52:21.528091 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:21.528062 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5n7z5\"" May 20 21:52:21.536139 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:21.536119 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hdgzt" May 20 21:52:21.660677 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:21.660649 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hdgzt"] May 20 21:52:21.663047 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:52:21.663005 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb785e9ea_de17_443e_b54a_ca50c16abeb6.slice/crio-152ee86b734cff18fd8afea403bbd43527cac83a488da2ee52528e2e5d907498 WatchSource:0}: Error finding container 152ee86b734cff18fd8afea403bbd43527cac83a488da2ee52528e2e5d907498: Status 404 returned error can't find the container with id 152ee86b734cff18fd8afea403bbd43527cac83a488da2ee52528e2e5d907498 May 20 21:52:22.377914 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:22.377877 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hdgzt" event={"ID":"b785e9ea-de17-443e-b54a-ca50c16abeb6","Type":"ContainerStarted","Data":"152ee86b734cff18fd8afea403bbd43527cac83a488da2ee52528e2e5d907498"} May 20 21:52:22.529380 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:22.529329 2571 patch_prober.go:28] interesting pod/console-67f88fc974-lwf64 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= May 20 21:52:22.529547 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:22.529398 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-67f88fc974-lwf64" podUID="9cafcd8f-18d3-46af-9538-779f64259e2b" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" May 20 21:52:23.381796 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:23.381769 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hdgzt" event={"ID":"b785e9ea-de17-443e-b54a-ca50c16abeb6","Type":"ContainerStarted","Data":"bd50413f9f050f587aa5c69201473f924f3cabbcafb04680b5b97e08eb3d5798"} May 20 21:52:24.115535 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:24.115496 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" podUID="f076b995-22bf-420a-aa9b-a1d15f41c868" containerName="registry" containerID="cri-o://9dbb009764171ced82546d59c66411804a172b8b7cf1881fb4fc6e2cacae26ed" gracePeriod=30 May 20 21:52:24.386200 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:24.386124 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hdgzt" event={"ID":"b785e9ea-de17-443e-b54a-ca50c16abeb6","Type":"ContainerStarted","Data":"38f81aa3c0443a9e0dd122e42b1114d348f57b630828d9fe3f4d619399bfcff8"} May 20 21:52:24.402650 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:24.402603 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hdgzt" podStartSLOduration=253.96203549 podStartE2EDuration="4m15.402590373s" podCreationTimestamp="2026-05-20 21:48:09 +0000 UTC" firstStartedPulling="2026-05-20 21:52:21.664866012 +0000 UTC m=+252.594682732" lastFinishedPulling="2026-05-20 21:52:23.105420891 +0000 UTC m=+254.035237615" observedRunningTime="2026-05-20 21:52:24.402000816 +0000 UTC m=+255.331817561" watchObservedRunningTime="2026-05-20 21:52:24.402590373 +0000 UTC m=+255.332407116" May 20 21:52:25.391038 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:25.391009 2571 generic.go:358] "Generic (PLEG): container finished" podID="f076b995-22bf-420a-aa9b-a1d15f41c868" containerID="9dbb009764171ced82546d59c66411804a172b8b7cf1881fb4fc6e2cacae26ed" exitCode=0 May 20 21:52:25.391426 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:25.391076 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" event={"ID":"f076b995-22bf-420a-aa9b-a1d15f41c868","Type":"ContainerDied","Data":"9dbb009764171ced82546d59c66411804a172b8b7cf1881fb4fc6e2cacae26ed"} May 20 21:52:25.391426 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:25.391109 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" event={"ID":"f076b995-22bf-420a-aa9b-a1d15f41c868","Type":"ContainerStarted","Data":"3edc92615e2d75ef5ad18bf0125e63a33472cb2af5941934c45d933cc650f99a"} May 20 21:52:25.391530 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:25.391510 2571 patch_prober.go:28] interesting pod/image-registry-f4bddfcf6-8tts7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.14:5000/healthz\": dial tcp 10.132.0.14:5000: connect: connection refused" start-of-body= May 20 21:52:25.391572 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:25.391556 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" podUID="f076b995-22bf-420a-aa9b-a1d15f41c868" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.14:5000/healthz\": dial tcp 10.132.0.14:5000: connect: connection refused" May 20 21:52:26.397839 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:26.397807 2571 generic.go:358] "Generic (PLEG): container finished" podID="4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc" containerID="ca873a696b15ecc2184ddf352821581d448f59ecc4d5964e485a31e829274d78" exitCode=0 May 20 21:52:26.398230 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:26.397885 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-2fql2" event={"ID":"4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc","Type":"ContainerDied","Data":"ca873a696b15ecc2184ddf352821581d448f59ecc4d5964e485a31e829274d78"} May 20 21:52:26.398295 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:26.398237 2571 scope.go:117] "RemoveContainer" containerID="ca873a696b15ecc2184ddf352821581d448f59ecc4d5964e485a31e829274d78" May 20 21:52:27.403756 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:27.403714 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-2fql2" event={"ID":"4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc","Type":"ContainerStarted","Data":"611e77c4a82345e8478e197140f69ad2a3cf57e744e4fa06ba93d5fb78aeb96d"} May 20 21:52:29.545613 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:29.545528 2571 patch_prober.go:28] interesting pod/console-5f9cbfb55b-zsqxn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= May 20 21:52:29.545613 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:29.545579 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5f9cbfb55b-zsqxn" podUID="41943e5d-a07d-4d68-a5f9-c862968445cf" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" May 20 21:52:29.591418 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:29.591379 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e7393362-2329-4e6a-b697-0ca4c0108e7a/init-config-reloader/0.log" May 20 21:52:29.791384 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:29.791355 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e7393362-2329-4e6a-b697-0ca4c0108e7a/alertmanager/0.log" May 20 21:52:29.990585 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:29.990551 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e7393362-2329-4e6a-b697-0ca4c0108e7a/config-reloader/0.log" May 20 21:52:30.190300 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:30.190269 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e7393362-2329-4e6a-b697-0ca4c0108e7a/kube-rbac-proxy-web/0.log" May 20 21:52:30.391028 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:30.390999 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e7393362-2329-4e6a-b697-0ca4c0108e7a/kube-rbac-proxy/0.log" May 20 21:52:30.590717 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:30.590672 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e7393362-2329-4e6a-b697-0ca4c0108e7a/kube-rbac-proxy-metric/0.log" May 20 21:52:30.790591 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:30.790522 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e7393362-2329-4e6a-b697-0ca4c0108e7a/prom-label-proxy/0.log" May 20 21:52:30.992713 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:30.992680 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-k6p4v_68adcd35-40d1-4ced-95ff-bb6dd6ded88d/cluster-monitoring-operator/0.log" May 20 21:52:31.990054 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:31.990022 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-pz686_8404b49b-0a27-4041-8187-fa4fe70abe6c/monitoring-plugin/0.log" May 20 21:52:32.529242 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:32.529208 2571 patch_prober.go:28] interesting pod/console-67f88fc974-lwf64 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= May 20 21:52:32.529417 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:32.529264 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-67f88fc974-lwf64" podUID="9cafcd8f-18d3-46af-9538-779f64259e2b" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" May 20 21:52:33.390487 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:33.390456 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t4tlq_dabab527-5248-49e1-862e-b9292ee3a982/init-textfile/0.log" May 20 21:52:33.592721 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:33.592698 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t4tlq_dabab527-5248-49e1-862e-b9292ee3a982/node-exporter/0.log" May 20 21:52:33.790488 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:33.790406 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t4tlq_dabab527-5248-49e1-862e-b9292ee3a982/kube-rbac-proxy/0.log" May 20 21:52:33.991207 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:33.991181 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-wss9v_dd691911-058c-4ebb-8eeb-c7bcb972f144/kube-rbac-proxy-main/0.log" May 20 21:52:34.190312 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:34.190280 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-wss9v_dd691911-058c-4ebb-8eeb-c7bcb972f144/kube-rbac-proxy-self/0.log" May 20 21:52:34.391052 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:34.391029 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-wss9v_dd691911-058c-4ebb-8eeb-c7bcb972f144/openshift-state-metrics/0.log" May 20 21:52:35.392317 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:35.392285 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:52:36.591025 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:36.590991 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c54d897ff-nx9kr_64a698a8-9681-45dd-889f-fb503d49ef30/telemeter-client/0.log" May 20 21:52:36.792897 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:36.792865 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c54d897ff-nx9kr_64a698a8-9681-45dd-889f-fb503d49ef30/reload/0.log" May 20 21:52:36.990228 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:36.990155 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c54d897ff-nx9kr_64a698a8-9681-45dd-889f-fb503d49ef30/kube-rbac-proxy/0.log" May 20 21:52:37.192199 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:37.192165 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5485f79869-fsfcl_f56ad553-52af-4cc6-8843-12b4991f98f0/thanos-query/0.log" May 20 21:52:37.391074 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:37.391047 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5485f79869-fsfcl_f56ad553-52af-4cc6-8843-12b4991f98f0/kube-rbac-proxy-web/0.log" May 20 21:52:37.590813 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:37.590779 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5485f79869-fsfcl_f56ad553-52af-4cc6-8843-12b4991f98f0/kube-rbac-proxy/0.log" May 20 21:52:37.790913 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:37.790841 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5485f79869-fsfcl_f56ad553-52af-4cc6-8843-12b4991f98f0/prom-label-proxy/0.log" May 20 21:52:37.991718 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:37.991690 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5485f79869-fsfcl_f56ad553-52af-4cc6-8843-12b4991f98f0/kube-rbac-proxy-rules/0.log" May 20 21:52:38.190461 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:38.190436 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5485f79869-fsfcl_f56ad553-52af-4cc6-8843-12b4991f98f0/kube-rbac-proxy-metrics/0.log" May 20 21:52:38.590886 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:38.590852 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/2.log" May 20 21:52:38.795759 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:38.795735 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/3.log" May 20 21:52:38.991536 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:38.991456 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f9cbfb55b-zsqxn_41943e5d-a07d-4d68-a5f9-c862968445cf/console/0.log" May 20 21:52:39.092775 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:39.092746 2571 patch_prober.go:28] interesting pod/image-registry-f4bddfcf6-8tts7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 20 21:52:39.092924 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:39.092802 2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" podUID="f076b995-22bf-420a-aa9b-a1d15f41c868" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 20 21:52:39.191274 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:39.191250 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67f88fc974-lwf64_9cafcd8f-18d3-46af-9538-779f64259e2b/console/0.log" May 20 21:52:39.393105 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:39.393077 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-br4g4_9024a82d-d325-4287-abdd-00322b2dd160/download-server/0.log" May 20 21:52:39.545550 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:39.545517 2571 patch_prober.go:28] interesting pod/console-5f9cbfb55b-zsqxn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= May 20 21:52:39.545726 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:39.545578 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5f9cbfb55b-zsqxn" podUID="41943e5d-a07d-4d68-a5f9-c862968445cf" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" May 20 21:52:40.790445 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:40.790421 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6wwrr_cf000cdd-dfa0-43d2-9df8-84baf9a14af4/dns-node-resolver/0.log" May 20 21:52:41.591425 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:41.591365 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-f4bddfcf6-8tts7_f076b995-22bf-420a-aa9b-a1d15f41c868/registry/0.log" May 20 21:52:41.790866 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:41.790838 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-f4bddfcf6-8tts7_f076b995-22bf-420a-aa9b-a1d15f41c868/registry/1.log" May 20 21:52:41.991584 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:41.991508 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-68fgb_aec000a4-9bb5-43e5-b40a-cfe251c18da5/node-ca/0.log" May 20 21:52:42.528795 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:42.528766 2571 patch_prober.go:28] interesting pod/console-67f88fc974-lwf64 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= May 20 21:52:42.528970 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:42.528810 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-67f88fc974-lwf64" podUID="9cafcd8f-18d3-46af-9538-779f64259e2b" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" May 20 21:52:42.592538 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:42.592510 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79b4479bfb-qqx5p_3d9fa4f6-b0e6-4d16-bc9a-c659362811db/router/0.log" May 20 21:52:45.397160 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:45.397127 2571 patch_prober.go:28] interesting pod/image-registry-f4bddfcf6-8tts7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 20 21:52:45.397524 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:45.397190 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" podUID="f076b995-22bf-420a-aa9b-a1d15f41c868" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 20 21:52:49.092445 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:49.092416 2571 patch_prober.go:28] interesting pod/image-registry-f4bddfcf6-8tts7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 20 21:52:49.092824 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:49.092476 2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" podUID="f076b995-22bf-420a-aa9b-a1d15f41c868" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 20 21:52:49.545095 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:49.545021 2571 patch_prober.go:28] interesting pod/console-5f9cbfb55b-zsqxn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= May 20 21:52:49.545095 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:49.545064 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5f9cbfb55b-zsqxn" podUID="41943e5d-a07d-4d68-a5f9-c862968445cf" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" May 20 21:52:50.029443 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:52:50.029406 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nxnd2" podUID="53d29758-e039-4bd4-93ed-9848d16a4bb8" May 20 21:52:50.470902 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:50.470871 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nxnd2" May 20 21:52:52.529566 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:52.529532 2571 patch_prober.go:28] interesting pod/console-67f88fc974-lwf64 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= May 20 21:52:52.529972 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:52.529593 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-67f88fc974-lwf64" podUID="9cafcd8f-18d3-46af-9538-779f64259e2b" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" May 20 21:52:52.932557 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:52.932522 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f9cbfb55b-zsqxn"] May 20 21:52:52.982627 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:52.982592 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b94b5c75-v7x7g"] May 20 21:52:52.987378 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:52.987352 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:52:53.003657 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.003612 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b94b5c75-v7x7g"] May 20 21:52:53.081865 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.081837 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgm5b\" (UniqueName: \"kubernetes.io/projected/effc5908-526f-447d-a993-89b4c48554c5-kube-api-access-xgm5b\") pod \"console-7b94b5c75-v7x7g\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:52:53.081982 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.081870 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/effc5908-526f-447d-a993-89b4c48554c5-oauth-serving-cert\") pod \"console-7b94b5c75-v7x7g\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:52:53.081982 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.081914 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/effc5908-526f-447d-a993-89b4c48554c5-service-ca\") pod \"console-7b94b5c75-v7x7g\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:52:53.081982 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.081965 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/effc5908-526f-447d-a993-89b4c48554c5-console-config\") pod \"console-7b94b5c75-v7x7g\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:52:53.082097 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.082030 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/effc5908-526f-447d-a993-89b4c48554c5-console-oauth-config\") pod \"console-7b94b5c75-v7x7g\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:52:53.082097 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.082058 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/effc5908-526f-447d-a993-89b4c48554c5-console-serving-cert\") pod \"console-7b94b5c75-v7x7g\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:52:53.082097 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.082080 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/effc5908-526f-447d-a993-89b4c48554c5-trusted-ca-bundle\") pod \"console-7b94b5c75-v7x7g\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:52:53.182859 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.182791 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xgm5b\" (UniqueName: \"kubernetes.io/projected/effc5908-526f-447d-a993-89b4c48554c5-kube-api-access-xgm5b\") pod \"console-7b94b5c75-v7x7g\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:52:53.182859 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.182824 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/effc5908-526f-447d-a993-89b4c48554c5-oauth-serving-cert\") pod \"console-7b94b5c75-v7x7g\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:52:53.182859 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.182853 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/effc5908-526f-447d-a993-89b4c48554c5-service-ca\") pod \"console-7b94b5c75-v7x7g\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:52:53.183070 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.182870 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/effc5908-526f-447d-a993-89b4c48554c5-console-config\") pod \"console-7b94b5c75-v7x7g\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:52:53.183070 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.182915 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/effc5908-526f-447d-a993-89b4c48554c5-console-oauth-config\") pod \"console-7b94b5c75-v7x7g\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:52:53.183070 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.182948 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/effc5908-526f-447d-a993-89b4c48554c5-console-serving-cert\") pod \"console-7b94b5c75-v7x7g\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:52:53.183219 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.183098 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/effc5908-526f-447d-a993-89b4c48554c5-trusted-ca-bundle\") pod \"console-7b94b5c75-v7x7g\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:52:53.183573 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.183550 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/effc5908-526f-447d-a993-89b4c48554c5-service-ca\") pod \"console-7b94b5c75-v7x7g\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:52:53.183698 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.183614 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/effc5908-526f-447d-a993-89b4c48554c5-console-config\") pod \"console-7b94b5c75-v7x7g\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:52:53.183698 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.183615 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/effc5908-526f-447d-a993-89b4c48554c5-oauth-serving-cert\") pod \"console-7b94b5c75-v7x7g\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:52:53.183954 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.183937 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/effc5908-526f-447d-a993-89b4c48554c5-trusted-ca-bundle\") pod \"console-7b94b5c75-v7x7g\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:52:53.185823 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.185798 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/effc5908-526f-447d-a993-89b4c48554c5-console-oauth-config\") pod \"console-7b94b5c75-v7x7g\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:52:53.186018 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.185999 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/effc5908-526f-447d-a993-89b4c48554c5-console-serving-cert\") pod \"console-7b94b5c75-v7x7g\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:52:53.193209 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.193190 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgm5b\" (UniqueName: \"kubernetes.io/projected/effc5908-526f-447d-a993-89b4c48554c5-kube-api-access-xgm5b\") pod \"console-7b94b5c75-v7x7g\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:52:53.296242 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.296220 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:52:53.417845 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.417819 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b94b5c75-v7x7g"] May 20 21:52:53.420018 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:52:53.419988 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeffc5908_526f_447d_a993_89b4c48554c5.slice/crio-08111d1c56acecd7b70ad0da93bebd427b75efb59199abac40feb84702c1e58f WatchSource:0}: Error finding container 08111d1c56acecd7b70ad0da93bebd427b75efb59199abac40feb84702c1e58f: Status 404 returned error can't find the container with id 08111d1c56acecd7b70ad0da93bebd427b75efb59199abac40feb84702c1e58f May 20 21:52:53.481746 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.481706 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b94b5c75-v7x7g" event={"ID":"effc5908-526f-447d-a993-89b4c48554c5","Type":"ContainerStarted","Data":"b3be0b247a763928f3f6ad9ef4f24455aec8d7f790b6b5f778450e450ae7f246"} May 20 21:52:53.481848 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.481763 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b94b5c75-v7x7g" event={"ID":"effc5908-526f-447d-a993-89b4c48554c5","Type":"ContainerStarted","Data":"08111d1c56acecd7b70ad0da93bebd427b75efb59199abac40feb84702c1e58f"} May 20 21:52:53.485903 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.485877 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls\") pod \"dns-default-nxnd2\" (UID: \"53d29758-e039-4bd4-93ed-9848d16a4bb8\") " pod="openshift-dns/dns-default-nxnd2" May 20 21:52:53.486031 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.486014 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert\") pod \"ingress-canary-rnmkn\" (UID: \"3099afb3-7f12-4cc5-9916-e30f1ce42c8b\") " pod="openshift-ingress-canary/ingress-canary-rnmkn" May 20 21:52:53.488117 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.488088 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53d29758-e039-4bd4-93ed-9848d16a4bb8-metrics-tls\") pod \"dns-default-nxnd2\" (UID: \"53d29758-e039-4bd4-93ed-9848d16a4bb8\") " pod="openshift-dns/dns-default-nxnd2" May 20 21:52:53.488117 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.488110 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3099afb3-7f12-4cc5-9916-e30f1ce42c8b-cert\") pod \"ingress-canary-rnmkn\" (UID: \"3099afb3-7f12-4cc5-9916-e30f1ce42c8b\") " pod="openshift-ingress-canary/ingress-canary-rnmkn" May 20 21:52:53.499725 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.499677 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7b94b5c75-v7x7g" podStartSLOduration=1.499661062 podStartE2EDuration="1.499661062s" podCreationTimestamp="2026-05-20 21:52:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:52:53.498660409 +0000 UTC m=+284.428477155" watchObservedRunningTime="2026-05-20 21:52:53.499661062 +0000 UTC m=+284.429477806" May 20 21:52:53.727502 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.727429 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n5njn\"" May 20 21:52:53.734707 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.734692 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rnmkn" May 20 21:52:53.774178 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.774150 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2fk4m\"" May 20 21:52:53.782543 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.782508 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nxnd2" May 20 21:52:53.867964 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.867941 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rnmkn"] May 20 21:52:53.871209 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:52:53.871176 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3099afb3_7f12_4cc5_9916_e30f1ce42c8b.slice/crio-6a0e1c3f063d7a513fb87f3192de3fe6eddee35adb20adc5f49805455e73b1d9 WatchSource:0}: Error finding container 6a0e1c3f063d7a513fb87f3192de3fe6eddee35adb20adc5f49805455e73b1d9: Status 404 returned error can't find the container with id 6a0e1c3f063d7a513fb87f3192de3fe6eddee35adb20adc5f49805455e73b1d9 May 20 21:52:53.926153 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:53.926130 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nxnd2"] May 20 21:52:53.928531 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:52:53.928505 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53d29758_e039_4bd4_93ed_9848d16a4bb8.slice/crio-e3f94ab46be305238f71a67fc2f6ad6e7c5c068b9278c86ea4839626844cba12 WatchSource:0}: Error finding container e3f94ab46be305238f71a67fc2f6ad6e7c5c068b9278c86ea4839626844cba12: Status 404 returned error can't find the container with id e3f94ab46be305238f71a67fc2f6ad6e7c5c068b9278c86ea4839626844cba12 May 20 21:52:54.487434 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:54.487397 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nxnd2" event={"ID":"53d29758-e039-4bd4-93ed-9848d16a4bb8","Type":"ContainerStarted","Data":"e3f94ab46be305238f71a67fc2f6ad6e7c5c068b9278c86ea4839626844cba12"} May 20 21:52:54.488894 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:54.488844 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rnmkn" event={"ID":"3099afb3-7f12-4cc5-9916-e30f1ce42c8b","Type":"ContainerStarted","Data":"6a0e1c3f063d7a513fb87f3192de3fe6eddee35adb20adc5f49805455e73b1d9"} May 20 21:52:54.976579 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:54.976542 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 21:52:54.983112 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:54.977754 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="alertmanager" containerID="cri-o://d0b932175d03b641ff6ab71677fced4cca5e6376002d3eb67080b80fa555e330" gracePeriod=120 May 20 21:52:54.983112 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:54.977930 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="kube-rbac-proxy" containerID="cri-o://f0b6a014d35ac53327f8f0ae263031855004e49fefe057f4fc1bb69b3ec821da" gracePeriod=120 May 20 21:52:54.983112 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:54.977755 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="kube-rbac-proxy-metric" containerID="cri-o://fc6c70e4b55f151c09d1c5c5c15227aaadc73fc8eab4de62a786e7d7588ee4ea" gracePeriod=120 May 20 21:52:54.983358 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:54.977955 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="prom-label-proxy" containerID="cri-o://44c2a44fb00908b5ba76b3759e6e1d4d61f53d321e077841c446192ffaf3461f" gracePeriod=120 May 20 21:52:54.983457 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:54.977967 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="kube-rbac-proxy-web" containerID="cri-o://c37bee8420363cadc6a3c9b6d391fa8124f329bbd9e8ebee696f018113b6862b" gracePeriod=120 May 20 21:52:54.983528 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:54.977978 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="config-reloader" containerID="cri-o://6dea6b9c416c0420a7caa0ef786d0ce8f2134305912c6d65a5d8fde2474d9a32" gracePeriod=120 May 20 21:52:55.397144 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:55.397102 2571 patch_prober.go:28] interesting pod/image-registry-f4bddfcf6-8tts7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 20 21:52:55.397265 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:55.397167 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" podUID="f076b995-22bf-420a-aa9b-a1d15f41c868" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 20 21:52:55.495808 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:55.495771 2571 generic.go:358] "Generic (PLEG): container finished" podID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerID="44c2a44fb00908b5ba76b3759e6e1d4d61f53d321e077841c446192ffaf3461f" exitCode=0 May 20 21:52:55.495808 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:55.495802 2571 generic.go:358] "Generic (PLEG): container finished" podID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerID="f0b6a014d35ac53327f8f0ae263031855004e49fefe057f4fc1bb69b3ec821da" exitCode=0 May 20 21:52:55.495808 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:55.495813 2571 generic.go:358] "Generic (PLEG): container finished" podID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerID="6dea6b9c416c0420a7caa0ef786d0ce8f2134305912c6d65a5d8fde2474d9a32" exitCode=0 May 20 21:52:55.495808 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:55.495823 2571 generic.go:358] "Generic (PLEG): container finished" podID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerID="d0b932175d03b641ff6ab71677fced4cca5e6376002d3eb67080b80fa555e330" exitCode=0 May 20 21:52:55.496083 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:55.495844 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7393362-2329-4e6a-b697-0ca4c0108e7a","Type":"ContainerDied","Data":"44c2a44fb00908b5ba76b3759e6e1d4d61f53d321e077841c446192ffaf3461f"} May 20 21:52:55.496083 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:55.495893 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7393362-2329-4e6a-b697-0ca4c0108e7a","Type":"ContainerDied","Data":"f0b6a014d35ac53327f8f0ae263031855004e49fefe057f4fc1bb69b3ec821da"} May 20 21:52:55.496083 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:55.495907 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7393362-2329-4e6a-b697-0ca4c0108e7a","Type":"ContainerDied","Data":"6dea6b9c416c0420a7caa0ef786d0ce8f2134305912c6d65a5d8fde2474d9a32"} May 20 21:52:55.496083 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:55.495919 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7393362-2329-4e6a-b697-0ca4c0108e7a","Type":"ContainerDied","Data":"d0b932175d03b641ff6ab71677fced4cca5e6376002d3eb67080b80fa555e330"} May 20 21:52:56.216783 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.216760 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.313239 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.313207 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e7393362-2329-4e6a-b697-0ca4c0108e7a-alertmanager-main-db\") pod \"e7393362-2329-4e6a-b697-0ca4c0108e7a\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " May 20 21:52:56.313239 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.313242 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-config-volume\") pod \"e7393362-2329-4e6a-b697-0ca4c0108e7a\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " May 20 21:52:56.313464 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.313266 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7393362-2329-4e6a-b697-0ca4c0108e7a-metrics-client-ca\") pod \"e7393362-2329-4e6a-b697-0ca4c0108e7a\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " May 20 21:52:56.313464 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.313293 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7393362-2329-4e6a-b697-0ca4c0108e7a-config-out\") pod \"e7393362-2329-4e6a-b697-0ca4c0108e7a\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " May 20 21:52:56.313464 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.313420 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-secret-alertmanager-kube-rbac-proxy\") pod \"e7393362-2329-4e6a-b697-0ca4c0108e7a\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " May 20 21:52:56.313626 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.313481 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bht59\" (UniqueName: \"kubernetes.io/projected/e7393362-2329-4e6a-b697-0ca4c0108e7a-kube-api-access-bht59\") pod \"e7393362-2329-4e6a-b697-0ca4c0108e7a\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " May 20 21:52:56.313626 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.313512 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-secret-alertmanager-kube-rbac-proxy-web\") pod \"e7393362-2329-4e6a-b697-0ca4c0108e7a\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " May 20 21:52:56.313626 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.313571 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7393362-2329-4e6a-b697-0ca4c0108e7a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e7393362-2329-4e6a-b697-0ca4c0108e7a" (UID: "e7393362-2329-4e6a-b697-0ca4c0108e7a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:52:56.313626 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.313578 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-web-config\") pod \"e7393362-2329-4e6a-b697-0ca4c0108e7a\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " May 20 21:52:56.313855 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.313632 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7393362-2329-4e6a-b697-0ca4c0108e7a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e7393362-2329-4e6a-b697-0ca4c0108e7a" (UID: "e7393362-2329-4e6a-b697-0ca4c0108e7a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 21:52:56.313855 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.313679 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-cluster-tls-config\") pod \"e7393362-2329-4e6a-b697-0ca4c0108e7a\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " May 20 21:52:56.313855 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.313726 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7393362-2329-4e6a-b697-0ca4c0108e7a-tls-assets\") pod \"e7393362-2329-4e6a-b697-0ca4c0108e7a\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " May 20 21:52:56.313855 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.313763 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-secret-alertmanager-main-tls\") pod \"e7393362-2329-4e6a-b697-0ca4c0108e7a\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " May 20 21:52:56.313855 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.313822 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7393362-2329-4e6a-b697-0ca4c0108e7a-alertmanager-trusted-ca-bundle\") pod \"e7393362-2329-4e6a-b697-0ca4c0108e7a\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " May 20 21:52:56.313855 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.313850 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e7393362-2329-4e6a-b697-0ca4c0108e7a\" (UID: \"e7393362-2329-4e6a-b697-0ca4c0108e7a\") " May 20 21:52:56.314168 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.314134 2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e7393362-2329-4e6a-b697-0ca4c0108e7a-alertmanager-main-db\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:52:56.314168 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.314154 2571 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7393362-2329-4e6a-b697-0ca4c0108e7a-metrics-client-ca\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:52:56.314906 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.314867 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7393362-2329-4e6a-b697-0ca4c0108e7a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e7393362-2329-4e6a-b697-0ca4c0108e7a" (UID: "e7393362-2329-4e6a-b697-0ca4c0108e7a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 21:52:56.316160 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.316131 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7393362-2329-4e6a-b697-0ca4c0108e7a-config-out" (OuterVolumeSpecName: "config-out") pod "e7393362-2329-4e6a-b697-0ca4c0108e7a" (UID: "e7393362-2329-4e6a-b697-0ca4c0108e7a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:52:56.316471 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.316446 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e7393362-2329-4e6a-b697-0ca4c0108e7a" (UID: "e7393362-2329-4e6a-b697-0ca4c0108e7a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 21:52:56.316801 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.316765 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e7393362-2329-4e6a-b697-0ca4c0108e7a" (UID: "e7393362-2329-4e6a-b697-0ca4c0108e7a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 21:52:56.316909 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.316844 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-config-volume" (OuterVolumeSpecName: "config-volume") pod "e7393362-2329-4e6a-b697-0ca4c0108e7a" (UID: "e7393362-2329-4e6a-b697-0ca4c0108e7a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 21:52:56.316994 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.316971 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e7393362-2329-4e6a-b697-0ca4c0108e7a" (UID: "e7393362-2329-4e6a-b697-0ca4c0108e7a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 21:52:56.317060 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.316978 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7393362-2329-4e6a-b697-0ca4c0108e7a-kube-api-access-bht59" (OuterVolumeSpecName: "kube-api-access-bht59") pod "e7393362-2329-4e6a-b697-0ca4c0108e7a" (UID: "e7393362-2329-4e6a-b697-0ca4c0108e7a"). InnerVolumeSpecName "kube-api-access-bht59". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:52:56.317490 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.317466 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7393362-2329-4e6a-b697-0ca4c0108e7a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e7393362-2329-4e6a-b697-0ca4c0108e7a" (UID: "e7393362-2329-4e6a-b697-0ca4c0108e7a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:52:56.318172 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.318152 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e7393362-2329-4e6a-b697-0ca4c0108e7a" (UID: "e7393362-2329-4e6a-b697-0ca4c0108e7a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 21:52:56.321023 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.320999 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e7393362-2329-4e6a-b697-0ca4c0108e7a" (UID: "e7393362-2329-4e6a-b697-0ca4c0108e7a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 21:52:56.327429 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.327408 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-web-config" (OuterVolumeSpecName: "web-config") pod "e7393362-2329-4e6a-b697-0ca4c0108e7a" (UID: "e7393362-2329-4e6a-b697-0ca4c0108e7a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 21:52:56.415535 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.415505 2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-web-config\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:52:56.415535 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.415532 2571 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-cluster-tls-config\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:52:56.415718 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.415541 2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7393362-2329-4e6a-b697-0ca4c0108e7a-tls-assets\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:52:56.415718 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.415551 2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-secret-alertmanager-main-tls\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:52:56.415718 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.415560 2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7393362-2329-4e6a-b697-0ca4c0108e7a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:52:56.415718 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.415570 2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:52:56.415718 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.415580 2571 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-config-volume\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:52:56.415718 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.415588 2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7393362-2329-4e6a-b697-0ca4c0108e7a-config-out\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:52:56.415718 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.415596 2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:52:56.415718 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.415605 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bht59\" (UniqueName: \"kubernetes.io/projected/e7393362-2329-4e6a-b697-0ca4c0108e7a-kube-api-access-bht59\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:52:56.415718 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.415613 2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7393362-2329-4e6a-b697-0ca4c0108e7a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:52:56.500454 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.500425 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nxnd2" event={"ID":"53d29758-e039-4bd4-93ed-9848d16a4bb8","Type":"ContainerStarted","Data":"4ab4cc3db64fa4e7d2dcd3ac55760279da028e249e9971b9803a2c426e0dcc27"} May 20 21:52:56.500593 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.500459 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nxnd2" event={"ID":"53d29758-e039-4bd4-93ed-9848d16a4bb8","Type":"ContainerStarted","Data":"0821c873595a3fc29de9ff80923a7f679a808e0fb926c45bcb51ece87e5d84dc"} May 20 21:52:56.500593 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.500569 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nxnd2" May 20 21:52:56.503098 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.503075 2571 generic.go:358] "Generic (PLEG): container finished" podID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerID="fc6c70e4b55f151c09d1c5c5c15227aaadc73fc8eab4de62a786e7d7588ee4ea" exitCode=0 May 20 21:52:56.503098 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.503096 2571 generic.go:358] "Generic (PLEG): container finished" podID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerID="c37bee8420363cadc6a3c9b6d391fa8124f329bbd9e8ebee696f018113b6862b" exitCode=0 May 20 21:52:56.503226 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.503161 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7393362-2329-4e6a-b697-0ca4c0108e7a","Type":"ContainerDied","Data":"fc6c70e4b55f151c09d1c5c5c15227aaadc73fc8eab4de62a786e7d7588ee4ea"} May 20 21:52:56.503226 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.503178 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.503226 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.503189 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7393362-2329-4e6a-b697-0ca4c0108e7a","Type":"ContainerDied","Data":"c37bee8420363cadc6a3c9b6d391fa8124f329bbd9e8ebee696f018113b6862b"} May 20 21:52:56.503226 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.503202 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7393362-2329-4e6a-b697-0ca4c0108e7a","Type":"ContainerDied","Data":"982fa5bf1cd310e4527e932c20792b4687c232e5d58e886b1652a71aeb859b10"} May 20 21:52:56.503226 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.503219 2571 scope.go:117] "RemoveContainer" containerID="44c2a44fb00908b5ba76b3759e6e1d4d61f53d321e077841c446192ffaf3461f" May 20 21:52:56.504606 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.504582 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rnmkn" event={"ID":"3099afb3-7f12-4cc5-9916-e30f1ce42c8b","Type":"ContainerStarted","Data":"f192e4d6fba7046b61cea38928d044f41c4eaf5be9fe58f67348330dda081e06"} May 20 21:52:56.510781 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.510633 2571 scope.go:117] "RemoveContainer" containerID="fc6c70e4b55f151c09d1c5c5c15227aaadc73fc8eab4de62a786e7d7588ee4ea" May 20 21:52:56.517856 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.517832 2571 scope.go:117] "RemoveContainer" containerID="f0b6a014d35ac53327f8f0ae263031855004e49fefe057f4fc1bb69b3ec821da" May 20 21:52:56.519458 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.519420 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-nxnd2" podStartSLOduration=251.614758196 podStartE2EDuration="4m13.519410533s" podCreationTimestamp="2026-05-20 21:48:43 +0000 UTC" firstStartedPulling="2026-05-20 21:52:53.930428635 +0000 UTC m=+284.860245359" lastFinishedPulling="2026-05-20 21:52:55.835080964 +0000 UTC m=+286.764897696" observedRunningTime="2026-05-20 21:52:56.517185546 +0000 UTC m=+287.447002311" watchObservedRunningTime="2026-05-20 21:52:56.519410533 +0000 UTC m=+287.449227276" May 20 21:52:56.525125 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.525108 2571 scope.go:117] "RemoveContainer" containerID="c37bee8420363cadc6a3c9b6d391fa8124f329bbd9e8ebee696f018113b6862b" May 20 21:52:56.532110 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.532088 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 21:52:56.532797 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.532771 2571 scope.go:117] "RemoveContainer" containerID="6dea6b9c416c0420a7caa0ef786d0ce8f2134305912c6d65a5d8fde2474d9a32" May 20 21:52:56.537010 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.536990 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 21:52:56.542434 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.542411 2571 scope.go:117] "RemoveContainer" containerID="d0b932175d03b641ff6ab71677fced4cca5e6376002d3eb67080b80fa555e330" May 20 21:52:56.548926 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.548887 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rnmkn" podStartSLOduration=251.585647968 podStartE2EDuration="4m13.548876458s" podCreationTimestamp="2026-05-20 21:48:43 +0000 UTC" firstStartedPulling="2026-05-20 21:52:53.874336049 +0000 UTC m=+284.804152775" lastFinishedPulling="2026-05-20 21:52:55.837564541 +0000 UTC m=+286.767381265" observedRunningTime="2026-05-20 21:52:56.548077692 +0000 UTC m=+287.477894435" watchObservedRunningTime="2026-05-20 21:52:56.548876458 +0000 UTC m=+287.478693198" May 20 21:52:56.549847 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.549807 2571 scope.go:117] "RemoveContainer" containerID="d4b29c43d35d8aed7385a2987d12df7674dc6a6678f30fb5e5e52317b613d8b7" May 20 21:52:56.557242 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.557223 2571 scope.go:117] "RemoveContainer" containerID="44c2a44fb00908b5ba76b3759e6e1d4d61f53d321e077841c446192ffaf3461f" May 20 21:52:56.557543 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:52:56.557512 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44c2a44fb00908b5ba76b3759e6e1d4d61f53d321e077841c446192ffaf3461f\": container with ID starting with 44c2a44fb00908b5ba76b3759e6e1d4d61f53d321e077841c446192ffaf3461f not found: ID does not exist" containerID="44c2a44fb00908b5ba76b3759e6e1d4d61f53d321e077841c446192ffaf3461f" May 20 21:52:56.557613 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.557554 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44c2a44fb00908b5ba76b3759e6e1d4d61f53d321e077841c446192ffaf3461f"} err="failed to get container status \"44c2a44fb00908b5ba76b3759e6e1d4d61f53d321e077841c446192ffaf3461f\": rpc error: code = NotFound desc = could not find container \"44c2a44fb00908b5ba76b3759e6e1d4d61f53d321e077841c446192ffaf3461f\": container with ID starting with 44c2a44fb00908b5ba76b3759e6e1d4d61f53d321e077841c446192ffaf3461f not found: ID does not exist" May 20 21:52:56.557613 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.557573 2571 scope.go:117] "RemoveContainer" containerID="fc6c70e4b55f151c09d1c5c5c15227aaadc73fc8eab4de62a786e7d7588ee4ea" May 20 21:52:56.557853 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:52:56.557835 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc6c70e4b55f151c09d1c5c5c15227aaadc73fc8eab4de62a786e7d7588ee4ea\": container with ID starting with fc6c70e4b55f151c09d1c5c5c15227aaadc73fc8eab4de62a786e7d7588ee4ea not found: ID does not exist" containerID="fc6c70e4b55f151c09d1c5c5c15227aaadc73fc8eab4de62a786e7d7588ee4ea" May 20 21:52:56.557907 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.557861 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6c70e4b55f151c09d1c5c5c15227aaadc73fc8eab4de62a786e7d7588ee4ea"} err="failed to get container status \"fc6c70e4b55f151c09d1c5c5c15227aaadc73fc8eab4de62a786e7d7588ee4ea\": rpc error: code = NotFound desc = could not find container \"fc6c70e4b55f151c09d1c5c5c15227aaadc73fc8eab4de62a786e7d7588ee4ea\": container with ID starting with fc6c70e4b55f151c09d1c5c5c15227aaadc73fc8eab4de62a786e7d7588ee4ea not found: ID does not exist" May 20 21:52:56.557907 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.557877 2571 scope.go:117] "RemoveContainer" containerID="f0b6a014d35ac53327f8f0ae263031855004e49fefe057f4fc1bb69b3ec821da" May 20 21:52:56.558111 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:52:56.558093 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0b6a014d35ac53327f8f0ae263031855004e49fefe057f4fc1bb69b3ec821da\": container with ID starting with f0b6a014d35ac53327f8f0ae263031855004e49fefe057f4fc1bb69b3ec821da not found: ID does not exist" containerID="f0b6a014d35ac53327f8f0ae263031855004e49fefe057f4fc1bb69b3ec821da" May 20 21:52:56.558174 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.558115 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0b6a014d35ac53327f8f0ae263031855004e49fefe057f4fc1bb69b3ec821da"} err="failed to get container status \"f0b6a014d35ac53327f8f0ae263031855004e49fefe057f4fc1bb69b3ec821da\": rpc error: code = NotFound desc = could not find container \"f0b6a014d35ac53327f8f0ae263031855004e49fefe057f4fc1bb69b3ec821da\": container with ID starting with f0b6a014d35ac53327f8f0ae263031855004e49fefe057f4fc1bb69b3ec821da not found: ID does not exist" May 20 21:52:56.558174 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.558130 2571 scope.go:117] "RemoveContainer" containerID="c37bee8420363cadc6a3c9b6d391fa8124f329bbd9e8ebee696f018113b6862b" May 20 21:52:56.558353 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:52:56.558338 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c37bee8420363cadc6a3c9b6d391fa8124f329bbd9e8ebee696f018113b6862b\": container with ID starting with c37bee8420363cadc6a3c9b6d391fa8124f329bbd9e8ebee696f018113b6862b not found: ID does not exist" containerID="c37bee8420363cadc6a3c9b6d391fa8124f329bbd9e8ebee696f018113b6862b" May 20 21:52:56.558399 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.558366 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c37bee8420363cadc6a3c9b6d391fa8124f329bbd9e8ebee696f018113b6862b"} err="failed to get container status \"c37bee8420363cadc6a3c9b6d391fa8124f329bbd9e8ebee696f018113b6862b\": rpc error: code = NotFound desc = could not find container \"c37bee8420363cadc6a3c9b6d391fa8124f329bbd9e8ebee696f018113b6862b\": container with ID starting with c37bee8420363cadc6a3c9b6d391fa8124f329bbd9e8ebee696f018113b6862b not found: ID does not exist" May 20 21:52:56.558399 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.558380 2571 scope.go:117] "RemoveContainer" containerID="6dea6b9c416c0420a7caa0ef786d0ce8f2134305912c6d65a5d8fde2474d9a32" May 20 21:52:56.558599 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:52:56.558579 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dea6b9c416c0420a7caa0ef786d0ce8f2134305912c6d65a5d8fde2474d9a32\": container with ID starting with 6dea6b9c416c0420a7caa0ef786d0ce8f2134305912c6d65a5d8fde2474d9a32 not found: ID does not exist" containerID="6dea6b9c416c0420a7caa0ef786d0ce8f2134305912c6d65a5d8fde2474d9a32" May 20 21:52:56.558694 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.558608 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dea6b9c416c0420a7caa0ef786d0ce8f2134305912c6d65a5d8fde2474d9a32"} err="failed to get container status \"6dea6b9c416c0420a7caa0ef786d0ce8f2134305912c6d65a5d8fde2474d9a32\": rpc error: code = NotFound desc = could not find container \"6dea6b9c416c0420a7caa0ef786d0ce8f2134305912c6d65a5d8fde2474d9a32\": container with ID starting with 6dea6b9c416c0420a7caa0ef786d0ce8f2134305912c6d65a5d8fde2474d9a32 not found: ID does not exist" May 20 21:52:56.558694 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.558629 2571 scope.go:117] "RemoveContainer" containerID="d0b932175d03b641ff6ab71677fced4cca5e6376002d3eb67080b80fa555e330" May 20 21:52:56.558857 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:52:56.558833 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0b932175d03b641ff6ab71677fced4cca5e6376002d3eb67080b80fa555e330\": container with ID starting with d0b932175d03b641ff6ab71677fced4cca5e6376002d3eb67080b80fa555e330 not found: ID does not exist" containerID="d0b932175d03b641ff6ab71677fced4cca5e6376002d3eb67080b80fa555e330" May 20 21:52:56.558958 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.558861 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0b932175d03b641ff6ab71677fced4cca5e6376002d3eb67080b80fa555e330"} err="failed to get container status \"d0b932175d03b641ff6ab71677fced4cca5e6376002d3eb67080b80fa555e330\": rpc error: code = NotFound desc = could not find container \"d0b932175d03b641ff6ab71677fced4cca5e6376002d3eb67080b80fa555e330\": container with ID starting with d0b932175d03b641ff6ab71677fced4cca5e6376002d3eb67080b80fa555e330 not found: ID does not exist" May 20 21:52:56.558958 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.558878 2571 scope.go:117] "RemoveContainer" containerID="d4b29c43d35d8aed7385a2987d12df7674dc6a6678f30fb5e5e52317b613d8b7" May 20 21:52:56.559116 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:52:56.559097 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4b29c43d35d8aed7385a2987d12df7674dc6a6678f30fb5e5e52317b613d8b7\": container with ID starting with d4b29c43d35d8aed7385a2987d12df7674dc6a6678f30fb5e5e52317b613d8b7 not found: ID does not exist" containerID="d4b29c43d35d8aed7385a2987d12df7674dc6a6678f30fb5e5e52317b613d8b7" May 20 21:52:56.559172 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.559124 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4b29c43d35d8aed7385a2987d12df7674dc6a6678f30fb5e5e52317b613d8b7"} err="failed to get container status \"d4b29c43d35d8aed7385a2987d12df7674dc6a6678f30fb5e5e52317b613d8b7\": rpc error: code = NotFound desc = could not find container \"d4b29c43d35d8aed7385a2987d12df7674dc6a6678f30fb5e5e52317b613d8b7\": container with ID starting with d4b29c43d35d8aed7385a2987d12df7674dc6a6678f30fb5e5e52317b613d8b7 not found: ID does not exist" May 20 21:52:56.559172 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.559145 2571 scope.go:117] "RemoveContainer" containerID="44c2a44fb00908b5ba76b3759e6e1d4d61f53d321e077841c446192ffaf3461f" May 20 21:52:56.559410 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.559387 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44c2a44fb00908b5ba76b3759e6e1d4d61f53d321e077841c446192ffaf3461f"} err="failed to get container status \"44c2a44fb00908b5ba76b3759e6e1d4d61f53d321e077841c446192ffaf3461f\": rpc error: code = NotFound desc = could not find container \"44c2a44fb00908b5ba76b3759e6e1d4d61f53d321e077841c446192ffaf3461f\": container with ID starting with 44c2a44fb00908b5ba76b3759e6e1d4d61f53d321e077841c446192ffaf3461f not found: ID does not exist" May 20 21:52:56.559496 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.559411 2571 scope.go:117] "RemoveContainer" containerID="fc6c70e4b55f151c09d1c5c5c15227aaadc73fc8eab4de62a786e7d7588ee4ea" May 20 21:52:56.559791 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.559664 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6c70e4b55f151c09d1c5c5c15227aaadc73fc8eab4de62a786e7d7588ee4ea"} err="failed to get container status \"fc6c70e4b55f151c09d1c5c5c15227aaadc73fc8eab4de62a786e7d7588ee4ea\": rpc error: code = NotFound desc = could not find container \"fc6c70e4b55f151c09d1c5c5c15227aaadc73fc8eab4de62a786e7d7588ee4ea\": container with ID starting with fc6c70e4b55f151c09d1c5c5c15227aaadc73fc8eab4de62a786e7d7588ee4ea not found: ID does not exist" May 20 21:52:56.559895 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.559845 2571 scope.go:117] "RemoveContainer" containerID="f0b6a014d35ac53327f8f0ae263031855004e49fefe057f4fc1bb69b3ec821da" May 20 21:52:56.560225 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.560193 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0b6a014d35ac53327f8f0ae263031855004e49fefe057f4fc1bb69b3ec821da"} err="failed to get container status \"f0b6a014d35ac53327f8f0ae263031855004e49fefe057f4fc1bb69b3ec821da\": rpc error: code = NotFound desc = could not find container \"f0b6a014d35ac53327f8f0ae263031855004e49fefe057f4fc1bb69b3ec821da\": container with ID starting with f0b6a014d35ac53327f8f0ae263031855004e49fefe057f4fc1bb69b3ec821da not found: ID does not exist" May 20 21:52:56.560300 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.560236 2571 scope.go:117] "RemoveContainer" containerID="c37bee8420363cadc6a3c9b6d391fa8124f329bbd9e8ebee696f018113b6862b" May 20 21:52:56.560585 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.560557 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c37bee8420363cadc6a3c9b6d391fa8124f329bbd9e8ebee696f018113b6862b"} err="failed to get container status \"c37bee8420363cadc6a3c9b6d391fa8124f329bbd9e8ebee696f018113b6862b\": rpc error: code = NotFound desc = could not find container \"c37bee8420363cadc6a3c9b6d391fa8124f329bbd9e8ebee696f018113b6862b\": container with ID starting with c37bee8420363cadc6a3c9b6d391fa8124f329bbd9e8ebee696f018113b6862b not found: ID does not exist" May 20 21:52:56.560585 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.560586 2571 scope.go:117] "RemoveContainer" containerID="6dea6b9c416c0420a7caa0ef786d0ce8f2134305912c6d65a5d8fde2474d9a32" May 20 21:52:56.561270 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.561243 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dea6b9c416c0420a7caa0ef786d0ce8f2134305912c6d65a5d8fde2474d9a32"} err="failed to get container status \"6dea6b9c416c0420a7caa0ef786d0ce8f2134305912c6d65a5d8fde2474d9a32\": rpc error: code = NotFound desc = could not find container \"6dea6b9c416c0420a7caa0ef786d0ce8f2134305912c6d65a5d8fde2474d9a32\": container with ID starting with 6dea6b9c416c0420a7caa0ef786d0ce8f2134305912c6d65a5d8fde2474d9a32 not found: ID does not exist" May 20 21:52:56.561367 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.561285 2571 scope.go:117] "RemoveContainer" containerID="d0b932175d03b641ff6ab71677fced4cca5e6376002d3eb67080b80fa555e330" May 20 21:52:56.561619 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.561583 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0b932175d03b641ff6ab71677fced4cca5e6376002d3eb67080b80fa555e330"} err="failed to get container status \"d0b932175d03b641ff6ab71677fced4cca5e6376002d3eb67080b80fa555e330\": rpc error: code = NotFound desc = could not find container \"d0b932175d03b641ff6ab71677fced4cca5e6376002d3eb67080b80fa555e330\": container with ID starting with d0b932175d03b641ff6ab71677fced4cca5e6376002d3eb67080b80fa555e330 not found: ID does not exist" May 20 21:52:56.561749 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.561622 2571 scope.go:117] "RemoveContainer" containerID="d4b29c43d35d8aed7385a2987d12df7674dc6a6678f30fb5e5e52317b613d8b7" May 20 21:52:56.561925 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.561902 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4b29c43d35d8aed7385a2987d12df7674dc6a6678f30fb5e5e52317b613d8b7"} err="failed to get container status \"d4b29c43d35d8aed7385a2987d12df7674dc6a6678f30fb5e5e52317b613d8b7\": rpc error: code = NotFound desc = could not find container \"d4b29c43d35d8aed7385a2987d12df7674dc6a6678f30fb5e5e52317b613d8b7\": container with ID starting with d4b29c43d35d8aed7385a2987d12df7674dc6a6678f30fb5e5e52317b613d8b7 not found: ID does not exist" May 20 21:52:56.562082 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.562065 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 21:52:56.562386 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.562372 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="init-config-reloader" May 20 21:52:56.562426 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.562389 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="init-config-reloader" May 20 21:52:56.562426 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.562407 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="kube-rbac-proxy" May 20 21:52:56.562426 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.562412 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="kube-rbac-proxy" May 20 21:52:56.562426 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.562425 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="kube-rbac-proxy-metric" May 20 21:52:56.562561 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.562430 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="kube-rbac-proxy-metric" May 20 21:52:56.562561 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.562441 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="alertmanager" May 20 21:52:56.562561 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.562446 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="alertmanager" May 20 21:52:56.562561 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.562464 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="prom-label-proxy" May 20 21:52:56.562561 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.562471 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="prom-label-proxy" May 20 21:52:56.562561 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.562479 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="config-reloader" May 20 21:52:56.562561 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.562484 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="config-reloader" May 20 21:52:56.562561 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.562490 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="kube-rbac-proxy-web" May 20 21:52:56.562561 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.562495 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="kube-rbac-proxy-web" May 20 21:52:56.562561 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.562549 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="kube-rbac-proxy-metric" May 20 21:52:56.562561 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.562559 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="alertmanager" May 20 21:52:56.562561 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.562565 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="kube-rbac-proxy-web" May 20 21:52:56.563006 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.562571 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="config-reloader" May 20 21:52:56.563006 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.562577 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="kube-rbac-proxy" May 20 21:52:56.563006 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.562583 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" containerName="prom-label-proxy" May 20 21:52:56.566188 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.566168 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.568738 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.568718 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 20 21:52:56.568890 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.568870 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mkvt6\"" May 20 21:52:56.568983 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.568876 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 20 21:52:56.569127 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.569101 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 20 21:52:56.569196 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.569161 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 20 21:52:56.569196 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.569176 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 20 21:52:56.569298 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.569235 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 20 21:52:56.569344 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.569179 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 20 21:52:56.569398 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.569354 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 20 21:52:56.573565 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.573547 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 20 21:52:56.578572 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.578552 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 21:52:56.618177 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.618116 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e46bc857-de87-4466-b497-efe8b44c7905-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.618177 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.618154 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e46bc857-de87-4466-b497-efe8b44c7905-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.618333 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.618231 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e46bc857-de87-4466-b497-efe8b44c7905-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.618333 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.618265 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e46bc857-de87-4466-b497-efe8b44c7905-web-config\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.618333 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.618290 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e46bc857-de87-4466-b497-efe8b44c7905-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.618454 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.618406 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e46bc857-de87-4466-b497-efe8b44c7905-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.618454 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.618431 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e46bc857-de87-4466-b497-efe8b44c7905-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.618618 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.618467 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e46bc857-de87-4466-b497-efe8b44c7905-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.618618 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.618506 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e46bc857-de87-4466-b497-efe8b44c7905-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.618618 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.618578 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e46bc857-de87-4466-b497-efe8b44c7905-config-out\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.618618 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.618609 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e46bc857-de87-4466-b497-efe8b44c7905-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.618826 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.618699 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnf96\" (UniqueName: \"kubernetes.io/projected/e46bc857-de87-4466-b497-efe8b44c7905-kube-api-access-dnf96\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.618826 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.618737 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e46bc857-de87-4466-b497-efe8b44c7905-config-volume\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.720103 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.720075 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e46bc857-de87-4466-b497-efe8b44c7905-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.720216 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.720107 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e46bc857-de87-4466-b497-efe8b44c7905-web-config\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.720216 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.720126 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e46bc857-de87-4466-b497-efe8b44c7905-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.720216 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.720148 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e46bc857-de87-4466-b497-efe8b44c7905-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.720378 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.720263 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e46bc857-de87-4466-b497-efe8b44c7905-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.720378 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.720313 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e46bc857-de87-4466-b497-efe8b44c7905-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.720378 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.720354 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e46bc857-de87-4466-b497-efe8b44c7905-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.720524 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.720388 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e46bc857-de87-4466-b497-efe8b44c7905-config-out\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.720524 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.720422 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e46bc857-de87-4466-b497-efe8b44c7905-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.720524 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.720465 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dnf96\" (UniqueName: \"kubernetes.io/projected/e46bc857-de87-4466-b497-efe8b44c7905-kube-api-access-dnf96\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.720524 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.720493 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e46bc857-de87-4466-b497-efe8b44c7905-config-volume\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.720524 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.720496 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e46bc857-de87-4466-b497-efe8b44c7905-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.720820 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.720553 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e46bc857-de87-4466-b497-efe8b44c7905-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.720820 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.720591 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e46bc857-de87-4466-b497-efe8b44c7905-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.721046 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.721018 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e46bc857-de87-4466-b497-efe8b44c7905-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.721242 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.721217 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e46bc857-de87-4466-b497-efe8b44c7905-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.723483 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.723285 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e46bc857-de87-4466-b497-efe8b44c7905-web-config\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.723483 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.723289 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e46bc857-de87-4466-b497-efe8b44c7905-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.723674 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.723630 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e46bc857-de87-4466-b497-efe8b44c7905-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.723744 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.723728 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e46bc857-de87-4466-b497-efe8b44c7905-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.723797 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.723762 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e46bc857-de87-4466-b497-efe8b44c7905-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.724176 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.724156 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e46bc857-de87-4466-b497-efe8b44c7905-config-volume\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.724240 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.724167 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e46bc857-de87-4466-b497-efe8b44c7905-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.724467 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.724449 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e46bc857-de87-4466-b497-efe8b44c7905-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.724745 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.724730 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e46bc857-de87-4466-b497-efe8b44c7905-config-out\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.729068 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.729048 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnf96\" (UniqueName: \"kubernetes.io/projected/e46bc857-de87-4466-b497-efe8b44c7905-kube-api-access-dnf96\") pod \"alertmanager-main-0\" (UID: \"e46bc857-de87-4466-b497-efe8b44c7905\") " pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:56.878255 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:56.878182 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 20 21:52:57.012794 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:57.012761 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 21:52:57.016328 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:52:57.016302 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode46bc857_de87_4466_b497_efe8b44c7905.slice/crio-25d68f42f3f2a1d406d4ad9bb03c7d7af5625cee682910cc32d8d2a61fdf9a35 WatchSource:0}: Error finding container 25d68f42f3f2a1d406d4ad9bb03c7d7af5625cee682910cc32d8d2a61fdf9a35: Status 404 returned error can't find the container with id 25d68f42f3f2a1d406d4ad9bb03c7d7af5625cee682910cc32d8d2a61fdf9a35 May 20 21:52:57.509134 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:57.509101 2571 generic.go:358] "Generic (PLEG): container finished" podID="e46bc857-de87-4466-b497-efe8b44c7905" containerID="990aa5f18195871764e2207c3b6f63601edd8378199d9e6aeb29cc690de2f265" exitCode=0 May 20 21:52:57.509575 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:57.509194 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e46bc857-de87-4466-b497-efe8b44c7905","Type":"ContainerDied","Data":"990aa5f18195871764e2207c3b6f63601edd8378199d9e6aeb29cc690de2f265"} May 20 21:52:57.509575 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:57.509231 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e46bc857-de87-4466-b497-efe8b44c7905","Type":"ContainerStarted","Data":"25d68f42f3f2a1d406d4ad9bb03c7d7af5625cee682910cc32d8d2a61fdf9a35"} May 20 21:52:57.632159 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:57.632135 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7393362-2329-4e6a-b697-0ca4c0108e7a" path="/var/lib/kubelet/pods/e7393362-2329-4e6a-b697-0ca4c0108e7a/volumes" May 20 21:52:58.516601 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:58.516568 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e46bc857-de87-4466-b497-efe8b44c7905","Type":"ContainerStarted","Data":"0b064f03170cf7392a602a858ac329e5555eab7613af04d456ac9fd37cd18636"} May 20 21:52:58.516601 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:58.516602 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e46bc857-de87-4466-b497-efe8b44c7905","Type":"ContainerStarted","Data":"7ffa861ffe0efd0b4d661c9cc9af5ca3add631c94eeba8e565419d0256aa2c34"} May 20 21:52:58.516601 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:58.516611 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e46bc857-de87-4466-b497-efe8b44c7905","Type":"ContainerStarted","Data":"c11cc78481195114148cb70de7de16c8adfd350a655a8cb8148d0439918529a0"} May 20 21:52:58.517067 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:58.516619 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e46bc857-de87-4466-b497-efe8b44c7905","Type":"ContainerStarted","Data":"44dfb6622b809193118db65ad19925a4cb8e82a0de0920554085e1b1084150c2"} May 20 21:52:58.517067 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:58.516628 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e46bc857-de87-4466-b497-efe8b44c7905","Type":"ContainerStarted","Data":"f0e08fb7eca2ac3e3743213fa5e4228bce0a28c9ee190ef2ec79077210ed5170"} May 20 21:52:58.517067 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:58.516656 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e46bc857-de87-4466-b497-efe8b44c7905","Type":"ContainerStarted","Data":"e5a08d8a0da95af18434a3f783c5dcbea81aa5e752d0bb3470988d23a4f5bb5a"} May 20 21:52:58.549327 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:58.549276 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.549259518 podStartE2EDuration="2.549259518s" podCreationTimestamp="2026-05-20 21:52:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:52:58.547707466 +0000 UTC m=+289.477524210" watchObservedRunningTime="2026-05-20 21:52:58.549259518 +0000 UTC m=+289.479076260" May 20 21:52:59.092658 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:59.092603 2571 patch_prober.go:28] interesting pod/image-registry-f4bddfcf6-8tts7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 20 21:52:59.092814 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:59.092672 2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" podUID="f076b995-22bf-420a-aa9b-a1d15f41c868" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 20 21:52:59.092814 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:59.092713 2571 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:52:59.093180 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:59.093160 2571 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"3edc92615e2d75ef5ad18bf0125e63a33472cb2af5941934c45d933cc650f99a"} pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" containerMessage="Container registry failed liveness probe, will be restarted" May 20 21:52:59.096531 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:59.096504 2571 patch_prober.go:28] interesting pod/image-registry-f4bddfcf6-8tts7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 20 21:52:59.096672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:52:59.096550 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" podUID="f076b995-22bf-420a-aa9b-a1d15f41c868" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 20 21:53:02.529443 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:02.529407 2571 patch_prober.go:28] interesting pod/console-67f88fc974-lwf64 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= May 20 21:53:02.529846 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:02.529462 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-67f88fc974-lwf64" podUID="9cafcd8f-18d3-46af-9538-779f64259e2b" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" May 20 21:53:03.297150 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:03.297111 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:53:03.297341 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:03.297211 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:53:03.298625 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:03.298602 2571 patch_prober.go:28] interesting pod/console-7b94b5c75-v7x7g container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" start-of-body= May 20 21:53:03.298759 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:03.298668 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7b94b5c75-v7x7g" podUID="effc5908-526f-447d-a993-89b4c48554c5" containerName="console" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" May 20 21:53:06.512333 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:06.512306 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nxnd2" May 20 21:53:09.096530 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:09.096488 2571 patch_prober.go:28] interesting pod/image-registry-f4bddfcf6-8tts7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 20 21:53:09.097015 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:09.096555 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" podUID="f076b995-22bf-420a-aa9b-a1d15f41c868" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 20 21:53:09.520783 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:09.520761 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/2.log" May 20 21:53:09.522573 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:09.522553 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/2.log" May 20 21:53:09.530090 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:09.530072 2571 kubelet.go:1628] "Image garbage collection succeeded" May 20 21:53:12.533063 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:12.533030 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67f88fc974-lwf64" May 20 21:53:12.536961 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:12.536935 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67f88fc974-lwf64" May 20 21:53:13.300891 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:13.300862 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:53:13.304731 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:13.304708 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:53:13.365900 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:13.365872 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67f88fc974-lwf64"] May 20 21:53:17.951333 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:17.951274 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5f9cbfb55b-zsqxn" podUID="41943e5d-a07d-4d68-a5f9-c862968445cf" containerName="console" containerID="cri-o://4247bda6ae0de97c9669f68da12d0050aee1153189657187a5a5b7a3b2902867" gracePeriod=15 May 20 21:53:18.198950 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.198927 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f9cbfb55b-zsqxn_41943e5d-a07d-4d68-a5f9-c862968445cf/console/0.log" May 20 21:53:18.199070 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.198996 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9cbfb55b-zsqxn" May 20 21:53:18.300685 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.300598 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41943e5d-a07d-4d68-a5f9-c862968445cf-console-oauth-config\") pod \"41943e5d-a07d-4d68-a5f9-c862968445cf\" (UID: \"41943e5d-a07d-4d68-a5f9-c862968445cf\") " May 20 21:53:18.300685 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.300673 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wxht\" (UniqueName: \"kubernetes.io/projected/41943e5d-a07d-4d68-a5f9-c862968445cf-kube-api-access-8wxht\") pod \"41943e5d-a07d-4d68-a5f9-c862968445cf\" (UID: \"41943e5d-a07d-4d68-a5f9-c862968445cf\") " May 20 21:53:18.300890 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.300699 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41943e5d-a07d-4d68-a5f9-c862968445cf-console-serving-cert\") pod \"41943e5d-a07d-4d68-a5f9-c862968445cf\" (UID: \"41943e5d-a07d-4d68-a5f9-c862968445cf\") " May 20 21:53:18.300890 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.300722 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41943e5d-a07d-4d68-a5f9-c862968445cf-service-ca\") pod \"41943e5d-a07d-4d68-a5f9-c862968445cf\" (UID: \"41943e5d-a07d-4d68-a5f9-c862968445cf\") " May 20 21:53:18.300890 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.300752 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41943e5d-a07d-4d68-a5f9-c862968445cf-console-config\") pod \"41943e5d-a07d-4d68-a5f9-c862968445cf\" (UID: \"41943e5d-a07d-4d68-a5f9-c862968445cf\") " May 20 21:53:18.300890 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.300795 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41943e5d-a07d-4d68-a5f9-c862968445cf-oauth-serving-cert\") pod \"41943e5d-a07d-4d68-a5f9-c862968445cf\" (UID: \"41943e5d-a07d-4d68-a5f9-c862968445cf\") " May 20 21:53:18.301163 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.301136 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41943e5d-a07d-4d68-a5f9-c862968445cf-console-config" (OuterVolumeSpecName: "console-config") pod "41943e5d-a07d-4d68-a5f9-c862968445cf" (UID: "41943e5d-a07d-4d68-a5f9-c862968445cf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 21:53:18.301220 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.301153 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41943e5d-a07d-4d68-a5f9-c862968445cf-service-ca" (OuterVolumeSpecName: "service-ca") pod "41943e5d-a07d-4d68-a5f9-c862968445cf" (UID: "41943e5d-a07d-4d68-a5f9-c862968445cf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 21:53:18.301271 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.301252 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41943e5d-a07d-4d68-a5f9-c862968445cf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "41943e5d-a07d-4d68-a5f9-c862968445cf" (UID: "41943e5d-a07d-4d68-a5f9-c862968445cf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 21:53:18.302966 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.302939 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41943e5d-a07d-4d68-a5f9-c862968445cf-kube-api-access-8wxht" (OuterVolumeSpecName: "kube-api-access-8wxht") pod "41943e5d-a07d-4d68-a5f9-c862968445cf" (UID: "41943e5d-a07d-4d68-a5f9-c862968445cf"). InnerVolumeSpecName "kube-api-access-8wxht". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:53:18.303071 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.302968 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41943e5d-a07d-4d68-a5f9-c862968445cf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "41943e5d-a07d-4d68-a5f9-c862968445cf" (UID: "41943e5d-a07d-4d68-a5f9-c862968445cf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 21:53:18.303071 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.302995 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41943e5d-a07d-4d68-a5f9-c862968445cf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "41943e5d-a07d-4d68-a5f9-c862968445cf" (UID: "41943e5d-a07d-4d68-a5f9-c862968445cf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 21:53:18.401359 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.401332 2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41943e5d-a07d-4d68-a5f9-c862968445cf-console-oauth-config\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:53:18.401359 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.401360 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wxht\" (UniqueName: \"kubernetes.io/projected/41943e5d-a07d-4d68-a5f9-c862968445cf-kube-api-access-8wxht\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:53:18.401546 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.401375 2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41943e5d-a07d-4d68-a5f9-c862968445cf-console-serving-cert\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:53:18.401546 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.401387 2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41943e5d-a07d-4d68-a5f9-c862968445cf-service-ca\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:53:18.401546 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.401426 2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41943e5d-a07d-4d68-a5f9-c862968445cf-console-config\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:53:18.401546 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.401439 2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41943e5d-a07d-4d68-a5f9-c862968445cf-oauth-serving-cert\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:53:18.580542 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.580515 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f9cbfb55b-zsqxn_41943e5d-a07d-4d68-a5f9-c862968445cf/console/0.log" May 20 21:53:18.580716 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.580554 2571 generic.go:358] "Generic (PLEG): container finished" podID="41943e5d-a07d-4d68-a5f9-c862968445cf" containerID="4247bda6ae0de97c9669f68da12d0050aee1153189657187a5a5b7a3b2902867" exitCode=2 May 20 21:53:18.580716 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.580618 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9cbfb55b-zsqxn" May 20 21:53:18.580716 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.580663 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9cbfb55b-zsqxn" event={"ID":"41943e5d-a07d-4d68-a5f9-c862968445cf","Type":"ContainerDied","Data":"4247bda6ae0de97c9669f68da12d0050aee1153189657187a5a5b7a3b2902867"} May 20 21:53:18.580716 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.580709 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9cbfb55b-zsqxn" event={"ID":"41943e5d-a07d-4d68-a5f9-c862968445cf","Type":"ContainerDied","Data":"969505afd8f83f192a5b5fd59bacb9f32dccfcfc33ae3b04fad4f75d2f595e79"} May 20 21:53:18.580963 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.580730 2571 scope.go:117] "RemoveContainer" containerID="4247bda6ae0de97c9669f68da12d0050aee1153189657187a5a5b7a3b2902867" May 20 21:53:18.589363 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.589347 2571 scope.go:117] "RemoveContainer" containerID="4247bda6ae0de97c9669f68da12d0050aee1153189657187a5a5b7a3b2902867" May 20 21:53:18.589603 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:53:18.589585 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4247bda6ae0de97c9669f68da12d0050aee1153189657187a5a5b7a3b2902867\": container with ID starting with 4247bda6ae0de97c9669f68da12d0050aee1153189657187a5a5b7a3b2902867 not found: ID does not exist" containerID="4247bda6ae0de97c9669f68da12d0050aee1153189657187a5a5b7a3b2902867" May 20 21:53:18.589701 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.589622 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4247bda6ae0de97c9669f68da12d0050aee1153189657187a5a5b7a3b2902867"} err="failed to get container status \"4247bda6ae0de97c9669f68da12d0050aee1153189657187a5a5b7a3b2902867\": rpc error: code = NotFound desc = could not find container \"4247bda6ae0de97c9669f68da12d0050aee1153189657187a5a5b7a3b2902867\": container with ID starting with 4247bda6ae0de97c9669f68da12d0050aee1153189657187a5a5b7a3b2902867 not found: ID does not exist" May 20 21:53:18.604920 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.604890 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f9cbfb55b-zsqxn"] May 20 21:53:18.608691 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:18.608673 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f9cbfb55b-zsqxn"] May 20 21:53:19.096918 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:19.096893 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:53:19.631779 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:19.631737 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41943e5d-a07d-4d68-a5f9-c862968445cf" path="/var/lib/kubelet/pods/41943e5d-a07d-4d68-a5f9-c862968445cf/volumes" May 20 21:53:24.112035 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:24.111996 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" podUID="f076b995-22bf-420a-aa9b-a1d15f41c868" containerName="registry" containerID="cri-o://3edc92615e2d75ef5ad18bf0125e63a33472cb2af5941934c45d933cc650f99a" gracePeriod=30 May 20 21:53:25.229130 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:25.229108 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 21:53:25.605657 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:25.605609 2571 generic.go:358] "Generic (PLEG): container finished" podID="f076b995-22bf-420a-aa9b-a1d15f41c868" containerID="3edc92615e2d75ef5ad18bf0125e63a33472cb2af5941934c45d933cc650f99a" exitCode=0 May 20 21:53:25.605824 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:25.605745 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" event={"ID":"f076b995-22bf-420a-aa9b-a1d15f41c868","Type":"ContainerDied","Data":"3edc92615e2d75ef5ad18bf0125e63a33472cb2af5941934c45d933cc650f99a"} May 20 21:53:25.605824 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:25.605770 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" event={"ID":"f076b995-22bf-420a-aa9b-a1d15f41c868","Type":"ContainerStarted","Data":"d28260123fbcbc113bf70863b6c1d7f64a6c6492b4a5fef64c6b9a6e4f62e68b"} May 20 21:53:25.605824 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:25.605785 2571 scope.go:117] "RemoveContainer" containerID="9dbb009764171ced82546d59c66411804a172b8b7cf1881fb4fc6e2cacae26ed" May 20 21:53:25.605981 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:25.605942 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:53:38.583316 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:38.583246 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-67f88fc974-lwf64" podUID="9cafcd8f-18d3-46af-9538-779f64259e2b" containerName="console" containerID="cri-o://2675515ae955ee8cd52898cefc8e49d63edd53835bdbf89c153a1f4d80e60db6" gracePeriod=15 May 20 21:53:38.824294 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:38.824274 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67f88fc974-lwf64_9cafcd8f-18d3-46af-9538-779f64259e2b/console/0.log" May 20 21:53:38.824405 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:38.824340 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f88fc974-lwf64" May 20 21:53:38.962693 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:38.962598 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zfmw\" (UniqueName: \"kubernetes.io/projected/9cafcd8f-18d3-46af-9538-779f64259e2b-kube-api-access-8zfmw\") pod \"9cafcd8f-18d3-46af-9538-779f64259e2b\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " May 20 21:53:38.962693 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:38.962655 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cafcd8f-18d3-46af-9538-779f64259e2b-console-serving-cert\") pod \"9cafcd8f-18d3-46af-9538-779f64259e2b\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " May 20 21:53:38.962693 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:38.962682 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cafcd8f-18d3-46af-9538-779f64259e2b-service-ca\") pod \"9cafcd8f-18d3-46af-9538-779f64259e2b\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " May 20 21:53:38.962949 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:38.962733 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cafcd8f-18d3-46af-9538-779f64259e2b-console-config\") pod \"9cafcd8f-18d3-46af-9538-779f64259e2b\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " May 20 21:53:38.962949 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:38.962755 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cafcd8f-18d3-46af-9538-779f64259e2b-oauth-serving-cert\") pod \"9cafcd8f-18d3-46af-9538-779f64259e2b\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " May 20 21:53:38.962949 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:38.962788 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cafcd8f-18d3-46af-9538-779f64259e2b-trusted-ca-bundle\") pod \"9cafcd8f-18d3-46af-9538-779f64259e2b\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " May 20 21:53:38.962949 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:38.962811 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cafcd8f-18d3-46af-9538-779f64259e2b-console-oauth-config\") pod \"9cafcd8f-18d3-46af-9538-779f64259e2b\" (UID: \"9cafcd8f-18d3-46af-9538-779f64259e2b\") " May 20 21:53:38.963153 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:38.963129 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cafcd8f-18d3-46af-9538-779f64259e2b-console-config" (OuterVolumeSpecName: "console-config") pod "9cafcd8f-18d3-46af-9538-779f64259e2b" (UID: "9cafcd8f-18d3-46af-9538-779f64259e2b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 21:53:38.963243 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:38.963213 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cafcd8f-18d3-46af-9538-779f64259e2b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9cafcd8f-18d3-46af-9538-779f64259e2b" (UID: "9cafcd8f-18d3-46af-9538-779f64259e2b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 21:53:38.963294 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:38.963220 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cafcd8f-18d3-46af-9538-779f64259e2b-service-ca" (OuterVolumeSpecName: "service-ca") pod "9cafcd8f-18d3-46af-9538-779f64259e2b" (UID: "9cafcd8f-18d3-46af-9538-779f64259e2b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 21:53:38.963294 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:38.963266 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cafcd8f-18d3-46af-9538-779f64259e2b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9cafcd8f-18d3-46af-9538-779f64259e2b" (UID: "9cafcd8f-18d3-46af-9538-779f64259e2b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 21:53:38.964829 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:38.964803 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cafcd8f-18d3-46af-9538-779f64259e2b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9cafcd8f-18d3-46af-9538-779f64259e2b" (UID: "9cafcd8f-18d3-46af-9538-779f64259e2b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 21:53:38.964936 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:38.964829 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cafcd8f-18d3-46af-9538-779f64259e2b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9cafcd8f-18d3-46af-9538-779f64259e2b" (UID: "9cafcd8f-18d3-46af-9538-779f64259e2b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 21:53:38.964936 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:38.964895 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cafcd8f-18d3-46af-9538-779f64259e2b-kube-api-access-8zfmw" (OuterVolumeSpecName: "kube-api-access-8zfmw") pod "9cafcd8f-18d3-46af-9538-779f64259e2b" (UID: "9cafcd8f-18d3-46af-9538-779f64259e2b"). InnerVolumeSpecName "kube-api-access-8zfmw". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:53:39.064206 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:39.064176 2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cafcd8f-18d3-46af-9538-779f64259e2b-console-config\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:53:39.064206 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:39.064199 2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cafcd8f-18d3-46af-9538-779f64259e2b-oauth-serving-cert\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:53:39.064206 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:39.064211 2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cafcd8f-18d3-46af-9538-779f64259e2b-trusted-ca-bundle\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:53:39.064477 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:39.064221 2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cafcd8f-18d3-46af-9538-779f64259e2b-console-oauth-config\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:53:39.064477 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:39.064230 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zfmw\" (UniqueName: \"kubernetes.io/projected/9cafcd8f-18d3-46af-9538-779f64259e2b-kube-api-access-8zfmw\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:53:39.064477 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:39.064239 2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cafcd8f-18d3-46af-9538-779f64259e2b-console-serving-cert\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:53:39.064477 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:39.064250 2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cafcd8f-18d3-46af-9538-779f64259e2b-service-ca\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:53:39.652328 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:39.652306 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67f88fc974-lwf64_9cafcd8f-18d3-46af-9538-779f64259e2b/console/0.log" May 20 21:53:39.652632 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:39.652343 2571 generic.go:358] "Generic (PLEG): container finished" podID="9cafcd8f-18d3-46af-9538-779f64259e2b" containerID="2675515ae955ee8cd52898cefc8e49d63edd53835bdbf89c153a1f4d80e60db6" exitCode=2 May 20 21:53:39.652632 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:39.652402 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f88fc974-lwf64" May 20 21:53:39.652632 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:39.652431 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f88fc974-lwf64" event={"ID":"9cafcd8f-18d3-46af-9538-779f64259e2b","Type":"ContainerDied","Data":"2675515ae955ee8cd52898cefc8e49d63edd53835bdbf89c153a1f4d80e60db6"} May 20 21:53:39.652632 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:39.652471 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f88fc974-lwf64" event={"ID":"9cafcd8f-18d3-46af-9538-779f64259e2b","Type":"ContainerDied","Data":"41cc210403dadce3ea53c72a314c927e86ad21da09cdcab50310cce5638e0de7"} May 20 21:53:39.652632 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:39.652489 2571 scope.go:117] "RemoveContainer" containerID="2675515ae955ee8cd52898cefc8e49d63edd53835bdbf89c153a1f4d80e60db6" May 20 21:53:39.660432 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:39.660414 2571 scope.go:117] "RemoveContainer" containerID="2675515ae955ee8cd52898cefc8e49d63edd53835bdbf89c153a1f4d80e60db6" May 20 21:53:39.660734 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:53:39.660711 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2675515ae955ee8cd52898cefc8e49d63edd53835bdbf89c153a1f4d80e60db6\": container with ID starting with 2675515ae955ee8cd52898cefc8e49d63edd53835bdbf89c153a1f4d80e60db6 not found: ID does not exist" containerID="2675515ae955ee8cd52898cefc8e49d63edd53835bdbf89c153a1f4d80e60db6" May 20 21:53:39.660826 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:39.660743 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2675515ae955ee8cd52898cefc8e49d63edd53835bdbf89c153a1f4d80e60db6"} err="failed to get container status \"2675515ae955ee8cd52898cefc8e49d63edd53835bdbf89c153a1f4d80e60db6\": rpc error: code = NotFound desc = could not find container \"2675515ae955ee8cd52898cefc8e49d63edd53835bdbf89c153a1f4d80e60db6\": container with ID starting with 2675515ae955ee8cd52898cefc8e49d63edd53835bdbf89c153a1f4d80e60db6 not found: ID does not exist" May 20 21:53:39.671204 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:39.671174 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67f88fc974-lwf64"] May 20 21:53:39.676255 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:39.676237 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67f88fc974-lwf64"] May 20 21:53:41.630030 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:41.629994 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cafcd8f-18d3-46af-9538-779f64259e2b" path="/var/lib/kubelet/pods/9cafcd8f-18d3-46af-9538-779f64259e2b/volumes" May 20 21:53:46.614505 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:53:46.614477 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f4bddfcf6-8tts7" May 20 21:54:22.384082 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:22.384045 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj"] May 20 21:54:22.384560 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:22.384385 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41943e5d-a07d-4d68-a5f9-c862968445cf" containerName="console" May 20 21:54:22.384560 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:22.384396 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="41943e5d-a07d-4d68-a5f9-c862968445cf" containerName="console" May 20 21:54:22.384560 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:22.384417 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cafcd8f-18d3-46af-9538-779f64259e2b" containerName="console" May 20 21:54:22.384560 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:22.384422 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cafcd8f-18d3-46af-9538-779f64259e2b" containerName="console" May 20 21:54:22.384560 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:22.384470 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="9cafcd8f-18d3-46af-9538-779f64259e2b" containerName="console" May 20 21:54:22.384560 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:22.384479 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="41943e5d-a07d-4d68-a5f9-c862968445cf" containerName="console" May 20 21:54:22.387371 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:22.387353 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj" May 20 21:54:22.389851 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:22.389828 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 20 21:54:22.389968 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:22.389835 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 20 21:54:22.390870 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:22.390856 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lgzrt\"" May 20 21:54:22.396105 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:22.396086 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj"] May 20 21:54:22.499973 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:22.499950 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b539ada2-dbce-41dd-a108-b90bbf6225bc-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj\" (UID: \"b539ada2-dbce-41dd-a108-b90bbf6225bc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj" May 20 21:54:22.500109 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:22.500017 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b539ada2-dbce-41dd-a108-b90bbf6225bc-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj\" (UID: \"b539ada2-dbce-41dd-a108-b90bbf6225bc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj" May 20 21:54:22.500109 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:22.500076 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtz79\" (UniqueName: \"kubernetes.io/projected/b539ada2-dbce-41dd-a108-b90bbf6225bc-kube-api-access-wtz79\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj\" (UID: \"b539ada2-dbce-41dd-a108-b90bbf6225bc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj" May 20 21:54:22.601285 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:22.601247 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtz79\" (UniqueName: \"kubernetes.io/projected/b539ada2-dbce-41dd-a108-b90bbf6225bc-kube-api-access-wtz79\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj\" (UID: \"b539ada2-dbce-41dd-a108-b90bbf6225bc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj" May 20 21:54:22.601427 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:22.601295 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b539ada2-dbce-41dd-a108-b90bbf6225bc-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj\" (UID: \"b539ada2-dbce-41dd-a108-b90bbf6225bc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj" May 20 21:54:22.601427 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:22.601369 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b539ada2-dbce-41dd-a108-b90bbf6225bc-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj\" (UID: \"b539ada2-dbce-41dd-a108-b90bbf6225bc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj" May 20 21:54:22.601760 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:22.601739 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b539ada2-dbce-41dd-a108-b90bbf6225bc-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj\" (UID: \"b539ada2-dbce-41dd-a108-b90bbf6225bc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj" May 20 21:54:22.601847 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:22.601775 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b539ada2-dbce-41dd-a108-b90bbf6225bc-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj\" (UID: \"b539ada2-dbce-41dd-a108-b90bbf6225bc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj" May 20 21:54:22.609882 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:22.609858 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtz79\" (UniqueName: \"kubernetes.io/projected/b539ada2-dbce-41dd-a108-b90bbf6225bc-kube-api-access-wtz79\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj\" (UID: \"b539ada2-dbce-41dd-a108-b90bbf6225bc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj" May 20 21:54:22.696477 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:22.696412 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj" May 20 21:54:22.819950 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:22.819925 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj"] May 20 21:54:22.822365 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:54:22.822338 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb539ada2_dbce_41dd_a108_b90bbf6225bc.slice/crio-f75349a7a57ea980460d5326058aa1fe0eddf883eb42dc991f7e09d879d79c1f WatchSource:0}: Error finding container f75349a7a57ea980460d5326058aa1fe0eddf883eb42dc991f7e09d879d79c1f: Status 404 returned error can't find the container with id f75349a7a57ea980460d5326058aa1fe0eddf883eb42dc991f7e09d879d79c1f May 20 21:54:23.785925 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:23.785878 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj" event={"ID":"b539ada2-dbce-41dd-a108-b90bbf6225bc","Type":"ContainerStarted","Data":"f75349a7a57ea980460d5326058aa1fe0eddf883eb42dc991f7e09d879d79c1f"} May 20 21:54:27.802013 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:27.801935 2571 generic.go:358] "Generic (PLEG): container finished" podID="b539ada2-dbce-41dd-a108-b90bbf6225bc" containerID="a5b161edc5117245e0d471c7df680c0784b5343b67885319a02980aaf8974db0" exitCode=0 May 20 21:54:27.802359 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:27.802022 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj" event={"ID":"b539ada2-dbce-41dd-a108-b90bbf6225bc","Type":"ContainerDied","Data":"a5b161edc5117245e0d471c7df680c0784b5343b67885319a02980aaf8974db0"} May 20 21:54:29.811786 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:29.811751 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj" event={"ID":"b539ada2-dbce-41dd-a108-b90bbf6225bc","Type":"ContainerStarted","Data":"2b5792ea37e72515e2e11027fd76135a0e53f7e1078f59278591a3c634d5527b"} May 20 21:54:30.821289 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:30.821254 2571 generic.go:358] "Generic (PLEG): container finished" podID="b539ada2-dbce-41dd-a108-b90bbf6225bc" containerID="2b5792ea37e72515e2e11027fd76135a0e53f7e1078f59278591a3c634d5527b" exitCode=0 May 20 21:54:30.821652 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:30.821315 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj" event={"ID":"b539ada2-dbce-41dd-a108-b90bbf6225bc","Type":"ContainerDied","Data":"2b5792ea37e72515e2e11027fd76135a0e53f7e1078f59278591a3c634d5527b"} May 20 21:54:36.846512 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:36.846436 2571 generic.go:358] "Generic (PLEG): container finished" podID="b539ada2-dbce-41dd-a108-b90bbf6225bc" containerID="ee5aac1e6b70a239406b136f81fa07500c866aaba064c5d969543643fb751035" exitCode=0 May 20 21:54:36.846851 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:36.846525 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj" event={"ID":"b539ada2-dbce-41dd-a108-b90bbf6225bc","Type":"ContainerDied","Data":"ee5aac1e6b70a239406b136f81fa07500c866aaba064c5d969543643fb751035"} May 20 21:54:37.976412 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:37.976390 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj" May 20 21:54:38.036360 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:38.036334 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b539ada2-dbce-41dd-a108-b90bbf6225bc-util\") pod \"b539ada2-dbce-41dd-a108-b90bbf6225bc\" (UID: \"b539ada2-dbce-41dd-a108-b90bbf6225bc\") " May 20 21:54:38.036472 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:38.036453 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b539ada2-dbce-41dd-a108-b90bbf6225bc-bundle\") pod \"b539ada2-dbce-41dd-a108-b90bbf6225bc\" (UID: \"b539ada2-dbce-41dd-a108-b90bbf6225bc\") " May 20 21:54:38.036525 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:38.036491 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtz79\" (UniqueName: \"kubernetes.io/projected/b539ada2-dbce-41dd-a108-b90bbf6225bc-kube-api-access-wtz79\") pod \"b539ada2-dbce-41dd-a108-b90bbf6225bc\" (UID: \"b539ada2-dbce-41dd-a108-b90bbf6225bc\") " May 20 21:54:38.037189 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:38.037168 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b539ada2-dbce-41dd-a108-b90bbf6225bc-bundle" (OuterVolumeSpecName: "bundle") pod "b539ada2-dbce-41dd-a108-b90bbf6225bc" (UID: "b539ada2-dbce-41dd-a108-b90bbf6225bc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:54:38.038605 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:38.038581 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b539ada2-dbce-41dd-a108-b90bbf6225bc-kube-api-access-wtz79" (OuterVolumeSpecName: "kube-api-access-wtz79") pod "b539ada2-dbce-41dd-a108-b90bbf6225bc" (UID: "b539ada2-dbce-41dd-a108-b90bbf6225bc"). InnerVolumeSpecName "kube-api-access-wtz79". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:54:38.040716 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:38.040698 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b539ada2-dbce-41dd-a108-b90bbf6225bc-util" (OuterVolumeSpecName: "util") pod "b539ada2-dbce-41dd-a108-b90bbf6225bc" (UID: "b539ada2-dbce-41dd-a108-b90bbf6225bc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:54:38.137585 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:38.137509 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtz79\" (UniqueName: \"kubernetes.io/projected/b539ada2-dbce-41dd-a108-b90bbf6225bc-kube-api-access-wtz79\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:54:38.137585 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:38.137536 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b539ada2-dbce-41dd-a108-b90bbf6225bc-util\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:54:38.137585 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:38.137547 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b539ada2-dbce-41dd-a108-b90bbf6225bc-bundle\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:54:38.853415 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:38.853384 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj" event={"ID":"b539ada2-dbce-41dd-a108-b90bbf6225bc","Type":"ContainerDied","Data":"f75349a7a57ea980460d5326058aa1fe0eddf883eb42dc991f7e09d879d79c1f"} May 20 21:54:38.853415 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:38.853415 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f75349a7a57ea980460d5326058aa1fe0eddf883eb42dc991f7e09d879d79c1f" May 20 21:54:38.853685 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:38.853443 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddbsqj" May 20 21:54:45.541595 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:45.541563 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hglsf"] May 20 21:54:45.541983 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:45.541885 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b539ada2-dbce-41dd-a108-b90bbf6225bc" containerName="util" May 20 21:54:45.541983 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:45.541896 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b539ada2-dbce-41dd-a108-b90bbf6225bc" containerName="util" May 20 21:54:45.541983 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:45.541903 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b539ada2-dbce-41dd-a108-b90bbf6225bc" containerName="extract" May 20 21:54:45.541983 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:45.541909 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b539ada2-dbce-41dd-a108-b90bbf6225bc" containerName="extract" May 20 21:54:45.541983 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:45.541921 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b539ada2-dbce-41dd-a108-b90bbf6225bc" containerName="pull" May 20 21:54:45.541983 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:45.541927 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b539ada2-dbce-41dd-a108-b90bbf6225bc" containerName="pull" May 20 21:54:45.541983 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:45.541981 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="b539ada2-dbce-41dd-a108-b90bbf6225bc" containerName="extract" May 20 21:54:45.592041 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:45.592014 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hglsf"] May 20 21:54:45.592192 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:45.592132 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hglsf" May 20 21:54:45.594836 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:45.594812 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vnbm4\"" May 20 21:54:45.594954 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:45.594851 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 20 21:54:45.595081 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:45.595067 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 20 21:54:45.688047 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:45.688022 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3aca2cb2-0e3c-4233-a5c0-1b0f3d775335-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-hglsf\" (UID: \"3aca2cb2-0e3c-4233-a5c0-1b0f3d775335\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hglsf" May 20 21:54:45.688182 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:45.688091 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmfxp\" (UniqueName: \"kubernetes.io/projected/3aca2cb2-0e3c-4233-a5c0-1b0f3d775335-kube-api-access-gmfxp\") pod \"cert-manager-operator-controller-manager-54b9655956-hglsf\" (UID: \"3aca2cb2-0e3c-4233-a5c0-1b0f3d775335\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hglsf" May 20 21:54:45.788619 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:45.788594 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmfxp\" (UniqueName: \"kubernetes.io/projected/3aca2cb2-0e3c-4233-a5c0-1b0f3d775335-kube-api-access-gmfxp\") pod \"cert-manager-operator-controller-manager-54b9655956-hglsf\" (UID: \"3aca2cb2-0e3c-4233-a5c0-1b0f3d775335\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hglsf" May 20 21:54:45.788738 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:45.788629 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3aca2cb2-0e3c-4233-a5c0-1b0f3d775335-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-hglsf\" (UID: \"3aca2cb2-0e3c-4233-a5c0-1b0f3d775335\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hglsf" May 20 21:54:45.788986 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:45.788971 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3aca2cb2-0e3c-4233-a5c0-1b0f3d775335-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-hglsf\" (UID: \"3aca2cb2-0e3c-4233-a5c0-1b0f3d775335\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hglsf" May 20 21:54:45.799260 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:45.799216 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmfxp\" (UniqueName: \"kubernetes.io/projected/3aca2cb2-0e3c-4233-a5c0-1b0f3d775335-kube-api-access-gmfxp\") pod \"cert-manager-operator-controller-manager-54b9655956-hglsf\" (UID: \"3aca2cb2-0e3c-4233-a5c0-1b0f3d775335\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hglsf" May 20 21:54:45.901226 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:45.901198 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hglsf" May 20 21:54:46.029816 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:46.029787 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hglsf"] May 20 21:54:46.031726 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:54:46.031700 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aca2cb2_0e3c_4233_a5c0_1b0f3d775335.slice/crio-0c08b867098a23016deca5d93ba4d4c4ba0cb79a8b2ee4e15c1f092bd44aaa9b WatchSource:0}: Error finding container 0c08b867098a23016deca5d93ba4d4c4ba0cb79a8b2ee4e15c1f092bd44aaa9b: Status 404 returned error can't find the container with id 0c08b867098a23016deca5d93ba4d4c4ba0cb79a8b2ee4e15c1f092bd44aaa9b May 20 21:54:46.877678 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:46.877625 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hglsf" event={"ID":"3aca2cb2-0e3c-4233-a5c0-1b0f3d775335","Type":"ContainerStarted","Data":"0c08b867098a23016deca5d93ba4d4c4ba0cb79a8b2ee4e15c1f092bd44aaa9b"} May 20 21:54:48.886575 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:48.886542 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hglsf" event={"ID":"3aca2cb2-0e3c-4233-a5c0-1b0f3d775335","Type":"ContainerStarted","Data":"b25734c205e9ee1968edf10abefdc0503d84846c85f07a41595352537f09c21e"} May 20 21:54:48.915798 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:48.915748 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-hglsf" podStartSLOduration=1.634967871 podStartE2EDuration="3.915733752s" podCreationTimestamp="2026-05-20 21:54:45 +0000 UTC" firstStartedPulling="2026-05-20 21:54:46.034213381 +0000 UTC m=+396.964030103" lastFinishedPulling="2026-05-20 21:54:48.314979255 +0000 UTC m=+399.244795984" observedRunningTime="2026-05-20 21:54:48.912668872 +0000 UTC m=+399.842485616" watchObservedRunningTime="2026-05-20 21:54:48.915733752 +0000 UTC m=+399.845550495" May 20 21:54:50.207349 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.207306 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl"] May 20 21:54:50.210106 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.210084 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl" May 20 21:54:50.212867 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.212846 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 20 21:54:50.214006 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.213982 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lgzrt\"" May 20 21:54:50.214114 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.214012 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 20 21:54:50.220718 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.220697 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl"] May 20 21:54:50.229406 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.229385 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7097df8a-7133-4ded-81ce-f0e9c0ba5db6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl\" (UID: \"7097df8a-7133-4ded-81ce-f0e9c0ba5db6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl" May 20 21:54:50.229498 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.229437 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwh42\" (UniqueName: \"kubernetes.io/projected/7097df8a-7133-4ded-81ce-f0e9c0ba5db6-kube-api-access-jwh42\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl\" (UID: \"7097df8a-7133-4ded-81ce-f0e9c0ba5db6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl" May 20 21:54:50.229582 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.229561 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7097df8a-7133-4ded-81ce-f0e9c0ba5db6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl\" (UID: \"7097df8a-7133-4ded-81ce-f0e9c0ba5db6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl" May 20 21:54:50.330890 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.330858 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7097df8a-7133-4ded-81ce-f0e9c0ba5db6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl\" (UID: \"7097df8a-7133-4ded-81ce-f0e9c0ba5db6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl" May 20 21:54:50.331087 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.330920 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jwh42\" (UniqueName: \"kubernetes.io/projected/7097df8a-7133-4ded-81ce-f0e9c0ba5db6-kube-api-access-jwh42\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl\" (UID: \"7097df8a-7133-4ded-81ce-f0e9c0ba5db6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl" May 20 21:54:50.331087 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.330981 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7097df8a-7133-4ded-81ce-f0e9c0ba5db6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl\" (UID: \"7097df8a-7133-4ded-81ce-f0e9c0ba5db6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl" May 20 21:54:50.331325 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.331293 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7097df8a-7133-4ded-81ce-f0e9c0ba5db6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl\" (UID: \"7097df8a-7133-4ded-81ce-f0e9c0ba5db6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl" May 20 21:54:50.331325 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.331309 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7097df8a-7133-4ded-81ce-f0e9c0ba5db6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl\" (UID: \"7097df8a-7133-4ded-81ce-f0e9c0ba5db6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl" May 20 21:54:50.339580 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.339556 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwh42\" (UniqueName: \"kubernetes.io/projected/7097df8a-7133-4ded-81ce-f0e9c0ba5db6-kube-api-access-jwh42\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl\" (UID: \"7097df8a-7133-4ded-81ce-f0e9c0ba5db6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl" May 20 21:54:50.519766 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.519687 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl" May 20 21:54:50.633223 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.633187 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-4dvv7"] May 20 21:54:50.636495 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.636472 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-4dvv7" May 20 21:54:50.639211 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.639186 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 20 21:54:50.639336 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.639224 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 20 21:54:50.649994 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.649968 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-4dvv7"] May 20 21:54:50.663998 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.663981 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl"] May 20 21:54:50.666117 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:54:50.666092 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7097df8a_7133_4ded_81ce_f0e9c0ba5db6.slice/crio-5521c965f01ab36a46d20c7b070822360d0203fec1413eb5c6e491a1d0e4a043 WatchSource:0}: Error finding container 5521c965f01ab36a46d20c7b070822360d0203fec1413eb5c6e491a1d0e4a043: Status 404 returned error can't find the container with id 5521c965f01ab36a46d20c7b070822360d0203fec1413eb5c6e491a1d0e4a043 May 20 21:54:50.734144 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.734105 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ebc3c79c-4a38-423b-8cf9-42726de52bc3-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-4dvv7\" (UID: \"ebc3c79c-4a38-423b-8cf9-42726de52bc3\") " pod="cert-manager/cert-manager-webhook-587ccfb98-4dvv7" May 20 21:54:50.734275 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.734208 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvnqh\" (UniqueName: \"kubernetes.io/projected/ebc3c79c-4a38-423b-8cf9-42726de52bc3-kube-api-access-gvnqh\") pod \"cert-manager-webhook-587ccfb98-4dvv7\" (UID: \"ebc3c79c-4a38-423b-8cf9-42726de52bc3\") " pod="cert-manager/cert-manager-webhook-587ccfb98-4dvv7" May 20 21:54:50.834866 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.834835 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ebc3c79c-4a38-423b-8cf9-42726de52bc3-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-4dvv7\" (UID: \"ebc3c79c-4a38-423b-8cf9-42726de52bc3\") " pod="cert-manager/cert-manager-webhook-587ccfb98-4dvv7" May 20 21:54:50.834993 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.834896 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gvnqh\" (UniqueName: \"kubernetes.io/projected/ebc3c79c-4a38-423b-8cf9-42726de52bc3-kube-api-access-gvnqh\") pod \"cert-manager-webhook-587ccfb98-4dvv7\" (UID: \"ebc3c79c-4a38-423b-8cf9-42726de52bc3\") " pod="cert-manager/cert-manager-webhook-587ccfb98-4dvv7" May 20 21:54:50.844037 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.844001 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ebc3c79c-4a38-423b-8cf9-42726de52bc3-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-4dvv7\" (UID: \"ebc3c79c-4a38-423b-8cf9-42726de52bc3\") " pod="cert-manager/cert-manager-webhook-587ccfb98-4dvv7" May 20 21:54:50.844138 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.844126 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvnqh\" (UniqueName: \"kubernetes.io/projected/ebc3c79c-4a38-423b-8cf9-42726de52bc3-kube-api-access-gvnqh\") pod \"cert-manager-webhook-587ccfb98-4dvv7\" (UID: \"ebc3c79c-4a38-423b-8cf9-42726de52bc3\") " pod="cert-manager/cert-manager-webhook-587ccfb98-4dvv7" May 20 21:54:50.894019 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.893992 2571 generic.go:358] "Generic (PLEG): container finished" podID="7097df8a-7133-4ded-81ce-f0e9c0ba5db6" containerID="14f7f52440a28431e215fe32df8347c8e59f2a0b45a1425089ad813008f1a19e" exitCode=0 May 20 21:54:50.894136 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.894081 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl" event={"ID":"7097df8a-7133-4ded-81ce-f0e9c0ba5db6","Type":"ContainerDied","Data":"14f7f52440a28431e215fe32df8347c8e59f2a0b45a1425089ad813008f1a19e"} May 20 21:54:50.894136 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.894120 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl" event={"ID":"7097df8a-7133-4ded-81ce-f0e9c0ba5db6","Type":"ContainerStarted","Data":"5521c965f01ab36a46d20c7b070822360d0203fec1413eb5c6e491a1d0e4a043"} May 20 21:54:50.955345 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:50.955319 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-4dvv7" May 20 21:54:51.080568 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:51.080542 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-4dvv7"] May 20 21:54:51.082473 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:54:51.082447 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podebc3c79c_4a38_423b_8cf9_42726de52bc3.slice/crio-b8f429a01c8717e3bbbc82b8d8e8d947c0507105516f3624d8c8f7cd66d27e8c WatchSource:0}: Error finding container b8f429a01c8717e3bbbc82b8d8e8d947c0507105516f3624d8c8f7cd66d27e8c: Status 404 returned error can't find the container with id b8f429a01c8717e3bbbc82b8d8e8d947c0507105516f3624d8c8f7cd66d27e8c May 20 21:54:51.898686 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:51.898654 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-4dvv7" event={"ID":"ebc3c79c-4a38-423b-8cf9-42726de52bc3","Type":"ContainerStarted","Data":"b8f429a01c8717e3bbbc82b8d8e8d947c0507105516f3624d8c8f7cd66d27e8c"} May 20 21:54:54.918992 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:54.918964 2571 generic.go:358] "Generic (PLEG): container finished" podID="7097df8a-7133-4ded-81ce-f0e9c0ba5db6" containerID="9ccf1b62e1ed38998dda137706a181e6f7c32d43ad163557b4e7abc2e3b2c6e7" exitCode=0 May 20 21:54:54.919392 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:54.919038 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl" event={"ID":"7097df8a-7133-4ded-81ce-f0e9c0ba5db6","Type":"ContainerDied","Data":"9ccf1b62e1ed38998dda137706a181e6f7c32d43ad163557b4e7abc2e3b2c6e7"} May 20 21:54:54.920383 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:54.920346 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-4dvv7" event={"ID":"ebc3c79c-4a38-423b-8cf9-42726de52bc3","Type":"ContainerStarted","Data":"7fa3778f1f12198a1554ec936e4ae0ac508a4a842c240821bbb3af5fbcd87d9f"} May 20 21:54:54.920505 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:54.920475 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-4dvv7" May 20 21:54:54.963740 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:54.963690 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-4dvv7" podStartSLOduration=1.573493006 podStartE2EDuration="4.963673107s" podCreationTimestamp="2026-05-20 21:54:50 +0000 UTC" firstStartedPulling="2026-05-20 21:54:51.084112559 +0000 UTC m=+402.013929283" lastFinishedPulling="2026-05-20 21:54:54.474292659 +0000 UTC m=+405.404109384" observedRunningTime="2026-05-20 21:54:54.962784306 +0000 UTC m=+405.892601062" watchObservedRunningTime="2026-05-20 21:54:54.963673107 +0000 UTC m=+405.893489851" May 20 21:54:55.928374 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:55.928341 2571 generic.go:358] "Generic (PLEG): container finished" podID="7097df8a-7133-4ded-81ce-f0e9c0ba5db6" containerID="d89a89b412872ace2e515cf1dbdb8091d82019b537cb9e3c1d96372481af8b9c" exitCode=0 May 20 21:54:55.928791 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:55.928426 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl" event={"ID":"7097df8a-7133-4ded-81ce-f0e9c0ba5db6","Type":"ContainerDied","Data":"d89a89b412872ace2e515cf1dbdb8091d82019b537cb9e3c1d96372481af8b9c"} May 20 21:54:57.091000 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:57.090976 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl" May 20 21:54:57.189272 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:57.189206 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwh42\" (UniqueName: \"kubernetes.io/projected/7097df8a-7133-4ded-81ce-f0e9c0ba5db6-kube-api-access-jwh42\") pod \"7097df8a-7133-4ded-81ce-f0e9c0ba5db6\" (UID: \"7097df8a-7133-4ded-81ce-f0e9c0ba5db6\") " May 20 21:54:57.189384 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:57.189300 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7097df8a-7133-4ded-81ce-f0e9c0ba5db6-util\") pod \"7097df8a-7133-4ded-81ce-f0e9c0ba5db6\" (UID: \"7097df8a-7133-4ded-81ce-f0e9c0ba5db6\") " May 20 21:54:57.189384 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:57.189346 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7097df8a-7133-4ded-81ce-f0e9c0ba5db6-bundle\") pod \"7097df8a-7133-4ded-81ce-f0e9c0ba5db6\" (UID: \"7097df8a-7133-4ded-81ce-f0e9c0ba5db6\") " May 20 21:54:57.189761 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:57.189730 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7097df8a-7133-4ded-81ce-f0e9c0ba5db6-bundle" (OuterVolumeSpecName: "bundle") pod "7097df8a-7133-4ded-81ce-f0e9c0ba5db6" (UID: "7097df8a-7133-4ded-81ce-f0e9c0ba5db6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:54:57.191263 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:57.191241 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7097df8a-7133-4ded-81ce-f0e9c0ba5db6-kube-api-access-jwh42" (OuterVolumeSpecName: "kube-api-access-jwh42") pod "7097df8a-7133-4ded-81ce-f0e9c0ba5db6" (UID: "7097df8a-7133-4ded-81ce-f0e9c0ba5db6"). InnerVolumeSpecName "kube-api-access-jwh42". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:54:57.195374 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:57.195345 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7097df8a-7133-4ded-81ce-f0e9c0ba5db6-util" (OuterVolumeSpecName: "util") pod "7097df8a-7133-4ded-81ce-f0e9c0ba5db6" (UID: "7097df8a-7133-4ded-81ce-f0e9c0ba5db6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:54:57.290589 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:57.290564 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwh42\" (UniqueName: \"kubernetes.io/projected/7097df8a-7133-4ded-81ce-f0e9c0ba5db6-kube-api-access-jwh42\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:54:57.290589 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:57.290586 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7097df8a-7133-4ded-81ce-f0e9c0ba5db6-util\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:54:57.290755 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:57.290596 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7097df8a-7133-4ded-81ce-f0e9c0ba5db6-bundle\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:54:57.936791 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:57.936697 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl" event={"ID":"7097df8a-7133-4ded-81ce-f0e9c0ba5db6","Type":"ContainerDied","Data":"5521c965f01ab36a46d20c7b070822360d0203fec1413eb5c6e491a1d0e4a043"} May 20 21:54:57.936791 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:57.936737 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5521c965f01ab36a46d20c7b070822360d0203fec1413eb5c6e491a1d0e4a043" May 20 21:54:57.936791 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:54:57.936785 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7mmtl" May 20 21:55:00.930466 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:00.930433 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-4dvv7" May 20 21:55:15.381330 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.381293 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv"] May 20 21:55:15.381748 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.381697 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7097df8a-7133-4ded-81ce-f0e9c0ba5db6" containerName="extract" May 20 21:55:15.381748 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.381711 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7097df8a-7133-4ded-81ce-f0e9c0ba5db6" containerName="extract" May 20 21:55:15.381748 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.381729 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7097df8a-7133-4ded-81ce-f0e9c0ba5db6" containerName="pull" May 20 21:55:15.381748 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.381735 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7097df8a-7133-4ded-81ce-f0e9c0ba5db6" containerName="pull" May 20 21:55:15.381748 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.381744 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7097df8a-7133-4ded-81ce-f0e9c0ba5db6" containerName="util" May 20 21:55:15.381748 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.381751 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7097df8a-7133-4ded-81ce-f0e9c0ba5db6" containerName="util" May 20 21:55:15.381991 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.381840 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="7097df8a-7133-4ded-81ce-f0e9c0ba5db6" containerName="extract" May 20 21:55:15.383930 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.383914 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv" May 20 21:55:15.386534 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.386511 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 20 21:55:15.386534 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.386525 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 20 21:55:15.387613 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.387597 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lgzrt\"" May 20 21:55:15.392286 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.392262 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv"] May 20 21:55:15.542945 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.542911 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhp2z\" (UniqueName: \"kubernetes.io/projected/1beac6ad-0438-4fcd-91ed-2cb753de4a82-kube-api-access-jhp2z\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv\" (UID: \"1beac6ad-0438-4fcd-91ed-2cb753de4a82\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv" May 20 21:55:15.543124 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.542955 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1beac6ad-0438-4fcd-91ed-2cb753de4a82-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv\" (UID: \"1beac6ad-0438-4fcd-91ed-2cb753de4a82\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv" May 20 21:55:15.543124 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.543047 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1beac6ad-0438-4fcd-91ed-2cb753de4a82-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv\" (UID: \"1beac6ad-0438-4fcd-91ed-2cb753de4a82\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv" May 20 21:55:15.643501 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.643427 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jhp2z\" (UniqueName: \"kubernetes.io/projected/1beac6ad-0438-4fcd-91ed-2cb753de4a82-kube-api-access-jhp2z\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv\" (UID: \"1beac6ad-0438-4fcd-91ed-2cb753de4a82\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv" May 20 21:55:15.643501 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.643495 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1beac6ad-0438-4fcd-91ed-2cb753de4a82-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv\" (UID: \"1beac6ad-0438-4fcd-91ed-2cb753de4a82\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv" May 20 21:55:15.643704 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.643553 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1beac6ad-0438-4fcd-91ed-2cb753de4a82-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv\" (UID: \"1beac6ad-0438-4fcd-91ed-2cb753de4a82\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv" May 20 21:55:15.643978 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.643958 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1beac6ad-0438-4fcd-91ed-2cb753de4a82-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv\" (UID: \"1beac6ad-0438-4fcd-91ed-2cb753de4a82\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv" May 20 21:55:15.644017 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.643973 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1beac6ad-0438-4fcd-91ed-2cb753de4a82-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv\" (UID: \"1beac6ad-0438-4fcd-91ed-2cb753de4a82\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv" May 20 21:55:15.651108 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.651088 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhp2z\" (UniqueName: \"kubernetes.io/projected/1beac6ad-0438-4fcd-91ed-2cb753de4a82-kube-api-access-jhp2z\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv\" (UID: \"1beac6ad-0438-4fcd-91ed-2cb753de4a82\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv" May 20 21:55:15.693062 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.693033 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv" May 20 21:55:15.820963 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.820936 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv"] May 20 21:55:15.823164 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:55:15.823132 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1beac6ad_0438_4fcd_91ed_2cb753de4a82.slice/crio-f85bfc5a691eecaf2cfbcf4c0f374661cf30fb9d92cc6c469ac6b148b3106b3d WatchSource:0}: Error finding container f85bfc5a691eecaf2cfbcf4c0f374661cf30fb9d92cc6c469ac6b148b3106b3d: Status 404 returned error can't find the container with id f85bfc5a691eecaf2cfbcf4c0f374661cf30fb9d92cc6c469ac6b148b3106b3d May 20 21:55:15.997763 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.997727 2571 generic.go:358] "Generic (PLEG): container finished" podID="1beac6ad-0438-4fcd-91ed-2cb753de4a82" containerID="15edd70222b5e21f8e2410fd03703d149ad85752dfcee83fea7216df941ba775" exitCode=0 May 20 21:55:15.997923 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.997820 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv" event={"ID":"1beac6ad-0438-4fcd-91ed-2cb753de4a82","Type":"ContainerDied","Data":"15edd70222b5e21f8e2410fd03703d149ad85752dfcee83fea7216df941ba775"} May 20 21:55:15.997923 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:15.997865 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv" event={"ID":"1beac6ad-0438-4fcd-91ed-2cb753de4a82","Type":"ContainerStarted","Data":"f85bfc5a691eecaf2cfbcf4c0f374661cf30fb9d92cc6c469ac6b148b3106b3d"} May 20 21:55:17.003050 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:17.003017 2571 generic.go:358] "Generic (PLEG): container finished" podID="1beac6ad-0438-4fcd-91ed-2cb753de4a82" containerID="54b4fe1225a6ce1be335220fcf0add48311d5933f6b207667ce0c2577304d8ae" exitCode=0 May 20 21:55:17.003424 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:17.003082 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv" event={"ID":"1beac6ad-0438-4fcd-91ed-2cb753de4a82","Type":"ContainerDied","Data":"54b4fe1225a6ce1be335220fcf0add48311d5933f6b207667ce0c2577304d8ae"} May 20 21:55:18.008821 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:18.008784 2571 generic.go:358] "Generic (PLEG): container finished" podID="1beac6ad-0438-4fcd-91ed-2cb753de4a82" containerID="c4796144bc6fc0ac2e28d4141db32c24b70721f0607b5e54ca1cfaab52f75109" exitCode=0 May 20 21:55:18.009199 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:18.008878 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv" event={"ID":"1beac6ad-0438-4fcd-91ed-2cb753de4a82","Type":"ContainerDied","Data":"c4796144bc6fc0ac2e28d4141db32c24b70721f0607b5e54ca1cfaab52f75109"} May 20 21:55:19.151418 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:19.151396 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv" May 20 21:55:19.274673 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:19.274586 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1beac6ad-0438-4fcd-91ed-2cb753de4a82-bundle\") pod \"1beac6ad-0438-4fcd-91ed-2cb753de4a82\" (UID: \"1beac6ad-0438-4fcd-91ed-2cb753de4a82\") " May 20 21:55:19.274801 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:19.274681 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1beac6ad-0438-4fcd-91ed-2cb753de4a82-util\") pod \"1beac6ad-0438-4fcd-91ed-2cb753de4a82\" (UID: \"1beac6ad-0438-4fcd-91ed-2cb753de4a82\") " May 20 21:55:19.274801 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:19.274725 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhp2z\" (UniqueName: \"kubernetes.io/projected/1beac6ad-0438-4fcd-91ed-2cb753de4a82-kube-api-access-jhp2z\") pod \"1beac6ad-0438-4fcd-91ed-2cb753de4a82\" (UID: \"1beac6ad-0438-4fcd-91ed-2cb753de4a82\") " May 20 21:55:19.275421 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:19.275383 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1beac6ad-0438-4fcd-91ed-2cb753de4a82-bundle" (OuterVolumeSpecName: "bundle") pod "1beac6ad-0438-4fcd-91ed-2cb753de4a82" (UID: "1beac6ad-0438-4fcd-91ed-2cb753de4a82"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:55:19.276842 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:19.276812 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1beac6ad-0438-4fcd-91ed-2cb753de4a82-kube-api-access-jhp2z" (OuterVolumeSpecName: "kube-api-access-jhp2z") pod "1beac6ad-0438-4fcd-91ed-2cb753de4a82" (UID: "1beac6ad-0438-4fcd-91ed-2cb753de4a82"). InnerVolumeSpecName "kube-api-access-jhp2z". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:55:19.280700 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:19.280675 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1beac6ad-0438-4fcd-91ed-2cb753de4a82-util" (OuterVolumeSpecName: "util") pod "1beac6ad-0438-4fcd-91ed-2cb753de4a82" (UID: "1beac6ad-0438-4fcd-91ed-2cb753de4a82"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:55:19.375403 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:19.375363 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1beac6ad-0438-4fcd-91ed-2cb753de4a82-util\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:55:19.375403 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:19.375399 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhp2z\" (UniqueName: \"kubernetes.io/projected/1beac6ad-0438-4fcd-91ed-2cb753de4a82-kube-api-access-jhp2z\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:55:19.375403 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:19.375410 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1beac6ad-0438-4fcd-91ed-2cb753de4a82-bundle\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:55:20.016561 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:20.016477 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv" event={"ID":"1beac6ad-0438-4fcd-91ed-2cb753de4a82","Type":"ContainerDied","Data":"f85bfc5a691eecaf2cfbcf4c0f374661cf30fb9d92cc6c469ac6b148b3106b3d"} May 20 21:55:20.016561 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:20.016507 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f85bfc5a691eecaf2cfbcf4c0f374661cf30fb9d92cc6c469ac6b148b3106b3d" May 20 21:55:20.016561 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:20.016533 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5tphfv" May 20 21:55:29.667212 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.667128 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c897df989-sq265"] May 20 21:55:29.668523 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.668498 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1beac6ad-0438-4fcd-91ed-2cb753de4a82" containerName="pull" May 20 21:55:29.668680 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.668668 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1beac6ad-0438-4fcd-91ed-2cb753de4a82" containerName="pull" May 20 21:55:29.668781 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.668771 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1beac6ad-0438-4fcd-91ed-2cb753de4a82" containerName="extract" May 20 21:55:29.668845 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.668838 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1beac6ad-0438-4fcd-91ed-2cb753de4a82" containerName="extract" May 20 21:55:29.668944 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.668935 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1beac6ad-0438-4fcd-91ed-2cb753de4a82" containerName="util" May 20 21:55:29.669009 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.669001 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1beac6ad-0438-4fcd-91ed-2cb753de4a82" containerName="util" May 20 21:55:29.669252 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.669241 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="1beac6ad-0438-4fcd-91ed-2cb753de4a82" containerName="extract" May 20 21:55:29.674441 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.674419 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-sq265" May 20 21:55:29.677700 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.677670 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 20 21:55:29.678371 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.678351 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 20 21:55:29.678480 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.678461 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 20 21:55:29.678814 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.678797 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 20 21:55:29.678900 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.678797 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jb7vn\"" May 20 21:55:29.696892 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.696860 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c897df989-sq265"] May 20 21:55:29.852764 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.852729 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgkff\" (UniqueName: \"kubernetes.io/projected/6f223683-5c1b-4b8b-a433-ce20e7a0b67e-kube-api-access-bgkff\") pod \"opendatahub-operator-controller-manager-6c897df989-sq265\" (UID: \"6f223683-5c1b-4b8b-a433-ce20e7a0b67e\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-sq265" May 20 21:55:29.852764 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.852773 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f223683-5c1b-4b8b-a433-ce20e7a0b67e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c897df989-sq265\" (UID: \"6f223683-5c1b-4b8b-a433-ce20e7a0b67e\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-sq265" May 20 21:55:29.852980 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.852807 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f223683-5c1b-4b8b-a433-ce20e7a0b67e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c897df989-sq265\" (UID: \"6f223683-5c1b-4b8b-a433-ce20e7a0b67e\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-sq265" May 20 21:55:29.954203 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.954121 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f223683-5c1b-4b8b-a433-ce20e7a0b67e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c897df989-sq265\" (UID: \"6f223683-5c1b-4b8b-a433-ce20e7a0b67e\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-sq265" May 20 21:55:29.954346 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.954225 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bgkff\" (UniqueName: \"kubernetes.io/projected/6f223683-5c1b-4b8b-a433-ce20e7a0b67e-kube-api-access-bgkff\") pod \"opendatahub-operator-controller-manager-6c897df989-sq265\" (UID: \"6f223683-5c1b-4b8b-a433-ce20e7a0b67e\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-sq265" May 20 21:55:29.954346 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.954264 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f223683-5c1b-4b8b-a433-ce20e7a0b67e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c897df989-sq265\" (UID: \"6f223683-5c1b-4b8b-a433-ce20e7a0b67e\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-sq265" May 20 21:55:29.956679 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.956631 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f223683-5c1b-4b8b-a433-ce20e7a0b67e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c897df989-sq265\" (UID: \"6f223683-5c1b-4b8b-a433-ce20e7a0b67e\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-sq265" May 20 21:55:29.956814 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.956720 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f223683-5c1b-4b8b-a433-ce20e7a0b67e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c897df989-sq265\" (UID: \"6f223683-5c1b-4b8b-a433-ce20e7a0b67e\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-sq265" May 20 21:55:29.965730 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.965707 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgkff\" (UniqueName: \"kubernetes.io/projected/6f223683-5c1b-4b8b-a433-ce20e7a0b67e-kube-api-access-bgkff\") pod \"opendatahub-operator-controller-manager-6c897df989-sq265\" (UID: \"6f223683-5c1b-4b8b-a433-ce20e7a0b67e\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-sq265" May 20 21:55:29.984818 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:29.984796 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-sq265" May 20 21:55:30.016717 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:30.016690 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2"] May 20 21:55:30.021157 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:30.021138 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2" May 20 21:55:30.025702 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:30.025659 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 20 21:55:30.025826 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:30.025731 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lgzrt\"" May 20 21:55:30.027800 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:30.027779 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 20 21:55:30.037854 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:30.037820 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2"] May 20 21:55:30.126360 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:30.126333 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c897df989-sq265"] May 20 21:55:30.128507 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:55:30.128481 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f223683_5c1b_4b8b_a433_ce20e7a0b67e.slice/crio-6030c5b06e70eb47dc05985654671acb433404ebabf203f272361e4721ec2047 WatchSource:0}: Error finding container 6030c5b06e70eb47dc05985654671acb433404ebabf203f272361e4721ec2047: Status 404 returned error can't find the container with id 6030c5b06e70eb47dc05985654671acb433404ebabf203f272361e4721ec2047 May 20 21:55:30.155285 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:30.155256 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99b9de8d-3bd1-4a79-addc-33692512d123-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2\" (UID: \"99b9de8d-3bd1-4a79-addc-33692512d123\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2" May 20 21:55:30.155400 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:30.155293 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmlzm\" (UniqueName: \"kubernetes.io/projected/99b9de8d-3bd1-4a79-addc-33692512d123-kube-api-access-rmlzm\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2\" (UID: \"99b9de8d-3bd1-4a79-addc-33692512d123\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2" May 20 21:55:30.155453 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:30.155403 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99b9de8d-3bd1-4a79-addc-33692512d123-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2\" (UID: \"99b9de8d-3bd1-4a79-addc-33692512d123\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2" May 20 21:55:30.256679 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:30.256586 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99b9de8d-3bd1-4a79-addc-33692512d123-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2\" (UID: \"99b9de8d-3bd1-4a79-addc-33692512d123\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2" May 20 21:55:30.256679 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:30.256624 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rmlzm\" (UniqueName: \"kubernetes.io/projected/99b9de8d-3bd1-4a79-addc-33692512d123-kube-api-access-rmlzm\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2\" (UID: \"99b9de8d-3bd1-4a79-addc-33692512d123\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2" May 20 21:55:30.256858 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:30.256710 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99b9de8d-3bd1-4a79-addc-33692512d123-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2\" (UID: \"99b9de8d-3bd1-4a79-addc-33692512d123\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2" May 20 21:55:30.256985 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:30.256958 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99b9de8d-3bd1-4a79-addc-33692512d123-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2\" (UID: \"99b9de8d-3bd1-4a79-addc-33692512d123\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2" May 20 21:55:30.257028 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:30.256992 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99b9de8d-3bd1-4a79-addc-33692512d123-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2\" (UID: \"99b9de8d-3bd1-4a79-addc-33692512d123\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2" May 20 21:55:30.265697 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:30.265672 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmlzm\" (UniqueName: \"kubernetes.io/projected/99b9de8d-3bd1-4a79-addc-33692512d123-kube-api-access-rmlzm\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2\" (UID: \"99b9de8d-3bd1-4a79-addc-33692512d123\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2" May 20 21:55:30.331544 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:30.331523 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2" May 20 21:55:30.460363 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:30.460330 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2"] May 20 21:55:30.462547 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:55:30.462516 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b9de8d_3bd1_4a79_addc_33692512d123.slice/crio-155b87ec1a0f2f95f296c36c316ae53e70cb0c13c64d3440e548f286f707a064 WatchSource:0}: Error finding container 155b87ec1a0f2f95f296c36c316ae53e70cb0c13c64d3440e548f286f707a064: Status 404 returned error can't find the container with id 155b87ec1a0f2f95f296c36c316ae53e70cb0c13c64d3440e548f286f707a064 May 20 21:55:31.058712 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:31.058669 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-sq265" event={"ID":"6f223683-5c1b-4b8b-a433-ce20e7a0b67e","Type":"ContainerStarted","Data":"6030c5b06e70eb47dc05985654671acb433404ebabf203f272361e4721ec2047"} May 20 21:55:31.060303 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:31.060276 2571 generic.go:358] "Generic (PLEG): container finished" podID="99b9de8d-3bd1-4a79-addc-33692512d123" containerID="da86223393da04a22f7db050fb756d4840539c6bde230d977acadb491f1e0dce" exitCode=0 May 20 21:55:31.060470 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:31.060421 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2" event={"ID":"99b9de8d-3bd1-4a79-addc-33692512d123","Type":"ContainerDied","Data":"da86223393da04a22f7db050fb756d4840539c6bde230d977acadb491f1e0dce"} May 20 21:55:31.060470 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:31.060450 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2" event={"ID":"99b9de8d-3bd1-4a79-addc-33692512d123","Type":"ContainerStarted","Data":"155b87ec1a0f2f95f296c36c316ae53e70cb0c13c64d3440e548f286f707a064"} May 20 21:55:33.069344 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:33.069309 2571 generic.go:358] "Generic (PLEG): container finished" podID="99b9de8d-3bd1-4a79-addc-33692512d123" containerID="e8a6f3acfd6def06632f8fb8ac4f8c1aefc7fe96fc7c4bf212d6f201a94fa099" exitCode=0 May 20 21:55:33.069849 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:33.069344 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2" event={"ID":"99b9de8d-3bd1-4a79-addc-33692512d123","Type":"ContainerDied","Data":"e8a6f3acfd6def06632f8fb8ac4f8c1aefc7fe96fc7c4bf212d6f201a94fa099"} May 20 21:55:33.071002 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:33.070973 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-sq265" event={"ID":"6f223683-5c1b-4b8b-a433-ce20e7a0b67e","Type":"ContainerStarted","Data":"c3a013193587e46c0f1ea83d03c81a96861edba223b6bb0c3bb7ac879b5303ea"} May 20 21:55:33.071123 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:33.071112 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-sq265" May 20 21:55:33.121476 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:33.116602 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-sq265" podStartSLOduration=1.632173527 podStartE2EDuration="4.116585757s" podCreationTimestamp="2026-05-20 21:55:29 +0000 UTC" firstStartedPulling="2026-05-20 21:55:30.130123139 +0000 UTC m=+441.059939862" lastFinishedPulling="2026-05-20 21:55:32.614535367 +0000 UTC m=+443.544352092" observedRunningTime="2026-05-20 21:55:33.115504803 +0000 UTC m=+444.045321547" watchObservedRunningTime="2026-05-20 21:55:33.116585757 +0000 UTC m=+444.046402501" May 20 21:55:34.077630 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:34.077595 2571 generic.go:358] "Generic (PLEG): container finished" podID="99b9de8d-3bd1-4a79-addc-33692512d123" containerID="45a0113bc4450d35e73117d3d0639e5735fcebe3934f8f652e2600d7be19d4b9" exitCode=0 May 20 21:55:34.078064 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:34.077740 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2" event={"ID":"99b9de8d-3bd1-4a79-addc-33692512d123","Type":"ContainerDied","Data":"45a0113bc4450d35e73117d3d0639e5735fcebe3934f8f652e2600d7be19d4b9"} May 20 21:55:35.204614 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:35.204592 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2" May 20 21:55:35.302238 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:35.302216 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99b9de8d-3bd1-4a79-addc-33692512d123-util\") pod \"99b9de8d-3bd1-4a79-addc-33692512d123\" (UID: \"99b9de8d-3bd1-4a79-addc-33692512d123\") " May 20 21:55:35.302340 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:35.302252 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99b9de8d-3bd1-4a79-addc-33692512d123-bundle\") pod \"99b9de8d-3bd1-4a79-addc-33692512d123\" (UID: \"99b9de8d-3bd1-4a79-addc-33692512d123\") " May 20 21:55:35.302340 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:35.302286 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmlzm\" (UniqueName: \"kubernetes.io/projected/99b9de8d-3bd1-4a79-addc-33692512d123-kube-api-access-rmlzm\") pod \"99b9de8d-3bd1-4a79-addc-33692512d123\" (UID: \"99b9de8d-3bd1-4a79-addc-33692512d123\") " May 20 21:55:35.302950 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:35.302928 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99b9de8d-3bd1-4a79-addc-33692512d123-bundle" (OuterVolumeSpecName: "bundle") pod "99b9de8d-3bd1-4a79-addc-33692512d123" (UID: "99b9de8d-3bd1-4a79-addc-33692512d123"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:55:35.304255 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:35.304234 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99b9de8d-3bd1-4a79-addc-33692512d123-kube-api-access-rmlzm" (OuterVolumeSpecName: "kube-api-access-rmlzm") pod "99b9de8d-3bd1-4a79-addc-33692512d123" (UID: "99b9de8d-3bd1-4a79-addc-33692512d123"). InnerVolumeSpecName "kube-api-access-rmlzm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:55:35.307588 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:35.307568 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99b9de8d-3bd1-4a79-addc-33692512d123-util" (OuterVolumeSpecName: "util") pod "99b9de8d-3bd1-4a79-addc-33692512d123" (UID: "99b9de8d-3bd1-4a79-addc-33692512d123"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:55:35.403599 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:35.403544 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99b9de8d-3bd1-4a79-addc-33692512d123-util\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:55:35.403599 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:35.403565 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99b9de8d-3bd1-4a79-addc-33692512d123-bundle\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:55:35.403599 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:35.403575 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmlzm\" (UniqueName: \"kubernetes.io/projected/99b9de8d-3bd1-4a79-addc-33692512d123-kube-api-access-rmlzm\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:55:36.086445 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:36.086410 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2" event={"ID":"99b9de8d-3bd1-4a79-addc-33692512d123","Type":"ContainerDied","Data":"155b87ec1a0f2f95f296c36c316ae53e70cb0c13c64d3440e548f286f707a064"} May 20 21:55:36.086445 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:36.086449 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="155b87ec1a0f2f95f296c36c316ae53e70cb0c13c64d3440e548f286f707a064" May 20 21:55:36.086667 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:36.086478 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9znlz2" May 20 21:55:37.941683 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:37.940547 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8647c47685-jgjh9"] May 20 21:55:37.941683 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:37.941287 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99b9de8d-3bd1-4a79-addc-33692512d123" containerName="pull" May 20 21:55:37.941683 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:37.941308 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="99b9de8d-3bd1-4a79-addc-33692512d123" containerName="pull" May 20 21:55:37.941683 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:37.941361 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99b9de8d-3bd1-4a79-addc-33692512d123" containerName="extract" May 20 21:55:37.941683 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:37.941370 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="99b9de8d-3bd1-4a79-addc-33692512d123" containerName="extract" May 20 21:55:37.941683 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:37.941394 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99b9de8d-3bd1-4a79-addc-33692512d123" containerName="util" May 20 21:55:37.941683 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:37.941404 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="99b9de8d-3bd1-4a79-addc-33692512d123" containerName="util" May 20 21:55:37.941683 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:37.941561 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="99b9de8d-3bd1-4a79-addc-33692512d123" containerName="extract" May 20 21:55:37.946534 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:37.946512 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8647c47685-jgjh9" May 20 21:55:37.950387 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:37.950363 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 20 21:55:37.950541 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:37.950390 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-z2px2\"" May 20 21:55:37.950541 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:37.950398 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 20 21:55:37.950541 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:37.950437 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 20 21:55:37.950541 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:37.950441 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 20 21:55:37.950541 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:37.950398 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 20 21:55:37.956023 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:37.956003 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8647c47685-jgjh9"] May 20 21:55:38.125895 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:38.125864 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae5f9c37-af29-446b-aa5d-3496c311f163-cert\") pod \"lws-controller-manager-8647c47685-jgjh9\" (UID: \"ae5f9c37-af29-446b-aa5d-3496c311f163\") " pod="openshift-lws-operator/lws-controller-manager-8647c47685-jgjh9" May 20 21:55:38.126059 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:38.125935 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae5f9c37-af29-446b-aa5d-3496c311f163-metrics-cert\") pod \"lws-controller-manager-8647c47685-jgjh9\" (UID: \"ae5f9c37-af29-446b-aa5d-3496c311f163\") " pod="openshift-lws-operator/lws-controller-manager-8647c47685-jgjh9" May 20 21:55:38.126059 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:38.125972 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ae5f9c37-af29-446b-aa5d-3496c311f163-manager-config\") pod \"lws-controller-manager-8647c47685-jgjh9\" (UID: \"ae5f9c37-af29-446b-aa5d-3496c311f163\") " pod="openshift-lws-operator/lws-controller-manager-8647c47685-jgjh9" May 20 21:55:38.126059 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:38.125990 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbh6j\" (UniqueName: \"kubernetes.io/projected/ae5f9c37-af29-446b-aa5d-3496c311f163-kube-api-access-cbh6j\") pod \"lws-controller-manager-8647c47685-jgjh9\" (UID: \"ae5f9c37-af29-446b-aa5d-3496c311f163\") " pod="openshift-lws-operator/lws-controller-manager-8647c47685-jgjh9" May 20 21:55:38.227324 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:38.227238 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae5f9c37-af29-446b-aa5d-3496c311f163-cert\") pod \"lws-controller-manager-8647c47685-jgjh9\" (UID: \"ae5f9c37-af29-446b-aa5d-3496c311f163\") " pod="openshift-lws-operator/lws-controller-manager-8647c47685-jgjh9" May 20 21:55:38.227324 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:38.227302 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae5f9c37-af29-446b-aa5d-3496c311f163-metrics-cert\") pod \"lws-controller-manager-8647c47685-jgjh9\" (UID: \"ae5f9c37-af29-446b-aa5d-3496c311f163\") " pod="openshift-lws-operator/lws-controller-manager-8647c47685-jgjh9" May 20 21:55:38.227505 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:38.227331 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ae5f9c37-af29-446b-aa5d-3496c311f163-manager-config\") pod \"lws-controller-manager-8647c47685-jgjh9\" (UID: \"ae5f9c37-af29-446b-aa5d-3496c311f163\") " pod="openshift-lws-operator/lws-controller-manager-8647c47685-jgjh9" May 20 21:55:38.227505 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:38.227348 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cbh6j\" (UniqueName: \"kubernetes.io/projected/ae5f9c37-af29-446b-aa5d-3496c311f163-kube-api-access-cbh6j\") pod \"lws-controller-manager-8647c47685-jgjh9\" (UID: \"ae5f9c37-af29-446b-aa5d-3496c311f163\") " pod="openshift-lws-operator/lws-controller-manager-8647c47685-jgjh9" May 20 21:55:38.228130 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:38.228107 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ae5f9c37-af29-446b-aa5d-3496c311f163-manager-config\") pod \"lws-controller-manager-8647c47685-jgjh9\" (UID: \"ae5f9c37-af29-446b-aa5d-3496c311f163\") " pod="openshift-lws-operator/lws-controller-manager-8647c47685-jgjh9" May 20 21:55:38.229750 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:38.229725 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae5f9c37-af29-446b-aa5d-3496c311f163-cert\") pod \"lws-controller-manager-8647c47685-jgjh9\" (UID: \"ae5f9c37-af29-446b-aa5d-3496c311f163\") " pod="openshift-lws-operator/lws-controller-manager-8647c47685-jgjh9" May 20 21:55:38.229862 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:38.229757 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae5f9c37-af29-446b-aa5d-3496c311f163-metrics-cert\") pod \"lws-controller-manager-8647c47685-jgjh9\" (UID: \"ae5f9c37-af29-446b-aa5d-3496c311f163\") " pod="openshift-lws-operator/lws-controller-manager-8647c47685-jgjh9" May 20 21:55:38.236271 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:38.236247 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbh6j\" (UniqueName: \"kubernetes.io/projected/ae5f9c37-af29-446b-aa5d-3496c311f163-kube-api-access-cbh6j\") pod \"lws-controller-manager-8647c47685-jgjh9\" (UID: \"ae5f9c37-af29-446b-aa5d-3496c311f163\") " pod="openshift-lws-operator/lws-controller-manager-8647c47685-jgjh9" May 20 21:55:38.256780 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:38.256758 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8647c47685-jgjh9" May 20 21:55:38.380549 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:38.380520 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8647c47685-jgjh9"] May 20 21:55:38.382059 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:55:38.382035 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae5f9c37_af29_446b_aa5d_3496c311f163.slice/crio-ea08e5bdc333c418ee1c2737fb9fef66d73c0aa09967b346a77a27751a63986d WatchSource:0}: Error finding container ea08e5bdc333c418ee1c2737fb9fef66d73c0aa09967b346a77a27751a63986d: Status 404 returned error can't find the container with id ea08e5bdc333c418ee1c2737fb9fef66d73c0aa09967b346a77a27751a63986d May 20 21:55:39.099471 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:39.099433 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8647c47685-jgjh9" event={"ID":"ae5f9c37-af29-446b-aa5d-3496c311f163","Type":"ContainerStarted","Data":"ea08e5bdc333c418ee1c2737fb9fef66d73c0aa09967b346a77a27751a63986d"} May 20 21:55:40.103768 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:40.103731 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8647c47685-jgjh9" event={"ID":"ae5f9c37-af29-446b-aa5d-3496c311f163","Type":"ContainerStarted","Data":"2b6a216fe384b546d37feac6184fd31c833fd9ee4b27d6f292fcc3dafa821e1d"} May 20 21:55:40.104154 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:40.103815 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8647c47685-jgjh9" May 20 21:55:40.122373 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:40.122321 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8647c47685-jgjh9" podStartSLOduration=1.587756309 podStartE2EDuration="3.12230891s" podCreationTimestamp="2026-05-20 21:55:37 +0000 UTC" firstStartedPulling="2026-05-20 21:55:38.383955655 +0000 UTC m=+449.313772392" lastFinishedPulling="2026-05-20 21:55:39.918508272 +0000 UTC m=+450.848324993" observedRunningTime="2026-05-20 21:55:40.119759673 +0000 UTC m=+451.049576428" watchObservedRunningTime="2026-05-20 21:55:40.12230891 +0000 UTC m=+451.052125699" May 20 21:55:44.080177 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:44.080146 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-sq265" May 20 21:55:51.109786 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:55:51.109747 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8647c47685-jgjh9" May 20 21:56:07.794764 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:07.794727 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb"] May 20 21:56:07.801759 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:07.801727 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb" May 20 21:56:07.804493 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:07.804471 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 20 21:56:07.804608 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:07.804473 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lgzrt\"" May 20 21:56:07.805753 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:07.805724 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 20 21:56:07.809511 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:07.809483 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb"] May 20 21:56:07.879137 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:07.879104 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8lj2\" (UniqueName: \"kubernetes.io/projected/9d9c8985-9469-4236-b756-179611e4fe08-kube-api-access-p8lj2\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb\" (UID: \"9d9c8985-9469-4236-b756-179611e4fe08\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb" May 20 21:56:07.879275 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:07.879261 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d9c8985-9469-4236-b756-179611e4fe08-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb\" (UID: \"9d9c8985-9469-4236-b756-179611e4fe08\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb" May 20 21:56:07.879317 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:07.879294 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d9c8985-9469-4236-b756-179611e4fe08-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb\" (UID: \"9d9c8985-9469-4236-b756-179611e4fe08\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb" May 20 21:56:07.980598 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:07.980568 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p8lj2\" (UniqueName: \"kubernetes.io/projected/9d9c8985-9469-4236-b756-179611e4fe08-kube-api-access-p8lj2\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb\" (UID: \"9d9c8985-9469-4236-b756-179611e4fe08\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb" May 20 21:56:07.980754 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:07.980661 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d9c8985-9469-4236-b756-179611e4fe08-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb\" (UID: \"9d9c8985-9469-4236-b756-179611e4fe08\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb" May 20 21:56:07.980754 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:07.980686 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d9c8985-9469-4236-b756-179611e4fe08-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb\" (UID: \"9d9c8985-9469-4236-b756-179611e4fe08\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb" May 20 21:56:07.981103 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:07.981085 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d9c8985-9469-4236-b756-179611e4fe08-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb\" (UID: \"9d9c8985-9469-4236-b756-179611e4fe08\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb" May 20 21:56:07.981143 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:07.981099 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d9c8985-9469-4236-b756-179611e4fe08-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb\" (UID: \"9d9c8985-9469-4236-b756-179611e4fe08\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb" May 20 21:56:07.989163 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:07.989137 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8lj2\" (UniqueName: \"kubernetes.io/projected/9d9c8985-9469-4236-b756-179611e4fe08-kube-api-access-p8lj2\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb\" (UID: \"9d9c8985-9469-4236-b756-179611e4fe08\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb" May 20 21:56:08.113094 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:08.113067 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb" May 20 21:56:08.241437 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:08.241414 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb"] May 20 21:56:08.242976 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:56:08.242941 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d9c8985_9469_4236_b756_179611e4fe08.slice/crio-18067e959997bd6a93390d2a86bb8bb65d5e4c7f95be0c08d651ea45ba963403 WatchSource:0}: Error finding container 18067e959997bd6a93390d2a86bb8bb65d5e4c7f95be0c08d651ea45ba963403: Status 404 returned error can't find the container with id 18067e959997bd6a93390d2a86bb8bb65d5e4c7f95be0c08d651ea45ba963403 May 20 21:56:09.203697 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:09.203659 2571 generic.go:358] "Generic (PLEG): container finished" podID="9d9c8985-9469-4236-b756-179611e4fe08" containerID="d7565925e278aa80bc3cd0ed40bcc2fd962acbcc5a05b0e89854cc4654d9f8cd" exitCode=0 May 20 21:56:09.204062 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:09.203738 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb" event={"ID":"9d9c8985-9469-4236-b756-179611e4fe08","Type":"ContainerDied","Data":"d7565925e278aa80bc3cd0ed40bcc2fd962acbcc5a05b0e89854cc4654d9f8cd"} May 20 21:56:09.204062 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:09.203779 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb" event={"ID":"9d9c8985-9469-4236-b756-179611e4fe08","Type":"ContainerStarted","Data":"18067e959997bd6a93390d2a86bb8bb65d5e4c7f95be0c08d651ea45ba963403"} May 20 21:56:11.211195 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:11.211156 2571 generic.go:358] "Generic (PLEG): container finished" podID="9d9c8985-9469-4236-b756-179611e4fe08" containerID="a01e05899a33a69cbca66be2fa4a7a1f604d71c7c3810b7017921a279dac2a7b" exitCode=0 May 20 21:56:11.211582 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:11.211239 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb" event={"ID":"9d9c8985-9469-4236-b756-179611e4fe08","Type":"ContainerDied","Data":"a01e05899a33a69cbca66be2fa4a7a1f604d71c7c3810b7017921a279dac2a7b"} May 20 21:56:12.216037 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:12.216003 2571 generic.go:358] "Generic (PLEG): container finished" podID="9d9c8985-9469-4236-b756-179611e4fe08" containerID="42a73f432394159eb504d34c456a500cd634aaa66baab5cf0ba8f47efb75c8c4" exitCode=0 May 20 21:56:12.216430 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:12.216096 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb" event={"ID":"9d9c8985-9469-4236-b756-179611e4fe08","Type":"ContainerDied","Data":"42a73f432394159eb504d34c456a500cd634aaa66baab5cf0ba8f47efb75c8c4"} May 20 21:56:13.346280 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:13.346252 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb" May 20 21:56:13.427059 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:13.427033 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d9c8985-9469-4236-b756-179611e4fe08-util\") pod \"9d9c8985-9469-4236-b756-179611e4fe08\" (UID: \"9d9c8985-9469-4236-b756-179611e4fe08\") " May 20 21:56:13.427206 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:13.427065 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d9c8985-9469-4236-b756-179611e4fe08-bundle\") pod \"9d9c8985-9469-4236-b756-179611e4fe08\" (UID: \"9d9c8985-9469-4236-b756-179611e4fe08\") " May 20 21:56:13.427206 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:13.427179 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8lj2\" (UniqueName: \"kubernetes.io/projected/9d9c8985-9469-4236-b756-179611e4fe08-kube-api-access-p8lj2\") pod \"9d9c8985-9469-4236-b756-179611e4fe08\" (UID: \"9d9c8985-9469-4236-b756-179611e4fe08\") " May 20 21:56:13.428013 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:13.427981 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d9c8985-9469-4236-b756-179611e4fe08-bundle" (OuterVolumeSpecName: "bundle") pod "9d9c8985-9469-4236-b756-179611e4fe08" (UID: "9d9c8985-9469-4236-b756-179611e4fe08"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:56:13.429169 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:13.429148 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d9c8985-9469-4236-b756-179611e4fe08-kube-api-access-p8lj2" (OuterVolumeSpecName: "kube-api-access-p8lj2") pod "9d9c8985-9469-4236-b756-179611e4fe08" (UID: "9d9c8985-9469-4236-b756-179611e4fe08"). InnerVolumeSpecName "kube-api-access-p8lj2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:56:13.432890 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:13.432855 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d9c8985-9469-4236-b756-179611e4fe08-util" (OuterVolumeSpecName: "util") pod "9d9c8985-9469-4236-b756-179611e4fe08" (UID: "9d9c8985-9469-4236-b756-179611e4fe08"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:56:13.528017 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:13.527957 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8lj2\" (UniqueName: \"kubernetes.io/projected/9d9c8985-9469-4236-b756-179611e4fe08-kube-api-access-p8lj2\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:56:13.528017 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:13.527981 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d9c8985-9469-4236-b756-179611e4fe08-util\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:56:13.528017 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:13.528002 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d9c8985-9469-4236-b756-179611e4fe08-bundle\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:56:14.225253 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:14.225227 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb" May 20 21:56:14.225415 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:14.225218 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gkxgb" event={"ID":"9d9c8985-9469-4236-b756-179611e4fe08","Type":"ContainerDied","Data":"18067e959997bd6a93390d2a86bb8bb65d5e4c7f95be0c08d651ea45ba963403"} May 20 21:56:14.225415 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:14.225333 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18067e959997bd6a93390d2a86bb8bb65d5e4c7f95be0c08d651ea45ba963403" May 20 21:56:22.049940 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:22.049901 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v"] May 20 21:56:22.050358 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:22.050341 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d9c8985-9469-4236-b756-179611e4fe08" containerName="pull" May 20 21:56:22.050404 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:22.050361 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d9c8985-9469-4236-b756-179611e4fe08" containerName="pull" May 20 21:56:22.050404 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:22.050385 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d9c8985-9469-4236-b756-179611e4fe08" containerName="util" May 20 21:56:22.050404 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:22.050394 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d9c8985-9469-4236-b756-179611e4fe08" containerName="util" May 20 21:56:22.050493 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:22.050409 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d9c8985-9469-4236-b756-179611e4fe08" containerName="extract" May 20 21:56:22.050493 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:22.050417 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d9c8985-9469-4236-b756-179611e4fe08" containerName="extract" May 20 21:56:22.050551 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:22.050515 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="9d9c8985-9469-4236-b756-179611e4fe08" containerName="extract" May 20 21:56:22.056354 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:22.056336 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v" May 20 21:56:22.060999 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:22.060974 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lgzrt\"" May 20 21:56:22.061983 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:22.061957 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 20 21:56:22.062567 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:22.062542 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 20 21:56:22.085161 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:22.085127 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v"] May 20 21:56:22.201798 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:22.201761 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhzxl\" (UniqueName: \"kubernetes.io/projected/b3db34a4-5aa1-453a-9fba-83490e0d8a42-kube-api-access-fhzxl\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v\" (UID: \"b3db34a4-5aa1-453a-9fba-83490e0d8a42\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v" May 20 21:56:22.201987 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:22.201808 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3db34a4-5aa1-453a-9fba-83490e0d8a42-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v\" (UID: \"b3db34a4-5aa1-453a-9fba-83490e0d8a42\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v" May 20 21:56:22.201987 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:22.201871 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3db34a4-5aa1-453a-9fba-83490e0d8a42-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v\" (UID: \"b3db34a4-5aa1-453a-9fba-83490e0d8a42\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v" May 20 21:56:22.303155 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:22.303066 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3db34a4-5aa1-453a-9fba-83490e0d8a42-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v\" (UID: \"b3db34a4-5aa1-453a-9fba-83490e0d8a42\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v" May 20 21:56:22.303155 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:22.303126 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3db34a4-5aa1-453a-9fba-83490e0d8a42-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v\" (UID: \"b3db34a4-5aa1-453a-9fba-83490e0d8a42\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v" May 20 21:56:22.303372 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:22.303214 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fhzxl\" (UniqueName: \"kubernetes.io/projected/b3db34a4-5aa1-453a-9fba-83490e0d8a42-kube-api-access-fhzxl\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v\" (UID: \"b3db34a4-5aa1-453a-9fba-83490e0d8a42\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v" May 20 21:56:22.303553 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:22.303526 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3db34a4-5aa1-453a-9fba-83490e0d8a42-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v\" (UID: \"b3db34a4-5aa1-453a-9fba-83490e0d8a42\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v" May 20 21:56:22.303614 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:22.303536 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3db34a4-5aa1-453a-9fba-83490e0d8a42-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v\" (UID: \"b3db34a4-5aa1-453a-9fba-83490e0d8a42\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v" May 20 21:56:22.313285 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:22.313260 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhzxl\" (UniqueName: \"kubernetes.io/projected/b3db34a4-5aa1-453a-9fba-83490e0d8a42-kube-api-access-fhzxl\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v\" (UID: \"b3db34a4-5aa1-453a-9fba-83490e0d8a42\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v" May 20 21:56:22.366250 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:22.366228 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v" May 20 21:56:22.505315 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:22.505281 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v"] May 20 21:56:22.508866 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:56:22.508826 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3db34a4_5aa1_453a_9fba_83490e0d8a42.slice/crio-b9a13d712be6d0875f7a3df876488e96921930abba83491376cfd33e63bf6b83 WatchSource:0}: Error finding container b9a13d712be6d0875f7a3df876488e96921930abba83491376cfd33e63bf6b83: Status 404 returned error can't find the container with id b9a13d712be6d0875f7a3df876488e96921930abba83491376cfd33e63bf6b83 May 20 21:56:23.258772 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:23.258742 2571 generic.go:358] "Generic (PLEG): container finished" podID="b3db34a4-5aa1-453a-9fba-83490e0d8a42" containerID="a303593e488e9bf3a46843ad3f6c59eb66fb992d6206e1ed2649a93a7262831d" exitCode=0 May 20 21:56:23.259137 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:23.258839 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v" event={"ID":"b3db34a4-5aa1-453a-9fba-83490e0d8a42","Type":"ContainerDied","Data":"a303593e488e9bf3a46843ad3f6c59eb66fb992d6206e1ed2649a93a7262831d"} May 20 21:56:23.259137 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:23.258881 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v" event={"ID":"b3db34a4-5aa1-453a-9fba-83490e0d8a42","Type":"ContainerStarted","Data":"b9a13d712be6d0875f7a3df876488e96921930abba83491376cfd33e63bf6b83"} May 20 21:56:24.264075 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:24.264001 2571 generic.go:358] "Generic (PLEG): container finished" podID="b3db34a4-5aa1-453a-9fba-83490e0d8a42" containerID="0f4628e6dfa949fac6b197e171590a306d54d5a2a4af163bd8402ad67a670bf6" exitCode=0 May 20 21:56:24.264075 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:24.264061 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v" event={"ID":"b3db34a4-5aa1-453a-9fba-83490e0d8a42","Type":"ContainerDied","Data":"0f4628e6dfa949fac6b197e171590a306d54d5a2a4af163bd8402ad67a670bf6"} May 20 21:56:25.275890 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:25.275855 2571 generic.go:358] "Generic (PLEG): container finished" podID="b3db34a4-5aa1-453a-9fba-83490e0d8a42" containerID="0d0398778bf77fc6473abf069858a27b1d150e121bd7b6d3f003aaef879d4158" exitCode=0 May 20 21:56:25.276220 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:25.275944 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v" event={"ID":"b3db34a4-5aa1-453a-9fba-83490e0d8a42","Type":"ContainerDied","Data":"0d0398778bf77fc6473abf069858a27b1d150e121bd7b6d3f003aaef879d4158"} May 20 21:56:26.422859 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:26.422836 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v" May 20 21:56:26.542943 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:26.542859 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhzxl\" (UniqueName: \"kubernetes.io/projected/b3db34a4-5aa1-453a-9fba-83490e0d8a42-kube-api-access-fhzxl\") pod \"b3db34a4-5aa1-453a-9fba-83490e0d8a42\" (UID: \"b3db34a4-5aa1-453a-9fba-83490e0d8a42\") " May 20 21:56:26.543106 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:26.543017 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3db34a4-5aa1-453a-9fba-83490e0d8a42-bundle\") pod \"b3db34a4-5aa1-453a-9fba-83490e0d8a42\" (UID: \"b3db34a4-5aa1-453a-9fba-83490e0d8a42\") " May 20 21:56:26.543106 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:26.543059 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3db34a4-5aa1-453a-9fba-83490e0d8a42-util\") pod \"b3db34a4-5aa1-453a-9fba-83490e0d8a42\" (UID: \"b3db34a4-5aa1-453a-9fba-83490e0d8a42\") " May 20 21:56:26.543840 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:26.543810 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3db34a4-5aa1-453a-9fba-83490e0d8a42-bundle" (OuterVolumeSpecName: "bundle") pod "b3db34a4-5aa1-453a-9fba-83490e0d8a42" (UID: "b3db34a4-5aa1-453a-9fba-83490e0d8a42"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:56:26.545020 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:26.544994 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3db34a4-5aa1-453a-9fba-83490e0d8a42-kube-api-access-fhzxl" (OuterVolumeSpecName: "kube-api-access-fhzxl") pod "b3db34a4-5aa1-453a-9fba-83490e0d8a42" (UID: "b3db34a4-5aa1-453a-9fba-83490e0d8a42"). InnerVolumeSpecName "kube-api-access-fhzxl". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:56:26.549077 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:26.549052 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3db34a4-5aa1-453a-9fba-83490e0d8a42-util" (OuterVolumeSpecName: "util") pod "b3db34a4-5aa1-453a-9fba-83490e0d8a42" (UID: "b3db34a4-5aa1-453a-9fba-83490e0d8a42"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:56:26.644457 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:26.644432 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3db34a4-5aa1-453a-9fba-83490e0d8a42-bundle\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:56:26.644457 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:26.644453 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3db34a4-5aa1-453a-9fba-83490e0d8a42-util\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:56:26.644605 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:26.644462 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhzxl\" (UniqueName: \"kubernetes.io/projected/b3db34a4-5aa1-453a-9fba-83490e0d8a42-kube-api-access-fhzxl\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:56:27.284101 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:27.284066 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v" event={"ID":"b3db34a4-5aa1-453a-9fba-83490e0d8a42","Type":"ContainerDied","Data":"b9a13d712be6d0875f7a3df876488e96921930abba83491376cfd33e63bf6b83"} May 20 21:56:27.284101 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:27.284097 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9a13d712be6d0875f7a3df876488e96921930abba83491376cfd33e63bf6b83" May 20 21:56:27.284314 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:27.284116 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6668v" May 20 21:56:37.764376 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.764339 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz"] May 20 21:56:37.764883 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.764865 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3db34a4-5aa1-453a-9fba-83490e0d8a42" containerName="util" May 20 21:56:37.764883 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.764883 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3db34a4-5aa1-453a-9fba-83490e0d8a42" containerName="util" May 20 21:56:37.765047 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.764915 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3db34a4-5aa1-453a-9fba-83490e0d8a42" containerName="pull" May 20 21:56:37.765047 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.764925 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3db34a4-5aa1-453a-9fba-83490e0d8a42" containerName="pull" May 20 21:56:37.765047 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.764943 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3db34a4-5aa1-453a-9fba-83490e0d8a42" containerName="extract" May 20 21:56:37.765047 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.764952 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3db34a4-5aa1-453a-9fba-83490e0d8a42" containerName="extract" May 20 21:56:37.765047 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.765029 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="b3db34a4-5aa1-453a-9fba-83490e0d8a42" containerName="extract" May 20 21:56:37.768329 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.768309 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.771050 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.771026 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-bknnm\"" May 20 21:56:37.771176 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.771150 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 20 21:56:37.776401 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.776376 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz"] May 20 21:56:37.820467 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.820438 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.820467 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.820472 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.820669 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.820495 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.820669 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.820570 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.820669 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.820610 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.820768 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.820682 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.820768 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.820708 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.820768 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.820762 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.820861 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.820790 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx4fz\" (UniqueName: \"kubernetes.io/projected/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-kube-api-access-xx4fz\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.921150 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.921121 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.921269 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.921162 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.921269 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.921205 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.921269 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.921236 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xx4fz\" (UniqueName: \"kubernetes.io/projected/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-kube-api-access-xx4fz\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.921429 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.921266 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.921429 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.921296 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.921429 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.921335 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.921429 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.921372 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.921429 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.921411 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.921725 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.921550 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.921725 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.921704 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.921814 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.921736 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.922012 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.921986 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.922012 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.922003 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.923518 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.923498 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.923687 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.923664 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.930294 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.930267 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:37.930395 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:37.930329 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx4fz\" (UniqueName: \"kubernetes.io/projected/bb6e7204-e17f-4755-9908-6dfc8d8cbbd0-kube-api-access-xx4fz\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz\" (UID: \"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:38.083738 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:38.083709 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:38.215769 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:38.215743 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz"] May 20 21:56:38.218984 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:56:38.218957 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb6e7204_e17f_4755_9908_6dfc8d8cbbd0.slice/crio-6b0e91f45c40adadd80cc9d4aa079e6914c2d098a5e92866a09e3e313ab82203 WatchSource:0}: Error finding container 6b0e91f45c40adadd80cc9d4aa079e6914c2d098a5e92866a09e3e313ab82203: Status 404 returned error can't find the container with id 6b0e91f45c40adadd80cc9d4aa079e6914c2d098a5e92866a09e3e313ab82203 May 20 21:56:38.326289 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:38.326259 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" event={"ID":"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0","Type":"ContainerStarted","Data":"6b0e91f45c40adadd80cc9d4aa079e6914c2d098a5e92866a09e3e313ab82203"} May 20 21:56:40.480853 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:40.480808 2571 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 20 21:56:40.481140 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:40.480888 2571 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 20 21:56:40.481140 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:40.480922 2571 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 20 21:56:41.340677 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:41.340625 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" event={"ID":"bb6e7204-e17f-4755-9908-6dfc8d8cbbd0","Type":"ContainerStarted","Data":"1e7c3045a9456c564378fc62c04ff9648aaa5e37d3f51b8a5d143ca64c71387b"} May 20 21:56:41.359776 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:41.359731 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" podStartSLOduration=2.100753687 podStartE2EDuration="4.359716665s" podCreationTimestamp="2026-05-20 21:56:37 +0000 UTC" firstStartedPulling="2026-05-20 21:56:38.221546691 +0000 UTC m=+509.151363412" lastFinishedPulling="2026-05-20 21:56:40.480509666 +0000 UTC m=+511.410326390" observedRunningTime="2026-05-20 21:56:41.358417483 +0000 UTC m=+512.288234226" watchObservedRunningTime="2026-05-20 21:56:41.359716665 +0000 UTC m=+512.289533408" May 20 21:56:42.083881 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:42.083849 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:42.088323 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:42.088300 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:42.345138 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:42.345060 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:42.346129 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:42.346113 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz" May 20 21:56:47.365341 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:47.365306 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sphbm"] May 20 21:56:47.368891 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:47.368874 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sphbm" May 20 21:56:47.372064 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:47.372039 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 20 21:56:47.372658 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:47.372618 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-s68p7\"" May 20 21:56:47.372774 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:47.372680 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 20 21:56:47.383356 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:47.383326 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sphbm"] May 20 21:56:47.403150 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:47.403127 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57sjk\" (UniqueName: \"kubernetes.io/projected/2da94f8d-da2e-462d-a2bc-b919b10188ec-kube-api-access-57sjk\") pod \"kuadrant-operator-catalog-sphbm\" (UID: \"2da94f8d-da2e-462d-a2bc-b919b10188ec\") " pod="kuadrant-system/kuadrant-operator-catalog-sphbm" May 20 21:56:47.504561 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:47.504529 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-57sjk\" (UniqueName: \"kubernetes.io/projected/2da94f8d-da2e-462d-a2bc-b919b10188ec-kube-api-access-57sjk\") pod \"kuadrant-operator-catalog-sphbm\" (UID: \"2da94f8d-da2e-462d-a2bc-b919b10188ec\") " pod="kuadrant-system/kuadrant-operator-catalog-sphbm" May 20 21:56:47.512263 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:47.512236 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57sjk\" (UniqueName: \"kubernetes.io/projected/2da94f8d-da2e-462d-a2bc-b919b10188ec-kube-api-access-57sjk\") pod \"kuadrant-operator-catalog-sphbm\" (UID: \"2da94f8d-da2e-462d-a2bc-b919b10188ec\") " pod="kuadrant-system/kuadrant-operator-catalog-sphbm" May 20 21:56:47.679474 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:47.679399 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sphbm" May 20 21:56:47.734123 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:47.734097 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sphbm"] May 20 21:56:47.811808 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:47.811782 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sphbm"] May 20 21:56:47.815750 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:56:47.815715 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2da94f8d_da2e_462d_a2bc_b919b10188ec.slice/crio-33bfcca12cd68fd4794a1aec648d433bd2de80b534e339dd2bd3d5724c02a3db WatchSource:0}: Error finding container 33bfcca12cd68fd4794a1aec648d433bd2de80b534e339dd2bd3d5724c02a3db: Status 404 returned error can't find the container with id 33bfcca12cd68fd4794a1aec648d433bd2de80b534e339dd2bd3d5724c02a3db May 20 21:56:47.942942 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:47.942884 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gnfsf"] May 20 21:56:47.947481 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:47.947465 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gnfsf" May 20 21:56:47.952653 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:47.952623 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gnfsf"] May 20 21:56:48.009340 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:48.009315 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgtpw\" (UniqueName: \"kubernetes.io/projected/34644ddc-a69b-49be-ab78-a4b3a1509a2f-kube-api-access-mgtpw\") pod \"kuadrant-operator-catalog-gnfsf\" (UID: \"34644ddc-a69b-49be-ab78-a4b3a1509a2f\") " pod="kuadrant-system/kuadrant-operator-catalog-gnfsf" May 20 21:56:48.109890 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:48.109861 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mgtpw\" (UniqueName: \"kubernetes.io/projected/34644ddc-a69b-49be-ab78-a4b3a1509a2f-kube-api-access-mgtpw\") pod \"kuadrant-operator-catalog-gnfsf\" (UID: \"34644ddc-a69b-49be-ab78-a4b3a1509a2f\") " pod="kuadrant-system/kuadrant-operator-catalog-gnfsf" May 20 21:56:48.117992 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:48.117962 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgtpw\" (UniqueName: \"kubernetes.io/projected/34644ddc-a69b-49be-ab78-a4b3a1509a2f-kube-api-access-mgtpw\") pod \"kuadrant-operator-catalog-gnfsf\" (UID: \"34644ddc-a69b-49be-ab78-a4b3a1509a2f\") " pod="kuadrant-system/kuadrant-operator-catalog-gnfsf" May 20 21:56:48.257367 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:48.257297 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gnfsf" May 20 21:56:48.367795 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:48.367757 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sphbm" event={"ID":"2da94f8d-da2e-462d-a2bc-b919b10188ec","Type":"ContainerStarted","Data":"33bfcca12cd68fd4794a1aec648d433bd2de80b534e339dd2bd3d5724c02a3db"} May 20 21:56:48.387414 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:48.387392 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gnfsf"] May 20 21:56:48.389465 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:56:48.389440 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34644ddc_a69b_49be_ab78_a4b3a1509a2f.slice/crio-6225b1d690a9c5867b3b5f543bd317a5403d92136323b3634a952e36b355f49f WatchSource:0}: Error finding container 6225b1d690a9c5867b3b5f543bd317a5403d92136323b3634a952e36b355f49f: Status 404 returned error can't find the container with id 6225b1d690a9c5867b3b5f543bd317a5403d92136323b3634a952e36b355f49f May 20 21:56:49.373516 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:49.373404 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gnfsf" event={"ID":"34644ddc-a69b-49be-ab78-a4b3a1509a2f","Type":"ContainerStarted","Data":"6225b1d690a9c5867b3b5f543bd317a5403d92136323b3634a952e36b355f49f"} May 20 21:56:50.378509 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:50.378467 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gnfsf" event={"ID":"34644ddc-a69b-49be-ab78-a4b3a1509a2f","Type":"ContainerStarted","Data":"f67c2395d938b7d3710bee8dcf9c83c4eaa202017d9dc0358ff49e4073f8c2f4"} May 20 21:56:50.379900 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:50.379875 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sphbm" event={"ID":"2da94f8d-da2e-462d-a2bc-b919b10188ec","Type":"ContainerStarted","Data":"20d985268ca7623b537d266889e82df47447fc674feebd12ded26dce2897e8d4"} May 20 21:56:50.380005 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:50.379969 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-sphbm" podUID="2da94f8d-da2e-462d-a2bc-b919b10188ec" containerName="registry-server" containerID="cri-o://20d985268ca7623b537d266889e82df47447fc674feebd12ded26dce2897e8d4" gracePeriod=2 May 20 21:56:50.395091 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:50.395049 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-gnfsf" podStartSLOduration=1.908146743 podStartE2EDuration="3.395034956s" podCreationTimestamp="2026-05-20 21:56:47 +0000 UTC" firstStartedPulling="2026-05-20 21:56:48.390849788 +0000 UTC m=+519.320666509" lastFinishedPulling="2026-05-20 21:56:49.877737991 +0000 UTC m=+520.807554722" observedRunningTime="2026-05-20 21:56:50.393042417 +0000 UTC m=+521.322859158" watchObservedRunningTime="2026-05-20 21:56:50.395034956 +0000 UTC m=+521.324851698" May 20 21:56:50.409578 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:50.409539 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-sphbm" podStartSLOduration=1.350023004 podStartE2EDuration="3.409526847s" podCreationTimestamp="2026-05-20 21:56:47 +0000 UTC" firstStartedPulling="2026-05-20 21:56:47.816711023 +0000 UTC m=+518.746527755" lastFinishedPulling="2026-05-20 21:56:49.876214875 +0000 UTC m=+520.806031598" observedRunningTime="2026-05-20 21:56:50.407629976 +0000 UTC m=+521.337446719" watchObservedRunningTime="2026-05-20 21:56:50.409526847 +0000 UTC m=+521.339343589" May 20 21:56:50.620687 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:50.620666 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sphbm" May 20 21:56:50.735945 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:50.735869 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57sjk\" (UniqueName: \"kubernetes.io/projected/2da94f8d-da2e-462d-a2bc-b919b10188ec-kube-api-access-57sjk\") pod \"2da94f8d-da2e-462d-a2bc-b919b10188ec\" (UID: \"2da94f8d-da2e-462d-a2bc-b919b10188ec\") " May 20 21:56:50.738010 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:50.737989 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2da94f8d-da2e-462d-a2bc-b919b10188ec-kube-api-access-57sjk" (OuterVolumeSpecName: "kube-api-access-57sjk") pod "2da94f8d-da2e-462d-a2bc-b919b10188ec" (UID: "2da94f8d-da2e-462d-a2bc-b919b10188ec"). InnerVolumeSpecName "kube-api-access-57sjk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:56:50.837172 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:50.837143 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57sjk\" (UniqueName: \"kubernetes.io/projected/2da94f8d-da2e-462d-a2bc-b919b10188ec-kube-api-access-57sjk\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:56:51.384323 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:51.384288 2571 generic.go:358] "Generic (PLEG): container finished" podID="2da94f8d-da2e-462d-a2bc-b919b10188ec" containerID="20d985268ca7623b537d266889e82df47447fc674feebd12ded26dce2897e8d4" exitCode=0 May 20 21:56:51.384793 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:51.384368 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sphbm" May 20 21:56:51.384793 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:51.384386 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sphbm" event={"ID":"2da94f8d-da2e-462d-a2bc-b919b10188ec","Type":"ContainerDied","Data":"20d985268ca7623b537d266889e82df47447fc674feebd12ded26dce2897e8d4"} May 20 21:56:51.384793 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:51.384434 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sphbm" event={"ID":"2da94f8d-da2e-462d-a2bc-b919b10188ec","Type":"ContainerDied","Data":"33bfcca12cd68fd4794a1aec648d433bd2de80b534e339dd2bd3d5724c02a3db"} May 20 21:56:51.384793 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:51.384461 2571 scope.go:117] "RemoveContainer" containerID="20d985268ca7623b537d266889e82df47447fc674feebd12ded26dce2897e8d4" May 20 21:56:51.394026 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:51.394011 2571 scope.go:117] "RemoveContainer" containerID="20d985268ca7623b537d266889e82df47447fc674feebd12ded26dce2897e8d4" May 20 21:56:51.394269 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:56:51.394252 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20d985268ca7623b537d266889e82df47447fc674feebd12ded26dce2897e8d4\": container with ID starting with 20d985268ca7623b537d266889e82df47447fc674feebd12ded26dce2897e8d4 not found: ID does not exist" containerID="20d985268ca7623b537d266889e82df47447fc674feebd12ded26dce2897e8d4" May 20 21:56:51.394316 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:51.394276 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20d985268ca7623b537d266889e82df47447fc674feebd12ded26dce2897e8d4"} err="failed to get container status \"20d985268ca7623b537d266889e82df47447fc674feebd12ded26dce2897e8d4\": rpc error: code = NotFound desc = could not find container \"20d985268ca7623b537d266889e82df47447fc674feebd12ded26dce2897e8d4\": container with ID starting with 20d985268ca7623b537d266889e82df47447fc674feebd12ded26dce2897e8d4 not found: ID does not exist" May 20 21:56:51.406437 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:51.406414 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sphbm"] May 20 21:56:51.408496 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:51.408474 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sphbm"] May 20 21:56:51.628195 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:51.628161 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2da94f8d-da2e-462d-a2bc-b919b10188ec" path="/var/lib/kubelet/pods/2da94f8d-da2e-462d-a2bc-b919b10188ec/volumes" May 20 21:56:58.257841 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:58.257811 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-gnfsf" May 20 21:56:58.257841 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:58.257847 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-gnfsf" May 20 21:56:58.279459 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:58.279433 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-gnfsf" May 20 21:56:58.430870 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:56:58.430834 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-gnfsf" May 20 21:57:03.179480 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.179406 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5"] May 20 21:57:03.179837 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.179827 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2da94f8d-da2e-462d-a2bc-b919b10188ec" containerName="registry-server" May 20 21:57:03.179882 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.179843 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2da94f8d-da2e-462d-a2bc-b919b10188ec" containerName="registry-server" May 20 21:57:03.179916 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.179899 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="2da94f8d-da2e-462d-a2bc-b919b10188ec" containerName="registry-server" May 20 21:57:03.182851 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.182836 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5" May 20 21:57:03.185237 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.185215 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-97wlc\"" May 20 21:57:03.190352 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.190332 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5"] May 20 21:57:03.237148 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.237126 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2410c929-7cc1-4de6-aff9-36f75fd86533-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5\" (UID: \"2410c929-7cc1-4de6-aff9-36f75fd86533\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5" May 20 21:57:03.237247 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.237185 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp7wt\" (UniqueName: \"kubernetes.io/projected/2410c929-7cc1-4de6-aff9-36f75fd86533-kube-api-access-rp7wt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5\" (UID: \"2410c929-7cc1-4de6-aff9-36f75fd86533\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5" May 20 21:57:03.237247 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.237222 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2410c929-7cc1-4de6-aff9-36f75fd86533-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5\" (UID: \"2410c929-7cc1-4de6-aff9-36f75fd86533\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5" May 20 21:57:03.337605 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.337578 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2410c929-7cc1-4de6-aff9-36f75fd86533-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5\" (UID: \"2410c929-7cc1-4de6-aff9-36f75fd86533\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5" May 20 21:57:03.337732 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.337668 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rp7wt\" (UniqueName: \"kubernetes.io/projected/2410c929-7cc1-4de6-aff9-36f75fd86533-kube-api-access-rp7wt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5\" (UID: \"2410c929-7cc1-4de6-aff9-36f75fd86533\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5" May 20 21:57:03.337732 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.337711 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2410c929-7cc1-4de6-aff9-36f75fd86533-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5\" (UID: \"2410c929-7cc1-4de6-aff9-36f75fd86533\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5" May 20 21:57:03.338075 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.338052 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2410c929-7cc1-4de6-aff9-36f75fd86533-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5\" (UID: \"2410c929-7cc1-4de6-aff9-36f75fd86533\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5" May 20 21:57:03.338111 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.338086 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2410c929-7cc1-4de6-aff9-36f75fd86533-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5\" (UID: \"2410c929-7cc1-4de6-aff9-36f75fd86533\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5" May 20 21:57:03.346833 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.346812 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp7wt\" (UniqueName: \"kubernetes.io/projected/2410c929-7cc1-4de6-aff9-36f75fd86533-kube-api-access-rp7wt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5\" (UID: \"2410c929-7cc1-4de6-aff9-36f75fd86533\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5" May 20 21:57:03.493215 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.493147 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5" May 20 21:57:03.775759 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.775671 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2"] May 20 21:57:03.780443 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.780421 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2" May 20 21:57:03.785915 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.785892 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2"] May 20 21:57:03.826103 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.826083 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5"] May 20 21:57:03.827967 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:57:03.827937 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2410c929_7cc1_4de6_aff9_36f75fd86533.slice/crio-1fb9e39f946ddd22ca0a0e45188bdffd60528386347104f6c4cd6bb31f80f4be WatchSource:0}: Error finding container 1fb9e39f946ddd22ca0a0e45188bdffd60528386347104f6c4cd6bb31f80f4be: Status 404 returned error can't find the container with id 1fb9e39f946ddd22ca0a0e45188bdffd60528386347104f6c4cd6bb31f80f4be May 20 21:57:03.842955 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.842931 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68hrl\" (UniqueName: \"kubernetes.io/projected/2094ce51-e1f3-4424-91bc-cb93e88ab260-kube-api-access-68hrl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2\" (UID: \"2094ce51-e1f3-4424-91bc-cb93e88ab260\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2" May 20 21:57:03.843031 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.842981 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2094ce51-e1f3-4424-91bc-cb93e88ab260-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2\" (UID: \"2094ce51-e1f3-4424-91bc-cb93e88ab260\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2" May 20 21:57:03.843108 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.843087 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2094ce51-e1f3-4424-91bc-cb93e88ab260-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2\" (UID: \"2094ce51-e1f3-4424-91bc-cb93e88ab260\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2" May 20 21:57:03.944435 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.944408 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-68hrl\" (UniqueName: \"kubernetes.io/projected/2094ce51-e1f3-4424-91bc-cb93e88ab260-kube-api-access-68hrl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2\" (UID: \"2094ce51-e1f3-4424-91bc-cb93e88ab260\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2" May 20 21:57:03.944532 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.944447 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2094ce51-e1f3-4424-91bc-cb93e88ab260-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2\" (UID: \"2094ce51-e1f3-4424-91bc-cb93e88ab260\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2" May 20 21:57:03.944532 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.944484 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2094ce51-e1f3-4424-91bc-cb93e88ab260-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2\" (UID: \"2094ce51-e1f3-4424-91bc-cb93e88ab260\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2" May 20 21:57:03.944816 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.944797 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2094ce51-e1f3-4424-91bc-cb93e88ab260-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2\" (UID: \"2094ce51-e1f3-4424-91bc-cb93e88ab260\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2" May 20 21:57:03.944884 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.944835 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2094ce51-e1f3-4424-91bc-cb93e88ab260-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2\" (UID: \"2094ce51-e1f3-4424-91bc-cb93e88ab260\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2" May 20 21:57:03.953335 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:03.953316 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68hrl\" (UniqueName: \"kubernetes.io/projected/2094ce51-e1f3-4424-91bc-cb93e88ab260-kube-api-access-68hrl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2\" (UID: \"2094ce51-e1f3-4424-91bc-cb93e88ab260\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2" May 20 21:57:04.091915 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.091891 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2" May 20 21:57:04.177572 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.177537 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44"] May 20 21:57:04.184987 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.184961 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44" May 20 21:57:04.188621 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.188594 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44"] May 20 21:57:04.219476 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.219450 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2"] May 20 21:57:04.220847 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:57:04.220821 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2094ce51_e1f3_4424_91bc_cb93e88ab260.slice/crio-3d67085b996b4cd355ba155732fa2aedffc46ffbf66736b2116f9a39bbf37d05 WatchSource:0}: Error finding container 3d67085b996b4cd355ba155732fa2aedffc46ffbf66736b2116f9a39bbf37d05: Status 404 returned error can't find the container with id 3d67085b996b4cd355ba155732fa2aedffc46ffbf66736b2116f9a39bbf37d05 May 20 21:57:04.248054 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.248026 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62d23714-87c6-4535-8c45-e49f6ea5d80e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44\" (UID: \"62d23714-87c6-4535-8c45-e49f6ea5d80e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44" May 20 21:57:04.248196 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.248089 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgj2k\" (UniqueName: \"kubernetes.io/projected/62d23714-87c6-4535-8c45-e49f6ea5d80e-kube-api-access-jgj2k\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44\" (UID: \"62d23714-87c6-4535-8c45-e49f6ea5d80e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44" May 20 21:57:04.248196 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.248123 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62d23714-87c6-4535-8c45-e49f6ea5d80e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44\" (UID: \"62d23714-87c6-4535-8c45-e49f6ea5d80e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44" May 20 21:57:04.349557 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.349496 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62d23714-87c6-4535-8c45-e49f6ea5d80e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44\" (UID: \"62d23714-87c6-4535-8c45-e49f6ea5d80e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44" May 20 21:57:04.349557 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.349547 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgj2k\" (UniqueName: \"kubernetes.io/projected/62d23714-87c6-4535-8c45-e49f6ea5d80e-kube-api-access-jgj2k\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44\" (UID: \"62d23714-87c6-4535-8c45-e49f6ea5d80e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44" May 20 21:57:04.349737 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.349574 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62d23714-87c6-4535-8c45-e49f6ea5d80e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44\" (UID: \"62d23714-87c6-4535-8c45-e49f6ea5d80e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44" May 20 21:57:04.349891 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.349867 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62d23714-87c6-4535-8c45-e49f6ea5d80e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44\" (UID: \"62d23714-87c6-4535-8c45-e49f6ea5d80e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44" May 20 21:57:04.349959 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.349891 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62d23714-87c6-4535-8c45-e49f6ea5d80e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44\" (UID: \"62d23714-87c6-4535-8c45-e49f6ea5d80e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44" May 20 21:57:04.357631 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.357606 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgj2k\" (UniqueName: \"kubernetes.io/projected/62d23714-87c6-4535-8c45-e49f6ea5d80e-kube-api-access-jgj2k\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44\" (UID: \"62d23714-87c6-4535-8c45-e49f6ea5d80e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44" May 20 21:57:04.430559 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.430530 2571 generic.go:358] "Generic (PLEG): container finished" podID="2410c929-7cc1-4de6-aff9-36f75fd86533" containerID="96213f3714edad523173dad910fe642d767e06c53bd28f26c8bbe7c1544c220e" exitCode=0 May 20 21:57:04.430708 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.430618 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5" event={"ID":"2410c929-7cc1-4de6-aff9-36f75fd86533","Type":"ContainerDied","Data":"96213f3714edad523173dad910fe642d767e06c53bd28f26c8bbe7c1544c220e"} May 20 21:57:04.430708 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.430674 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5" event={"ID":"2410c929-7cc1-4de6-aff9-36f75fd86533","Type":"ContainerStarted","Data":"1fb9e39f946ddd22ca0a0e45188bdffd60528386347104f6c4cd6bb31f80f4be"} May 20 21:57:04.432198 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.432177 2571 generic.go:358] "Generic (PLEG): container finished" podID="2094ce51-e1f3-4424-91bc-cb93e88ab260" containerID="793a625438dc2cbf7d802190e508aa9dacb835ffb1d54ea6e73216b61e812216" exitCode=0 May 20 21:57:04.432304 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.432212 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2" event={"ID":"2094ce51-e1f3-4424-91bc-cb93e88ab260","Type":"ContainerDied","Data":"793a625438dc2cbf7d802190e508aa9dacb835ffb1d54ea6e73216b61e812216"} May 20 21:57:04.432304 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.432234 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2" event={"ID":"2094ce51-e1f3-4424-91bc-cb93e88ab260","Type":"ContainerStarted","Data":"3d67085b996b4cd355ba155732fa2aedffc46ffbf66736b2116f9a39bbf37d05"} May 20 21:57:04.497585 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.497552 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44" May 20 21:57:04.628710 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.628685 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44"] May 20 21:57:04.630905 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:57:04.630869 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62d23714_87c6_4535_8c45_e49f6ea5d80e.slice/crio-845adb8c33504a0407d7d127de12a537a76c26c95ebbdcaf3411b019acf98834 WatchSource:0}: Error finding container 845adb8c33504a0407d7d127de12a537a76c26c95ebbdcaf3411b019acf98834: Status 404 returned error can't find the container with id 845adb8c33504a0407d7d127de12a537a76c26c95ebbdcaf3411b019acf98834 May 20 21:57:04.789466 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.789436 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb"] May 20 21:57:04.792914 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.792898 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb" May 20 21:57:04.801465 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.801444 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb"] May 20 21:57:04.853845 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.853820 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/755d76f4-f07d-4dfc-98bd-5d3703beada5-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb\" (UID: \"755d76f4-f07d-4dfc-98bd-5d3703beada5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb" May 20 21:57:04.853968 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.853927 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/755d76f4-f07d-4dfc-98bd-5d3703beada5-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb\" (UID: \"755d76f4-f07d-4dfc-98bd-5d3703beada5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb" May 20 21:57:04.854005 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.853987 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm28x\" (UniqueName: \"kubernetes.io/projected/755d76f4-f07d-4dfc-98bd-5d3703beada5-kube-api-access-sm28x\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb\" (UID: \"755d76f4-f07d-4dfc-98bd-5d3703beada5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb" May 20 21:57:04.954522 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.954453 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/755d76f4-f07d-4dfc-98bd-5d3703beada5-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb\" (UID: \"755d76f4-f07d-4dfc-98bd-5d3703beada5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb" May 20 21:57:04.954522 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.954507 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sm28x\" (UniqueName: \"kubernetes.io/projected/755d76f4-f07d-4dfc-98bd-5d3703beada5-kube-api-access-sm28x\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb\" (UID: \"755d76f4-f07d-4dfc-98bd-5d3703beada5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb" May 20 21:57:04.954712 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.954546 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/755d76f4-f07d-4dfc-98bd-5d3703beada5-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb\" (UID: \"755d76f4-f07d-4dfc-98bd-5d3703beada5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb" May 20 21:57:04.954856 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.954838 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/755d76f4-f07d-4dfc-98bd-5d3703beada5-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb\" (UID: \"755d76f4-f07d-4dfc-98bd-5d3703beada5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb" May 20 21:57:04.954897 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.954883 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/755d76f4-f07d-4dfc-98bd-5d3703beada5-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb\" (UID: \"755d76f4-f07d-4dfc-98bd-5d3703beada5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb" May 20 21:57:04.962697 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:04.962675 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm28x\" (UniqueName: \"kubernetes.io/projected/755d76f4-f07d-4dfc-98bd-5d3703beada5-kube-api-access-sm28x\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb\" (UID: \"755d76f4-f07d-4dfc-98bd-5d3703beada5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb" May 20 21:57:05.102675 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:05.102616 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb" May 20 21:57:05.380584 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:05.380557 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb"] May 20 21:57:05.401704 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:57:05.401678 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod755d76f4_f07d_4dfc_98bd_5d3703beada5.slice/crio-031626495f58315ea3bd4171317148b44244e986670e8771c0fe7cfb434f1039 WatchSource:0}: Error finding container 031626495f58315ea3bd4171317148b44244e986670e8771c0fe7cfb434f1039: Status 404 returned error can't find the container with id 031626495f58315ea3bd4171317148b44244e986670e8771c0fe7cfb434f1039 May 20 21:57:05.440228 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:05.440202 2571 generic.go:358] "Generic (PLEG): container finished" podID="2410c929-7cc1-4de6-aff9-36f75fd86533" containerID="f6f529fcccb4b17c0ccdb7f696bc2dc41d88b7772380287696e58ebecef68c4f" exitCode=0 May 20 21:57:05.440323 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:05.440286 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5" event={"ID":"2410c929-7cc1-4de6-aff9-36f75fd86533","Type":"ContainerDied","Data":"f6f529fcccb4b17c0ccdb7f696bc2dc41d88b7772380287696e58ebecef68c4f"} May 20 21:57:05.441714 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:05.441694 2571 generic.go:358] "Generic (PLEG): container finished" podID="62d23714-87c6-4535-8c45-e49f6ea5d80e" containerID="500f4cf9a166743b2aac625a23ef6ae20787763d94fb8c59265e0cdf56f16eed" exitCode=0 May 20 21:57:05.441817 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:05.441721 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44" event={"ID":"62d23714-87c6-4535-8c45-e49f6ea5d80e","Type":"ContainerDied","Data":"500f4cf9a166743b2aac625a23ef6ae20787763d94fb8c59265e0cdf56f16eed"} May 20 21:57:05.441817 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:05.441748 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44" event={"ID":"62d23714-87c6-4535-8c45-e49f6ea5d80e","Type":"ContainerStarted","Data":"845adb8c33504a0407d7d127de12a537a76c26c95ebbdcaf3411b019acf98834"} May 20 21:57:05.443495 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:05.443473 2571 generic.go:358] "Generic (PLEG): container finished" podID="2094ce51-e1f3-4424-91bc-cb93e88ab260" containerID="41d6772d6db2cc5d20def3f7d2e4f0c5e788b5b5d6ede1e5760ed110fcb70e35" exitCode=0 May 20 21:57:05.443580 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:05.443504 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2" event={"ID":"2094ce51-e1f3-4424-91bc-cb93e88ab260","Type":"ContainerDied","Data":"41d6772d6db2cc5d20def3f7d2e4f0c5e788b5b5d6ede1e5760ed110fcb70e35"} May 20 21:57:05.444624 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:05.444597 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb" event={"ID":"755d76f4-f07d-4dfc-98bd-5d3703beada5","Type":"ContainerStarted","Data":"031626495f58315ea3bd4171317148b44244e986670e8771c0fe7cfb434f1039"} May 20 21:57:06.450297 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:06.450211 2571 generic.go:358] "Generic (PLEG): container finished" podID="2410c929-7cc1-4de6-aff9-36f75fd86533" containerID="1bdd2384d75821d9ffc6d393d5f1339d29cf219ac5f4b33dd2a74a6f3b4cbaeb" exitCode=0 May 20 21:57:06.450667 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:06.450291 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5" event={"ID":"2410c929-7cc1-4de6-aff9-36f75fd86533","Type":"ContainerDied","Data":"1bdd2384d75821d9ffc6d393d5f1339d29cf219ac5f4b33dd2a74a6f3b4cbaeb"} May 20 21:57:06.451828 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:06.451807 2571 generic.go:358] "Generic (PLEG): container finished" podID="62d23714-87c6-4535-8c45-e49f6ea5d80e" containerID="c3d5ead70f901cf134a04d9b8f02bafc781ac5ff9d6c0200c5619595dacf3d56" exitCode=0 May 20 21:57:06.451895 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:06.451875 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44" event={"ID":"62d23714-87c6-4535-8c45-e49f6ea5d80e","Type":"ContainerDied","Data":"c3d5ead70f901cf134a04d9b8f02bafc781ac5ff9d6c0200c5619595dacf3d56"} May 20 21:57:06.453986 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:06.453963 2571 generic.go:358] "Generic (PLEG): container finished" podID="2094ce51-e1f3-4424-91bc-cb93e88ab260" containerID="9b2362089791b07ba43ab129c23a62c764a27b384b29333c33b52f2e345618b3" exitCode=0 May 20 21:57:06.454104 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:06.453997 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2" event={"ID":"2094ce51-e1f3-4424-91bc-cb93e88ab260","Type":"ContainerDied","Data":"9b2362089791b07ba43ab129c23a62c764a27b384b29333c33b52f2e345618b3"} May 20 21:57:06.455361 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:06.455342 2571 generic.go:358] "Generic (PLEG): container finished" podID="755d76f4-f07d-4dfc-98bd-5d3703beada5" containerID="5c8f5ddb2099c6a724268a316317bf2b30b015be1147eb7b14ca4a0802bfcdd0" exitCode=0 May 20 21:57:06.455448 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:06.455409 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb" event={"ID":"755d76f4-f07d-4dfc-98bd-5d3703beada5","Type":"ContainerDied","Data":"5c8f5ddb2099c6a724268a316317bf2b30b015be1147eb7b14ca4a0802bfcdd0"} May 20 21:57:07.461615 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:07.461536 2571 generic.go:358] "Generic (PLEG): container finished" podID="62d23714-87c6-4535-8c45-e49f6ea5d80e" containerID="b65ff99a3442af38488ac0f42613444f50a8f377fe8bc92e18d0bb24cb54e113" exitCode=0 May 20 21:57:07.462024 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:07.461627 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44" event={"ID":"62d23714-87c6-4535-8c45-e49f6ea5d80e","Type":"ContainerDied","Data":"b65ff99a3442af38488ac0f42613444f50a8f377fe8bc92e18d0bb24cb54e113"} May 20 21:57:07.463327 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:07.463302 2571 generic.go:358] "Generic (PLEG): container finished" podID="755d76f4-f07d-4dfc-98bd-5d3703beada5" containerID="e26393de469cc534af00907ca33e5f9ab2fff7f82c51111680cd539679867007" exitCode=0 May 20 21:57:07.463455 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:07.463381 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb" event={"ID":"755d76f4-f07d-4dfc-98bd-5d3703beada5","Type":"ContainerDied","Data":"e26393de469cc534af00907ca33e5f9ab2fff7f82c51111680cd539679867007"} May 20 21:57:07.612711 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:07.612686 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5" May 20 21:57:07.682054 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:07.682027 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2410c929-7cc1-4de6-aff9-36f75fd86533-util\") pod \"2410c929-7cc1-4de6-aff9-36f75fd86533\" (UID: \"2410c929-7cc1-4de6-aff9-36f75fd86533\") " May 20 21:57:07.682165 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:07.682125 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2410c929-7cc1-4de6-aff9-36f75fd86533-bundle\") pod \"2410c929-7cc1-4de6-aff9-36f75fd86533\" (UID: \"2410c929-7cc1-4de6-aff9-36f75fd86533\") " May 20 21:57:07.682242 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:07.682173 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rp7wt\" (UniqueName: \"kubernetes.io/projected/2410c929-7cc1-4de6-aff9-36f75fd86533-kube-api-access-rp7wt\") pod \"2410c929-7cc1-4de6-aff9-36f75fd86533\" (UID: \"2410c929-7cc1-4de6-aff9-36f75fd86533\") " May 20 21:57:07.682618 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:07.682590 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2410c929-7cc1-4de6-aff9-36f75fd86533-bundle" (OuterVolumeSpecName: "bundle") pod "2410c929-7cc1-4de6-aff9-36f75fd86533" (UID: "2410c929-7cc1-4de6-aff9-36f75fd86533"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:57:07.684095 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:07.684074 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2410c929-7cc1-4de6-aff9-36f75fd86533-kube-api-access-rp7wt" (OuterVolumeSpecName: "kube-api-access-rp7wt") pod "2410c929-7cc1-4de6-aff9-36f75fd86533" (UID: "2410c929-7cc1-4de6-aff9-36f75fd86533"). InnerVolumeSpecName "kube-api-access-rp7wt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:57:07.688999 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:07.688975 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2410c929-7cc1-4de6-aff9-36f75fd86533-util" (OuterVolumeSpecName: "util") pod "2410c929-7cc1-4de6-aff9-36f75fd86533" (UID: "2410c929-7cc1-4de6-aff9-36f75fd86533"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:57:07.714458 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:07.714409 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2" May 20 21:57:07.783491 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:07.783463 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2094ce51-e1f3-4424-91bc-cb93e88ab260-bundle\") pod \"2094ce51-e1f3-4424-91bc-cb93e88ab260\" (UID: \"2094ce51-e1f3-4424-91bc-cb93e88ab260\") " May 20 21:57:07.783610 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:07.783570 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2094ce51-e1f3-4424-91bc-cb93e88ab260-util\") pod \"2094ce51-e1f3-4424-91bc-cb93e88ab260\" (UID: \"2094ce51-e1f3-4424-91bc-cb93e88ab260\") " May 20 21:57:07.783706 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:07.783609 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68hrl\" (UniqueName: \"kubernetes.io/projected/2094ce51-e1f3-4424-91bc-cb93e88ab260-kube-api-access-68hrl\") pod \"2094ce51-e1f3-4424-91bc-cb93e88ab260\" (UID: \"2094ce51-e1f3-4424-91bc-cb93e88ab260\") " May 20 21:57:07.783890 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:07.783873 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rp7wt\" (UniqueName: \"kubernetes.io/projected/2410c929-7cc1-4de6-aff9-36f75fd86533-kube-api-access-rp7wt\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:57:07.783947 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:07.783896 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2410c929-7cc1-4de6-aff9-36f75fd86533-util\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:57:07.783947 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:07.783911 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2410c929-7cc1-4de6-aff9-36f75fd86533-bundle\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:57:07.784019 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:07.783953 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2094ce51-e1f3-4424-91bc-cb93e88ab260-bundle" (OuterVolumeSpecName: "bundle") pod "2094ce51-e1f3-4424-91bc-cb93e88ab260" (UID: "2094ce51-e1f3-4424-91bc-cb93e88ab260"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:57:07.785592 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:07.785573 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2094ce51-e1f3-4424-91bc-cb93e88ab260-kube-api-access-68hrl" (OuterVolumeSpecName: "kube-api-access-68hrl") pod "2094ce51-e1f3-4424-91bc-cb93e88ab260" (UID: "2094ce51-e1f3-4424-91bc-cb93e88ab260"). InnerVolumeSpecName "kube-api-access-68hrl". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:57:07.788771 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:07.788752 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2094ce51-e1f3-4424-91bc-cb93e88ab260-util" (OuterVolumeSpecName: "util") pod "2094ce51-e1f3-4424-91bc-cb93e88ab260" (UID: "2094ce51-e1f3-4424-91bc-cb93e88ab260"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:57:07.884858 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:07.884831 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2094ce51-e1f3-4424-91bc-cb93e88ab260-util\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:57:07.884858 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:07.884854 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68hrl\" (UniqueName: \"kubernetes.io/projected/2094ce51-e1f3-4424-91bc-cb93e88ab260-kube-api-access-68hrl\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:57:07.885018 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:07.884864 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2094ce51-e1f3-4424-91bc-cb93e88ab260-bundle\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:57:08.469150 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:08.469112 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2" event={"ID":"2094ce51-e1f3-4424-91bc-cb93e88ab260","Type":"ContainerDied","Data":"3d67085b996b4cd355ba155732fa2aedffc46ffbf66736b2116f9a39bbf37d05"} May 20 21:57:08.469150 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:08.469142 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2" May 20 21:57:08.469616 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:08.469146 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d67085b996b4cd355ba155732fa2aedffc46ffbf66736b2116f9a39bbf37d05" May 20 21:57:08.471017 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:08.470991 2571 generic.go:358] "Generic (PLEG): container finished" podID="755d76f4-f07d-4dfc-98bd-5d3703beada5" containerID="d10aaebd861c9cff50e3a2cc22f9b35cce482780fb0138c80cc4187c90227444" exitCode=0 May 20 21:57:08.471148 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:08.471029 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb" event={"ID":"755d76f4-f07d-4dfc-98bd-5d3703beada5","Type":"ContainerDied","Data":"d10aaebd861c9cff50e3a2cc22f9b35cce482780fb0138c80cc4187c90227444"} May 20 21:57:08.472763 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:08.472745 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5" May 20 21:57:08.472862 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:08.472766 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5" event={"ID":"2410c929-7cc1-4de6-aff9-36f75fd86533","Type":"ContainerDied","Data":"1fb9e39f946ddd22ca0a0e45188bdffd60528386347104f6c4cd6bb31f80f4be"} May 20 21:57:08.472862 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:08.472794 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1fb9e39f946ddd22ca0a0e45188bdffd60528386347104f6c4cd6bb31f80f4be" May 20 21:57:08.604805 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:08.604785 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44" May 20 21:57:08.691753 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:08.691721 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgj2k\" (UniqueName: \"kubernetes.io/projected/62d23714-87c6-4535-8c45-e49f6ea5d80e-kube-api-access-jgj2k\") pod \"62d23714-87c6-4535-8c45-e49f6ea5d80e\" (UID: \"62d23714-87c6-4535-8c45-e49f6ea5d80e\") " May 20 21:57:08.691900 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:08.691781 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62d23714-87c6-4535-8c45-e49f6ea5d80e-util\") pod \"62d23714-87c6-4535-8c45-e49f6ea5d80e\" (UID: \"62d23714-87c6-4535-8c45-e49f6ea5d80e\") " May 20 21:57:08.691900 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:08.691810 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62d23714-87c6-4535-8c45-e49f6ea5d80e-bundle\") pod \"62d23714-87c6-4535-8c45-e49f6ea5d80e\" (UID: \"62d23714-87c6-4535-8c45-e49f6ea5d80e\") " May 20 21:57:08.692340 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:08.692314 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62d23714-87c6-4535-8c45-e49f6ea5d80e-bundle" (OuterVolumeSpecName: "bundle") pod "62d23714-87c6-4535-8c45-e49f6ea5d80e" (UID: "62d23714-87c6-4535-8c45-e49f6ea5d80e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:57:08.693827 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:08.693807 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62d23714-87c6-4535-8c45-e49f6ea5d80e-kube-api-access-jgj2k" (OuterVolumeSpecName: "kube-api-access-jgj2k") pod "62d23714-87c6-4535-8c45-e49f6ea5d80e" (UID: "62d23714-87c6-4535-8c45-e49f6ea5d80e"). InnerVolumeSpecName "kube-api-access-jgj2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:57:08.697036 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:08.697000 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62d23714-87c6-4535-8c45-e49f6ea5d80e-util" (OuterVolumeSpecName: "util") pod "62d23714-87c6-4535-8c45-e49f6ea5d80e" (UID: "62d23714-87c6-4535-8c45-e49f6ea5d80e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:57:08.792952 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:08.792887 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgj2k\" (UniqueName: \"kubernetes.io/projected/62d23714-87c6-4535-8c45-e49f6ea5d80e-kube-api-access-jgj2k\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:57:08.792952 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:08.792914 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62d23714-87c6-4535-8c45-e49f6ea5d80e-util\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:57:08.792952 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:08.792924 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62d23714-87c6-4535-8c45-e49f6ea5d80e-bundle\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:57:09.477912 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:09.477883 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44" May 20 21:57:09.477912 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:09.477898 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44" event={"ID":"62d23714-87c6-4535-8c45-e49f6ea5d80e","Type":"ContainerDied","Data":"845adb8c33504a0407d7d127de12a537a76c26c95ebbdcaf3411b019acf98834"} May 20 21:57:09.478324 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:09.477933 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="845adb8c33504a0407d7d127de12a537a76c26c95ebbdcaf3411b019acf98834" May 20 21:57:09.617503 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:09.617478 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb" May 20 21:57:09.700353 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:09.700330 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sm28x\" (UniqueName: \"kubernetes.io/projected/755d76f4-f07d-4dfc-98bd-5d3703beada5-kube-api-access-sm28x\") pod \"755d76f4-f07d-4dfc-98bd-5d3703beada5\" (UID: \"755d76f4-f07d-4dfc-98bd-5d3703beada5\") " May 20 21:57:09.700474 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:09.700412 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/755d76f4-f07d-4dfc-98bd-5d3703beada5-util\") pod \"755d76f4-f07d-4dfc-98bd-5d3703beada5\" (UID: \"755d76f4-f07d-4dfc-98bd-5d3703beada5\") " May 20 21:57:09.700474 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:09.700439 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/755d76f4-f07d-4dfc-98bd-5d3703beada5-bundle\") pod \"755d76f4-f07d-4dfc-98bd-5d3703beada5\" (UID: \"755d76f4-f07d-4dfc-98bd-5d3703beada5\") " May 20 21:57:09.701067 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:09.701028 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/755d76f4-f07d-4dfc-98bd-5d3703beada5-bundle" (OuterVolumeSpecName: "bundle") pod "755d76f4-f07d-4dfc-98bd-5d3703beada5" (UID: "755d76f4-f07d-4dfc-98bd-5d3703beada5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:57:09.702278 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:09.702254 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/755d76f4-f07d-4dfc-98bd-5d3703beada5-kube-api-access-sm28x" (OuterVolumeSpecName: "kube-api-access-sm28x") pod "755d76f4-f07d-4dfc-98bd-5d3703beada5" (UID: "755d76f4-f07d-4dfc-98bd-5d3703beada5"). InnerVolumeSpecName "kube-api-access-sm28x". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:57:09.705833 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:09.705794 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/755d76f4-f07d-4dfc-98bd-5d3703beada5-util" (OuterVolumeSpecName: "util") pod "755d76f4-f07d-4dfc-98bd-5d3703beada5" (UID: "755d76f4-f07d-4dfc-98bd-5d3703beada5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:57:09.801936 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:09.801884 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/755d76f4-f07d-4dfc-98bd-5d3703beada5-util\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:57:09.801936 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:09.801904 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/755d76f4-f07d-4dfc-98bd-5d3703beada5-bundle\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:57:09.801936 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:09.801914 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sm28x\" (UniqueName: \"kubernetes.io/projected/755d76f4-f07d-4dfc-98bd-5d3703beada5-kube-api-access-sm28x\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:57:10.483258 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:10.483226 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb" May 20 21:57:10.483258 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:10.483234 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb" event={"ID":"755d76f4-f07d-4dfc-98bd-5d3703beada5","Type":"ContainerDied","Data":"031626495f58315ea3bd4171317148b44244e986670e8771c0fe7cfb434f1039"} May 20 21:57:10.483258 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:10.483264 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="031626495f58315ea3bd4171317148b44244e986670e8771c0fe7cfb434f1039" May 20 21:57:12.541835 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.541801 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-777d8787c4-r8g5g"] May 20 21:57:12.543258 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543216 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62d23714-87c6-4535-8c45-e49f6ea5d80e" containerName="extract" May 20 21:57:12.543258 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543243 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d23714-87c6-4535-8c45-e49f6ea5d80e" containerName="extract" May 20 21:57:12.543463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543275 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2410c929-7cc1-4de6-aff9-36f75fd86533" containerName="pull" May 20 21:57:12.543463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543286 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2410c929-7cc1-4de6-aff9-36f75fd86533" containerName="pull" May 20 21:57:12.543463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543298 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62d23714-87c6-4535-8c45-e49f6ea5d80e" containerName="pull" May 20 21:57:12.543463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543306 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d23714-87c6-4535-8c45-e49f6ea5d80e" containerName="pull" May 20 21:57:12.543463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543316 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="755d76f4-f07d-4dfc-98bd-5d3703beada5" containerName="pull" May 20 21:57:12.543463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543321 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="755d76f4-f07d-4dfc-98bd-5d3703beada5" containerName="pull" May 20 21:57:12.543463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543331 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2094ce51-e1f3-4424-91bc-cb93e88ab260" containerName="util" May 20 21:57:12.543463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543338 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2094ce51-e1f3-4424-91bc-cb93e88ab260" containerName="util" May 20 21:57:12.543463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543348 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2094ce51-e1f3-4424-91bc-cb93e88ab260" containerName="pull" May 20 21:57:12.543463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543353 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2094ce51-e1f3-4424-91bc-cb93e88ab260" containerName="pull" May 20 21:57:12.543463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543359 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2094ce51-e1f3-4424-91bc-cb93e88ab260" containerName="extract" May 20 21:57:12.543463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543364 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2094ce51-e1f3-4424-91bc-cb93e88ab260" containerName="extract" May 20 21:57:12.543463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543375 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62d23714-87c6-4535-8c45-e49f6ea5d80e" containerName="util" May 20 21:57:12.543463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543380 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d23714-87c6-4535-8c45-e49f6ea5d80e" containerName="util" May 20 21:57:12.543463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543385 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2410c929-7cc1-4de6-aff9-36f75fd86533" containerName="extract" May 20 21:57:12.543463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543390 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2410c929-7cc1-4de6-aff9-36f75fd86533" containerName="extract" May 20 21:57:12.543463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543401 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="755d76f4-f07d-4dfc-98bd-5d3703beada5" containerName="extract" May 20 21:57:12.543463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543409 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="755d76f4-f07d-4dfc-98bd-5d3703beada5" containerName="extract" May 20 21:57:12.543463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543419 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2410c929-7cc1-4de6-aff9-36f75fd86533" containerName="util" May 20 21:57:12.543463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543424 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2410c929-7cc1-4de6-aff9-36f75fd86533" containerName="util" May 20 21:57:12.543463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543429 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="755d76f4-f07d-4dfc-98bd-5d3703beada5" containerName="util" May 20 21:57:12.543463 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543434 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="755d76f4-f07d-4dfc-98bd-5d3703beada5" containerName="util" May 20 21:57:12.544518 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543504 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="755d76f4-f07d-4dfc-98bd-5d3703beada5" containerName="extract" May 20 21:57:12.544518 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543514 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="2410c929-7cc1-4de6-aff9-36f75fd86533" containerName="extract" May 20 21:57:12.544518 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543522 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="2094ce51-e1f3-4424-91bc-cb93e88ab260" containerName="extract" May 20 21:57:12.544518 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.543531 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="62d23714-87c6-4535-8c45-e49f6ea5d80e" containerName="extract" May 20 21:57:12.550588 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.550569 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:12.558101 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.557900 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-777d8787c4-r8g5g"] May 20 21:57:12.626116 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.626083 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93b7154a-6a4c-4b0e-96d3-08fb850b7546-console-config\") pod \"console-777d8787c4-r8g5g\" (UID: \"93b7154a-6a4c-4b0e-96d3-08fb850b7546\") " pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:12.626256 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.626122 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93b7154a-6a4c-4b0e-96d3-08fb850b7546-console-serving-cert\") pod \"console-777d8787c4-r8g5g\" (UID: \"93b7154a-6a4c-4b0e-96d3-08fb850b7546\") " pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:12.626256 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.626147 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93b7154a-6a4c-4b0e-96d3-08fb850b7546-trusted-ca-bundle\") pod \"console-777d8787c4-r8g5g\" (UID: \"93b7154a-6a4c-4b0e-96d3-08fb850b7546\") " pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:12.626256 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.626205 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93b7154a-6a4c-4b0e-96d3-08fb850b7546-oauth-serving-cert\") pod \"console-777d8787c4-r8g5g\" (UID: \"93b7154a-6a4c-4b0e-96d3-08fb850b7546\") " pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:12.626256 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.626252 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93b7154a-6a4c-4b0e-96d3-08fb850b7546-service-ca\") pod \"console-777d8787c4-r8g5g\" (UID: \"93b7154a-6a4c-4b0e-96d3-08fb850b7546\") " pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:12.626504 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.626280 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93b7154a-6a4c-4b0e-96d3-08fb850b7546-console-oauth-config\") pod \"console-777d8787c4-r8g5g\" (UID: \"93b7154a-6a4c-4b0e-96d3-08fb850b7546\") " pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:12.626504 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.626309 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5trsf\" (UniqueName: \"kubernetes.io/projected/93b7154a-6a4c-4b0e-96d3-08fb850b7546-kube-api-access-5trsf\") pod \"console-777d8787c4-r8g5g\" (UID: \"93b7154a-6a4c-4b0e-96d3-08fb850b7546\") " pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:12.727083 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.727054 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93b7154a-6a4c-4b0e-96d3-08fb850b7546-oauth-serving-cert\") pod \"console-777d8787c4-r8g5g\" (UID: \"93b7154a-6a4c-4b0e-96d3-08fb850b7546\") " pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:12.727234 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.727103 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93b7154a-6a4c-4b0e-96d3-08fb850b7546-service-ca\") pod \"console-777d8787c4-r8g5g\" (UID: \"93b7154a-6a4c-4b0e-96d3-08fb850b7546\") " pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:12.727234 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.727139 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93b7154a-6a4c-4b0e-96d3-08fb850b7546-console-oauth-config\") pod \"console-777d8787c4-r8g5g\" (UID: \"93b7154a-6a4c-4b0e-96d3-08fb850b7546\") " pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:12.727234 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.727160 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5trsf\" (UniqueName: \"kubernetes.io/projected/93b7154a-6a4c-4b0e-96d3-08fb850b7546-kube-api-access-5trsf\") pod \"console-777d8787c4-r8g5g\" (UID: \"93b7154a-6a4c-4b0e-96d3-08fb850b7546\") " pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:12.727234 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.727188 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93b7154a-6a4c-4b0e-96d3-08fb850b7546-console-config\") pod \"console-777d8787c4-r8g5g\" (UID: \"93b7154a-6a4c-4b0e-96d3-08fb850b7546\") " pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:12.727234 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.727221 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93b7154a-6a4c-4b0e-96d3-08fb850b7546-console-serving-cert\") pod \"console-777d8787c4-r8g5g\" (UID: \"93b7154a-6a4c-4b0e-96d3-08fb850b7546\") " pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:12.727509 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.727251 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93b7154a-6a4c-4b0e-96d3-08fb850b7546-trusted-ca-bundle\") pod \"console-777d8787c4-r8g5g\" (UID: \"93b7154a-6a4c-4b0e-96d3-08fb850b7546\") " pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:12.727913 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.727887 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93b7154a-6a4c-4b0e-96d3-08fb850b7546-service-ca\") pod \"console-777d8787c4-r8g5g\" (UID: \"93b7154a-6a4c-4b0e-96d3-08fb850b7546\") " pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:12.728011 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.727894 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93b7154a-6a4c-4b0e-96d3-08fb850b7546-oauth-serving-cert\") pod \"console-777d8787c4-r8g5g\" (UID: \"93b7154a-6a4c-4b0e-96d3-08fb850b7546\") " pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:12.728011 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.727962 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93b7154a-6a4c-4b0e-96d3-08fb850b7546-console-config\") pod \"console-777d8787c4-r8g5g\" (UID: \"93b7154a-6a4c-4b0e-96d3-08fb850b7546\") " pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:12.728117 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.728046 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93b7154a-6a4c-4b0e-96d3-08fb850b7546-trusted-ca-bundle\") pod \"console-777d8787c4-r8g5g\" (UID: \"93b7154a-6a4c-4b0e-96d3-08fb850b7546\") " pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:12.730079 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.730053 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93b7154a-6a4c-4b0e-96d3-08fb850b7546-console-serving-cert\") pod \"console-777d8787c4-r8g5g\" (UID: \"93b7154a-6a4c-4b0e-96d3-08fb850b7546\") " pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:12.730254 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.730232 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93b7154a-6a4c-4b0e-96d3-08fb850b7546-console-oauth-config\") pod \"console-777d8787c4-r8g5g\" (UID: \"93b7154a-6a4c-4b0e-96d3-08fb850b7546\") " pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:12.734604 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.734588 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5trsf\" (UniqueName: \"kubernetes.io/projected/93b7154a-6a4c-4b0e-96d3-08fb850b7546-kube-api-access-5trsf\") pod \"console-777d8787c4-r8g5g\" (UID: \"93b7154a-6a4c-4b0e-96d3-08fb850b7546\") " pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:12.861812 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.861781 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:12.998879 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:12.998839 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-777d8787c4-r8g5g"] May 20 21:57:13.001069 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:57:13.001040 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93b7154a_6a4c_4b0e_96d3_08fb850b7546.slice/crio-54ce889822c97ef15724690ea2fd9a9d4da8762beb27e9efa7129e71c35d9d02 WatchSource:0}: Error finding container 54ce889822c97ef15724690ea2fd9a9d4da8762beb27e9efa7129e71c35d9d02: Status 404 returned error can't find the container with id 54ce889822c97ef15724690ea2fd9a9d4da8762beb27e9efa7129e71c35d9d02 May 20 21:57:13.495838 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:13.495797 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777d8787c4-r8g5g" event={"ID":"93b7154a-6a4c-4b0e-96d3-08fb850b7546","Type":"ContainerStarted","Data":"3d73b7ae46e5df3d3f58826023b164b7143c8b133d55ed85f2fd8a92bd0aecbb"} May 20 21:57:13.495838 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:13.495833 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777d8787c4-r8g5g" event={"ID":"93b7154a-6a4c-4b0e-96d3-08fb850b7546","Type":"ContainerStarted","Data":"54ce889822c97ef15724690ea2fd9a9d4da8762beb27e9efa7129e71c35d9d02"} May 20 21:57:13.514050 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:13.514006 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-777d8787c4-r8g5g" podStartSLOduration=1.513992688 podStartE2EDuration="1.513992688s" podCreationTimestamp="2026-05-20 21:57:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:57:13.512487734 +0000 UTC m=+544.442304478" watchObservedRunningTime="2026-05-20 21:57:13.513992688 +0000 UTC m=+544.443809431" May 20 21:57:22.862946 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:22.862910 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:22.863519 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:22.862956 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:22.867796 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:22.867771 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:23.537430 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:23.537400 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-777d8787c4-r8g5g" May 20 21:57:23.586867 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:23.586832 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b94b5c75-v7x7g"] May 20 21:57:27.299708 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:27.299676 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv"] May 20 21:57:27.308033 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:27.308012 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv" May 20 21:57:27.310713 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:27.310688 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-75bc9\"" May 20 21:57:27.315176 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:27.315154 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv"] May 20 21:57:27.346133 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:27.346101 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvh2d\" (UniqueName: \"kubernetes.io/projected/8e34bf16-d5e7-408e-827b-bec6edabccdd-kube-api-access-nvh2d\") pod \"limitador-operator-controller-manager-85c4996f8c-gl7jv\" (UID: \"8e34bf16-d5e7-408e-827b-bec6edabccdd\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv" May 20 21:57:27.447414 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:27.447385 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nvh2d\" (UniqueName: \"kubernetes.io/projected/8e34bf16-d5e7-408e-827b-bec6edabccdd-kube-api-access-nvh2d\") pod \"limitador-operator-controller-manager-85c4996f8c-gl7jv\" (UID: \"8e34bf16-d5e7-408e-827b-bec6edabccdd\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv" May 20 21:57:27.459726 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:27.459701 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvh2d\" (UniqueName: \"kubernetes.io/projected/8e34bf16-d5e7-408e-827b-bec6edabccdd-kube-api-access-nvh2d\") pod \"limitador-operator-controller-manager-85c4996f8c-gl7jv\" (UID: \"8e34bf16-d5e7-408e-827b-bec6edabccdd\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv" May 20 21:57:27.621279 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:27.621249 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv" May 20 21:57:27.752959 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:27.752936 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv"] May 20 21:57:27.755231 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:57:27.755203 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e34bf16_d5e7_408e_827b_bec6edabccdd.slice/crio-97365bcaaeebcdbe51df3c258e0509c16c72e3cb7a70f8a5de5d67afcafd2bb8 WatchSource:0}: Error finding container 97365bcaaeebcdbe51df3c258e0509c16c72e3cb7a70f8a5de5d67afcafd2bb8: Status 404 returned error can't find the container with id 97365bcaaeebcdbe51df3c258e0509c16c72e3cb7a70f8a5de5d67afcafd2bb8 May 20 21:57:28.553625 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:28.553584 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv" event={"ID":"8e34bf16-d5e7-408e-827b-bec6edabccdd","Type":"ContainerStarted","Data":"97365bcaaeebcdbe51df3c258e0509c16c72e3cb7a70f8a5de5d67afcafd2bb8"} May 20 21:57:30.563054 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:30.563017 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv" event={"ID":"8e34bf16-d5e7-408e-827b-bec6edabccdd","Type":"ContainerStarted","Data":"562b291fec5992b08eb199dcc916df47e634cb5e91be85fe69b80fb5bcabfb79"} May 20 21:57:30.563444 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:30.563124 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv" May 20 21:57:30.580007 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:30.579962 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv" podStartSLOduration=1.826969799 podStartE2EDuration="3.579949461s" podCreationTimestamp="2026-05-20 21:57:27 +0000 UTC" firstStartedPulling="2026-05-20 21:57:27.757118328 +0000 UTC m=+558.686935048" lastFinishedPulling="2026-05-20 21:57:29.510097982 +0000 UTC m=+560.439914710" observedRunningTime="2026-05-20 21:57:30.578519253 +0000 UTC m=+561.508335997" watchObservedRunningTime="2026-05-20 21:57:30.579949461 +0000 UTC m=+561.509766204" May 20 21:57:36.098270 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:36.098232 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd"] May 20 21:57:36.102027 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:36.102009 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" May 20 21:57:36.104633 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:36.104609 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-j65r2\"" May 20 21:57:36.114658 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:36.114618 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd"] May 20 21:57:36.118948 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:36.118923 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3947e9ee-2357-486b-af81-2747b9380ee1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-ctmfd\" (UID: \"3947e9ee-2357-486b-af81-2747b9380ee1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" May 20 21:57:36.119063 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:36.118996 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsscv\" (UniqueName: \"kubernetes.io/projected/3947e9ee-2357-486b-af81-2747b9380ee1-kube-api-access-hsscv\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-ctmfd\" (UID: \"3947e9ee-2357-486b-af81-2747b9380ee1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" May 20 21:57:36.220006 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:36.219971 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3947e9ee-2357-486b-af81-2747b9380ee1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-ctmfd\" (UID: \"3947e9ee-2357-486b-af81-2747b9380ee1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" May 20 21:57:36.220161 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:36.220023 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hsscv\" (UniqueName: \"kubernetes.io/projected/3947e9ee-2357-486b-af81-2747b9380ee1-kube-api-access-hsscv\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-ctmfd\" (UID: \"3947e9ee-2357-486b-af81-2747b9380ee1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" May 20 21:57:36.220326 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:36.220308 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3947e9ee-2357-486b-af81-2747b9380ee1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-ctmfd\" (UID: \"3947e9ee-2357-486b-af81-2747b9380ee1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" May 20 21:57:36.228523 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:36.228492 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsscv\" (UniqueName: \"kubernetes.io/projected/3947e9ee-2357-486b-af81-2747b9380ee1-kube-api-access-hsscv\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-ctmfd\" (UID: \"3947e9ee-2357-486b-af81-2747b9380ee1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" May 20 21:57:36.412097 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:36.412005 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" May 20 21:57:36.542944 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:36.542917 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd"] May 20 21:57:36.545327 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:57:36.545300 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3947e9ee_2357_486b_af81_2747b9380ee1.slice/crio-61f9a76fade3ffe43f928645668620a0ea446b8143fbefb6fd46eed27a788d58 WatchSource:0}: Error finding container 61f9a76fade3ffe43f928645668620a0ea446b8143fbefb6fd46eed27a788d58: Status 404 returned error can't find the container with id 61f9a76fade3ffe43f928645668620a0ea446b8143fbefb6fd46eed27a788d58 May 20 21:57:36.585859 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:36.585829 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" event={"ID":"3947e9ee-2357-486b-af81-2747b9380ee1","Type":"ContainerStarted","Data":"61f9a76fade3ffe43f928645668620a0ea446b8143fbefb6fd46eed27a788d58"} May 20 21:57:41.568812 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:41.568773 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv" May 20 21:57:41.610064 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:41.610029 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" event={"ID":"3947e9ee-2357-486b-af81-2747b9380ee1","Type":"ContainerStarted","Data":"0483c5a4eb3be5f5251f66958ac116e2c4461cf63116e9ad1d31feee861db0e4"} May 20 21:57:41.610245 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:41.610166 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" May 20 21:57:41.632272 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:41.632224 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" podStartSLOduration=1.170532227 podStartE2EDuration="5.632209588s" podCreationTimestamp="2026-05-20 21:57:36 +0000 UTC" firstStartedPulling="2026-05-20 21:57:36.547837645 +0000 UTC m=+567.477654366" lastFinishedPulling="2026-05-20 21:57:41.009514993 +0000 UTC m=+571.939331727" observedRunningTime="2026-05-20 21:57:41.631116287 +0000 UTC m=+572.560933031" watchObservedRunningTime="2026-05-20 21:57:41.632209588 +0000 UTC m=+572.562026331" May 20 21:57:48.607090 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:48.607051 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7b94b5c75-v7x7g" podUID="effc5908-526f-447d-a993-89b4c48554c5" containerName="console" containerID="cri-o://b3be0b247a763928f3f6ad9ef4f24455aec8d7f790b6b5f778450e450ae7f246" gracePeriod=15 May 20 21:57:48.854706 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:48.854685 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b94b5c75-v7x7g_effc5908-526f-447d-a993-89b4c48554c5/console/0.log" May 20 21:57:48.854821 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:48.854745 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:57:48.935392 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:48.935363 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/effc5908-526f-447d-a993-89b4c48554c5-console-oauth-config\") pod \"effc5908-526f-447d-a993-89b4c48554c5\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " May 20 21:57:48.935557 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:48.935420 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/effc5908-526f-447d-a993-89b4c48554c5-trusted-ca-bundle\") pod \"effc5908-526f-447d-a993-89b4c48554c5\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " May 20 21:57:48.935557 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:48.935455 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgm5b\" (UniqueName: \"kubernetes.io/projected/effc5908-526f-447d-a993-89b4c48554c5-kube-api-access-xgm5b\") pod \"effc5908-526f-447d-a993-89b4c48554c5\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " May 20 21:57:48.935557 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:48.935471 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/effc5908-526f-447d-a993-89b4c48554c5-oauth-serving-cert\") pod \"effc5908-526f-447d-a993-89b4c48554c5\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " May 20 21:57:48.935557 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:48.935505 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/effc5908-526f-447d-a993-89b4c48554c5-service-ca\") pod \"effc5908-526f-447d-a993-89b4c48554c5\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " May 20 21:57:48.935557 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:48.935520 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/effc5908-526f-447d-a993-89b4c48554c5-console-config\") pod \"effc5908-526f-447d-a993-89b4c48554c5\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " May 20 21:57:48.935825 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:48.935570 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/effc5908-526f-447d-a993-89b4c48554c5-console-serving-cert\") pod \"effc5908-526f-447d-a993-89b4c48554c5\" (UID: \"effc5908-526f-447d-a993-89b4c48554c5\") " May 20 21:57:48.936014 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:48.935987 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/effc5908-526f-447d-a993-89b4c48554c5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "effc5908-526f-447d-a993-89b4c48554c5" (UID: "effc5908-526f-447d-a993-89b4c48554c5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 21:57:48.936165 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:48.936140 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/effc5908-526f-447d-a993-89b4c48554c5-console-config" (OuterVolumeSpecName: "console-config") pod "effc5908-526f-447d-a993-89b4c48554c5" (UID: "effc5908-526f-447d-a993-89b4c48554c5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 21:57:48.936225 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:48.936146 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/effc5908-526f-447d-a993-89b4c48554c5-service-ca" (OuterVolumeSpecName: "service-ca") pod "effc5908-526f-447d-a993-89b4c48554c5" (UID: "effc5908-526f-447d-a993-89b4c48554c5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 21:57:48.936225 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:48.936191 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/effc5908-526f-447d-a993-89b4c48554c5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "effc5908-526f-447d-a993-89b4c48554c5" (UID: "effc5908-526f-447d-a993-89b4c48554c5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 21:57:48.937529 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:48.937510 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/effc5908-526f-447d-a993-89b4c48554c5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "effc5908-526f-447d-a993-89b4c48554c5" (UID: "effc5908-526f-447d-a993-89b4c48554c5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 21:57:48.937650 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:48.937617 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/effc5908-526f-447d-a993-89b4c48554c5-kube-api-access-xgm5b" (OuterVolumeSpecName: "kube-api-access-xgm5b") pod "effc5908-526f-447d-a993-89b4c48554c5" (UID: "effc5908-526f-447d-a993-89b4c48554c5"). InnerVolumeSpecName "kube-api-access-xgm5b". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:57:48.937719 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:48.937681 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/effc5908-526f-447d-a993-89b4c48554c5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "effc5908-526f-447d-a993-89b4c48554c5" (UID: "effc5908-526f-447d-a993-89b4c48554c5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 21:57:49.037033 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:49.037001 2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/effc5908-526f-447d-a993-89b4c48554c5-console-oauth-config\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:57:49.037033 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:49.037025 2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/effc5908-526f-447d-a993-89b4c48554c5-trusted-ca-bundle\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:57:49.037033 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:49.037034 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgm5b\" (UniqueName: \"kubernetes.io/projected/effc5908-526f-447d-a993-89b4c48554c5-kube-api-access-xgm5b\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:57:49.037247 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:49.037044 2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/effc5908-526f-447d-a993-89b4c48554c5-oauth-serving-cert\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:57:49.037247 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:49.037056 2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/effc5908-526f-447d-a993-89b4c48554c5-service-ca\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:57:49.037247 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:49.037065 2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/effc5908-526f-447d-a993-89b4c48554c5-console-config\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:57:49.037247 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:49.037074 2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/effc5908-526f-447d-a993-89b4c48554c5-console-serving-cert\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:57:49.643565 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:49.643543 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b94b5c75-v7x7g_effc5908-526f-447d-a993-89b4c48554c5/console/0.log" May 20 21:57:49.643885 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:49.643582 2571 generic.go:358] "Generic (PLEG): container finished" podID="effc5908-526f-447d-a993-89b4c48554c5" containerID="b3be0b247a763928f3f6ad9ef4f24455aec8d7f790b6b5f778450e450ae7f246" exitCode=2 May 20 21:57:49.643885 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:49.643612 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b94b5c75-v7x7g" event={"ID":"effc5908-526f-447d-a993-89b4c48554c5","Type":"ContainerDied","Data":"b3be0b247a763928f3f6ad9ef4f24455aec8d7f790b6b5f778450e450ae7f246"} May 20 21:57:49.643885 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:49.643632 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b94b5c75-v7x7g" event={"ID":"effc5908-526f-447d-a993-89b4c48554c5","Type":"ContainerDied","Data":"08111d1c56acecd7b70ad0da93bebd427b75efb59199abac40feb84702c1e58f"} May 20 21:57:49.643885 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:49.643670 2571 scope.go:117] "RemoveContainer" containerID="b3be0b247a763928f3f6ad9ef4f24455aec8d7f790b6b5f778450e450ae7f246" May 20 21:57:49.643885 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:49.643675 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b94b5c75-v7x7g" May 20 21:57:49.652688 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:49.652670 2571 scope.go:117] "RemoveContainer" containerID="b3be0b247a763928f3f6ad9ef4f24455aec8d7f790b6b5f778450e450ae7f246" May 20 21:57:49.652929 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:57:49.652911 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3be0b247a763928f3f6ad9ef4f24455aec8d7f790b6b5f778450e450ae7f246\": container with ID starting with b3be0b247a763928f3f6ad9ef4f24455aec8d7f790b6b5f778450e450ae7f246 not found: ID does not exist" containerID="b3be0b247a763928f3f6ad9ef4f24455aec8d7f790b6b5f778450e450ae7f246" May 20 21:57:49.652981 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:49.652937 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3be0b247a763928f3f6ad9ef4f24455aec8d7f790b6b5f778450e450ae7f246"} err="failed to get container status \"b3be0b247a763928f3f6ad9ef4f24455aec8d7f790b6b5f778450e450ae7f246\": rpc error: code = NotFound desc = could not find container \"b3be0b247a763928f3f6ad9ef4f24455aec8d7f790b6b5f778450e450ae7f246\": container with ID starting with b3be0b247a763928f3f6ad9ef4f24455aec8d7f790b6b5f778450e450ae7f246 not found: ID does not exist" May 20 21:57:49.664320 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:49.664293 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b94b5c75-v7x7g"] May 20 21:57:49.670834 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:49.670814 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b94b5c75-v7x7g"] May 20 21:57:51.628243 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:51.628210 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="effc5908-526f-447d-a993-89b4c48554c5" path="/var/lib/kubelet/pods/effc5908-526f-447d-a993-89b4c48554c5/volumes" May 20 21:57:52.615853 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:52.615823 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" May 20 21:57:54.253485 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.253451 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd"] May 20 21:57:54.254125 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.253753 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" podUID="3947e9ee-2357-486b-af81-2747b9380ee1" containerName="manager" containerID="cri-o://0483c5a4eb3be5f5251f66958ac116e2c4461cf63116e9ad1d31feee861db0e4" gracePeriod=2 May 20 21:57:54.255778 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.255743 2571 status_manager.go:895] "Failed to get status for pod" podUID="3947e9ee-2357-486b-af81-2747b9380ee1" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-ctmfd\" is forbidden: User \"system:node:ip-10-0-135-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-24.ec2.internal' and this object" May 20 21:57:54.256844 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.256822 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd"] May 20 21:57:54.284747 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.284716 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rgtcn"] May 20 21:57:54.285287 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.285269 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="effc5908-526f-447d-a993-89b4c48554c5" containerName="console" May 20 21:57:54.285373 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.285289 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="effc5908-526f-447d-a993-89b4c48554c5" containerName="console" May 20 21:57:54.285373 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.285327 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3947e9ee-2357-486b-af81-2747b9380ee1" containerName="manager" May 20 21:57:54.285373 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.285336 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3947e9ee-2357-486b-af81-2747b9380ee1" containerName="manager" May 20 21:57:54.285541 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.285416 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="3947e9ee-2357-486b-af81-2747b9380ee1" containerName="manager" May 20 21:57:54.285541 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.285432 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="effc5908-526f-447d-a993-89b4c48554c5" containerName="console" May 20 21:57:54.288969 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.288950 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rgtcn" May 20 21:57:54.300467 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.300441 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv"] May 20 21:57:54.300728 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.300706 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv" podUID="8e34bf16-d5e7-408e-827b-bec6edabccdd" containerName="manager" containerID="cri-o://562b291fec5992b08eb199dcc916df47e634cb5e91be85fe69b80fb5bcabfb79" gracePeriod=2 May 20 21:57:54.330840 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.330816 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv"] May 20 21:57:54.333219 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.333194 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rgtcn"] May 20 21:57:54.344256 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.344234 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fpncx"] May 20 21:57:54.344576 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.344564 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e34bf16-d5e7-408e-827b-bec6edabccdd" containerName="manager" May 20 21:57:54.344658 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.344577 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e34bf16-d5e7-408e-827b-bec6edabccdd" containerName="manager" May 20 21:57:54.344720 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.344672 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="8e34bf16-d5e7-408e-827b-bec6edabccdd" containerName="manager" May 20 21:57:54.347995 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.347975 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fpncx" May 20 21:57:54.349513 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.349480 2571 status_manager.go:895] "Failed to get status for pod" podUID="3947e9ee-2357-486b-af81-2747b9380ee1" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-ctmfd\" is forbidden: User \"system:node:ip-10-0-135-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-24.ec2.internal' and this object" May 20 21:57:54.368180 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.368154 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fpncx"] May 20 21:57:54.380968 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.380941 2571 status_manager.go:895] "Failed to get status for pod" podUID="8e34bf16-d5e7-408e-827b-bec6edabccdd" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv" err="pods \"limitador-operator-controller-manager-85c4996f8c-gl7jv\" is forbidden: User \"system:node:ip-10-0-135-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-24.ec2.internal' and this object" May 20 21:57:54.383035 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.383013 2571 status_manager.go:895] "Failed to get status for pod" podUID="3947e9ee-2357-486b-af81-2747b9380ee1" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-ctmfd\" is forbidden: User \"system:node:ip-10-0-135-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-24.ec2.internal' and this object" May 20 21:57:54.384361 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.384343 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t592l\" (UniqueName: \"kubernetes.io/projected/dac3a443-ac30-47b8-ab1b-57a42c841e6a-kube-api-access-t592l\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-rgtcn\" (UID: \"dac3a443-ac30-47b8-ab1b-57a42c841e6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rgtcn" May 20 21:57:54.384452 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.384383 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dac3a443-ac30-47b8-ab1b-57a42c841e6a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-rgtcn\" (UID: \"dac3a443-ac30-47b8-ab1b-57a42c841e6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rgtcn" May 20 21:57:54.485357 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.485329 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gspwf\" (UniqueName: \"kubernetes.io/projected/22bb1e9f-6873-4f5b-8670-3bafbc10ab1f-kube-api-access-gspwf\") pod \"limitador-operator-controller-manager-85c4996f8c-fpncx\" (UID: \"22bb1e9f-6873-4f5b-8670-3bafbc10ab1f\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fpncx" May 20 21:57:54.485471 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.485449 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t592l\" (UniqueName: \"kubernetes.io/projected/dac3a443-ac30-47b8-ab1b-57a42c841e6a-kube-api-access-t592l\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-rgtcn\" (UID: \"dac3a443-ac30-47b8-ab1b-57a42c841e6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rgtcn" May 20 21:57:54.485525 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.485510 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dac3a443-ac30-47b8-ab1b-57a42c841e6a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-rgtcn\" (UID: \"dac3a443-ac30-47b8-ab1b-57a42c841e6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rgtcn" May 20 21:57:54.485909 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.485890 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dac3a443-ac30-47b8-ab1b-57a42c841e6a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-rgtcn\" (UID: \"dac3a443-ac30-47b8-ab1b-57a42c841e6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rgtcn" May 20 21:57:54.496390 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.496368 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t592l\" (UniqueName: \"kubernetes.io/projected/dac3a443-ac30-47b8-ab1b-57a42c841e6a-kube-api-access-t592l\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-rgtcn\" (UID: \"dac3a443-ac30-47b8-ab1b-57a42c841e6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rgtcn" May 20 21:57:54.539428 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.539400 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" May 20 21:57:54.541998 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.541974 2571 status_manager.go:895] "Failed to get status for pod" podUID="8e34bf16-d5e7-408e-827b-bec6edabccdd" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv" err="pods \"limitador-operator-controller-manager-85c4996f8c-gl7jv\" is forbidden: User \"system:node:ip-10-0-135-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-24.ec2.internal' and this object" May 20 21:57:54.542731 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.542715 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv" May 20 21:57:54.544047 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.544027 2571 status_manager.go:895] "Failed to get status for pod" podUID="3947e9ee-2357-486b-af81-2747b9380ee1" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-ctmfd\" is forbidden: User \"system:node:ip-10-0-135-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-24.ec2.internal' and this object" May 20 21:57:54.546160 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.546142 2571 status_manager.go:895] "Failed to get status for pod" podUID="3947e9ee-2357-486b-af81-2747b9380ee1" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-ctmfd\" is forbidden: User \"system:node:ip-10-0-135-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-24.ec2.internal' and this object" May 20 21:57:54.548343 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.548325 2571 status_manager.go:895] "Failed to get status for pod" podUID="8e34bf16-d5e7-408e-827b-bec6edabccdd" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv" err="pods \"limitador-operator-controller-manager-85c4996f8c-gl7jv\" is forbidden: User \"system:node:ip-10-0-135-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-24.ec2.internal' and this object" May 20 21:57:54.586815 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.586782 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gspwf\" (UniqueName: \"kubernetes.io/projected/22bb1e9f-6873-4f5b-8670-3bafbc10ab1f-kube-api-access-gspwf\") pod \"limitador-operator-controller-manager-85c4996f8c-fpncx\" (UID: \"22bb1e9f-6873-4f5b-8670-3bafbc10ab1f\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fpncx" May 20 21:57:54.601925 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.601902 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gspwf\" (UniqueName: \"kubernetes.io/projected/22bb1e9f-6873-4f5b-8670-3bafbc10ab1f-kube-api-access-gspwf\") pod \"limitador-operator-controller-manager-85c4996f8c-fpncx\" (UID: \"22bb1e9f-6873-4f5b-8670-3bafbc10ab1f\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fpncx" May 20 21:57:54.664261 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.664234 2571 generic.go:358] "Generic (PLEG): container finished" podID="8e34bf16-d5e7-408e-827b-bec6edabccdd" containerID="562b291fec5992b08eb199dcc916df47e634cb5e91be85fe69b80fb5bcabfb79" exitCode=0 May 20 21:57:54.664369 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.664279 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv" May 20 21:57:54.664369 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.664337 2571 scope.go:117] "RemoveContainer" containerID="562b291fec5992b08eb199dcc916df47e634cb5e91be85fe69b80fb5bcabfb79" May 20 21:57:54.665597 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.665577 2571 generic.go:358] "Generic (PLEG): container finished" podID="3947e9ee-2357-486b-af81-2747b9380ee1" containerID="0483c5a4eb3be5f5251f66958ac116e2c4461cf63116e9ad1d31feee861db0e4" exitCode=0 May 20 21:57:54.665717 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.665627 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" May 20 21:57:54.666822 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.666800 2571 status_manager.go:895] "Failed to get status for pod" podUID="3947e9ee-2357-486b-af81-2747b9380ee1" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-ctmfd\" is forbidden: User \"system:node:ip-10-0-135-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-24.ec2.internal' and this object" May 20 21:57:54.668892 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.668869 2571 status_manager.go:895] "Failed to get status for pod" podUID="8e34bf16-d5e7-408e-827b-bec6edabccdd" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv" err="pods \"limitador-operator-controller-manager-85c4996f8c-gl7jv\" is forbidden: User \"system:node:ip-10-0-135-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-24.ec2.internal' and this object" May 20 21:57:54.670852 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.670827 2571 status_manager.go:895] "Failed to get status for pod" podUID="3947e9ee-2357-486b-af81-2747b9380ee1" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-ctmfd\" is forbidden: User \"system:node:ip-10-0-135-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-24.ec2.internal' and this object" May 20 21:57:54.673106 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.672979 2571 status_manager.go:895] "Failed to get status for pod" podUID="8e34bf16-d5e7-408e-827b-bec6edabccdd" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv" err="pods \"limitador-operator-controller-manager-85c4996f8c-gl7jv\" is forbidden: User \"system:node:ip-10-0-135-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-24.ec2.internal' and this object" May 20 21:57:54.673160 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.673107 2571 scope.go:117] "RemoveContainer" containerID="562b291fec5992b08eb199dcc916df47e634cb5e91be85fe69b80fb5bcabfb79" May 20 21:57:54.673343 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:57:54.673324 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"562b291fec5992b08eb199dcc916df47e634cb5e91be85fe69b80fb5bcabfb79\": container with ID starting with 562b291fec5992b08eb199dcc916df47e634cb5e91be85fe69b80fb5bcabfb79 not found: ID does not exist" containerID="562b291fec5992b08eb199dcc916df47e634cb5e91be85fe69b80fb5bcabfb79" May 20 21:57:54.673386 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.673350 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"562b291fec5992b08eb199dcc916df47e634cb5e91be85fe69b80fb5bcabfb79"} err="failed to get container status \"562b291fec5992b08eb199dcc916df47e634cb5e91be85fe69b80fb5bcabfb79\": rpc error: code = NotFound desc = could not find container \"562b291fec5992b08eb199dcc916df47e634cb5e91be85fe69b80fb5bcabfb79\": container with ID starting with 562b291fec5992b08eb199dcc916df47e634cb5e91be85fe69b80fb5bcabfb79 not found: ID does not exist" May 20 21:57:54.673386 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.673368 2571 scope.go:117] "RemoveContainer" containerID="0483c5a4eb3be5f5251f66958ac116e2c4461cf63116e9ad1d31feee861db0e4" May 20 21:57:54.677315 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.677295 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rgtcn" May 20 21:57:54.681089 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.681075 2571 scope.go:117] "RemoveContainer" containerID="0483c5a4eb3be5f5251f66958ac116e2c4461cf63116e9ad1d31feee861db0e4" May 20 21:57:54.681358 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:57:54.681340 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0483c5a4eb3be5f5251f66958ac116e2c4461cf63116e9ad1d31feee861db0e4\": container with ID starting with 0483c5a4eb3be5f5251f66958ac116e2c4461cf63116e9ad1d31feee861db0e4 not found: ID does not exist" containerID="0483c5a4eb3be5f5251f66958ac116e2c4461cf63116e9ad1d31feee861db0e4" May 20 21:57:54.681422 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.681363 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0483c5a4eb3be5f5251f66958ac116e2c4461cf63116e9ad1d31feee861db0e4"} err="failed to get container status \"0483c5a4eb3be5f5251f66958ac116e2c4461cf63116e9ad1d31feee861db0e4\": rpc error: code = NotFound desc = could not find container \"0483c5a4eb3be5f5251f66958ac116e2c4461cf63116e9ad1d31feee861db0e4\": container with ID starting with 0483c5a4eb3be5f5251f66958ac116e2c4461cf63116e9ad1d31feee861db0e4 not found: ID does not exist" May 20 21:57:54.683501 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.683480 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fpncx" May 20 21:57:54.687170 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.687151 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvh2d\" (UniqueName: \"kubernetes.io/projected/8e34bf16-d5e7-408e-827b-bec6edabccdd-kube-api-access-nvh2d\") pod \"8e34bf16-d5e7-408e-827b-bec6edabccdd\" (UID: \"8e34bf16-d5e7-408e-827b-bec6edabccdd\") " May 20 21:57:54.687307 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.687210 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3947e9ee-2357-486b-af81-2747b9380ee1-extensions-socket-volume\") pod \"3947e9ee-2357-486b-af81-2747b9380ee1\" (UID: \"3947e9ee-2357-486b-af81-2747b9380ee1\") " May 20 21:57:54.687307 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.687239 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsscv\" (UniqueName: \"kubernetes.io/projected/3947e9ee-2357-486b-af81-2747b9380ee1-kube-api-access-hsscv\") pod \"3947e9ee-2357-486b-af81-2747b9380ee1\" (UID: \"3947e9ee-2357-486b-af81-2747b9380ee1\") " May 20 21:57:54.687806 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.687771 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3947e9ee-2357-486b-af81-2747b9380ee1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3947e9ee-2357-486b-af81-2747b9380ee1" (UID: "3947e9ee-2357-486b-af81-2747b9380ee1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:57:54.689126 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.689106 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e34bf16-d5e7-408e-827b-bec6edabccdd-kube-api-access-nvh2d" (OuterVolumeSpecName: "kube-api-access-nvh2d") pod "8e34bf16-d5e7-408e-827b-bec6edabccdd" (UID: "8e34bf16-d5e7-408e-827b-bec6edabccdd"). InnerVolumeSpecName "kube-api-access-nvh2d". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:57:54.689588 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.689559 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3947e9ee-2357-486b-af81-2747b9380ee1-kube-api-access-hsscv" (OuterVolumeSpecName: "kube-api-access-hsscv") pod "3947e9ee-2357-486b-af81-2747b9380ee1" (UID: "3947e9ee-2357-486b-af81-2747b9380ee1"). InnerVolumeSpecName "kube-api-access-hsscv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:57:54.788200 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.788175 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvh2d\" (UniqueName: \"kubernetes.io/projected/8e34bf16-d5e7-408e-827b-bec6edabccdd-kube-api-access-nvh2d\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:57:54.788299 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.788203 2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3947e9ee-2357-486b-af81-2747b9380ee1-extensions-socket-volume\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:57:54.788299 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.788213 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsscv\" (UniqueName: \"kubernetes.io/projected/3947e9ee-2357-486b-af81-2747b9380ee1-kube-api-access-hsscv\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:57:54.827342 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.827314 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rgtcn"] May 20 21:57:54.828279 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:57:54.828254 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddac3a443_ac30_47b8_ab1b_57a42c841e6a.slice/crio-69d37fd4c9a320a454eb4ec4f15e8108d36a2c0b07f65e4361f2ce7729cbec98 WatchSource:0}: Error finding container 69d37fd4c9a320a454eb4ec4f15e8108d36a2c0b07f65e4361f2ce7729cbec98: Status 404 returned error can't find the container with id 69d37fd4c9a320a454eb4ec4f15e8108d36a2c0b07f65e4361f2ce7729cbec98 May 20 21:57:54.847000 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.846980 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fpncx"] May 20 21:57:54.849001 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:57:54.848976 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22bb1e9f_6873_4f5b_8670_3bafbc10ab1f.slice/crio-1d68e96564367febb34c254e6f6e46d2019b0ce9f013d0af8dd4ff151c74a466 WatchSource:0}: Error finding container 1d68e96564367febb34c254e6f6e46d2019b0ce9f013d0af8dd4ff151c74a466: Status 404 returned error can't find the container with id 1d68e96564367febb34c254e6f6e46d2019b0ce9f013d0af8dd4ff151c74a466 May 20 21:57:54.978121 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.978091 2571 status_manager.go:895] "Failed to get status for pod" podUID="3947e9ee-2357-486b-af81-2747b9380ee1" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-ctmfd\" is forbidden: User \"system:node:ip-10-0-135-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-24.ec2.internal' and this object" May 20 21:57:54.980201 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.980178 2571 status_manager.go:895] "Failed to get status for pod" podUID="8e34bf16-d5e7-408e-827b-bec6edabccdd" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv" err="pods \"limitador-operator-controller-manager-85c4996f8c-gl7jv\" is forbidden: User \"system:node:ip-10-0-135-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-24.ec2.internal' and this object" May 20 21:57:54.982416 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.982396 2571 status_manager.go:895] "Failed to get status for pod" podUID="8e34bf16-d5e7-408e-827b-bec6edabccdd" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gl7jv" err="pods \"limitador-operator-controller-manager-85c4996f8c-gl7jv\" is forbidden: User \"system:node:ip-10-0-135-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-24.ec2.internal' and this object" May 20 21:57:54.984499 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:54.984482 2571 status_manager.go:895] "Failed to get status for pod" podUID="3947e9ee-2357-486b-af81-2747b9380ee1" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ctmfd" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-ctmfd\" is forbidden: User \"system:node:ip-10-0-135-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-24.ec2.internal' and this object" May 20 21:57:55.628933 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:55.628900 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3947e9ee-2357-486b-af81-2747b9380ee1" path="/var/lib/kubelet/pods/3947e9ee-2357-486b-af81-2747b9380ee1/volumes" May 20 21:57:55.629374 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:55.629356 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e34bf16-d5e7-408e-827b-bec6edabccdd" path="/var/lib/kubelet/pods/8e34bf16-d5e7-408e-827b-bec6edabccdd/volumes" May 20 21:57:55.672235 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:55.672207 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fpncx" event={"ID":"22bb1e9f-6873-4f5b-8670-3bafbc10ab1f","Type":"ContainerStarted","Data":"b0d748ec24947871d8ec6fc2c3fc77d1bed865d5b94b96e57a1086a56b99cc24"} May 20 21:57:55.672397 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:55.672240 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fpncx" event={"ID":"22bb1e9f-6873-4f5b-8670-3bafbc10ab1f","Type":"ContainerStarted","Data":"1d68e96564367febb34c254e6f6e46d2019b0ce9f013d0af8dd4ff151c74a466"} May 20 21:57:55.672397 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:55.672257 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fpncx" May 20 21:57:55.674468 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:55.674439 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rgtcn" event={"ID":"dac3a443-ac30-47b8-ab1b-57a42c841e6a","Type":"ContainerStarted","Data":"e28bc6063182853a9c63a40b56aacfe883c0b31aee8f3e61b212e933efd7fcf4"} May 20 21:57:55.674592 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:55.674468 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rgtcn" event={"ID":"dac3a443-ac30-47b8-ab1b-57a42c841e6a","Type":"ContainerStarted","Data":"69d37fd4c9a320a454eb4ec4f15e8108d36a2c0b07f65e4361f2ce7729cbec98"} May 20 21:57:55.674592 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:55.674508 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rgtcn" May 20 21:57:55.690887 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:55.690845 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fpncx" podStartSLOduration=1.690832512 podStartE2EDuration="1.690832512s" podCreationTimestamp="2026-05-20 21:57:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:57:55.688329593 +0000 UTC m=+586.618146338" watchObservedRunningTime="2026-05-20 21:57:55.690832512 +0000 UTC m=+586.620649320" May 20 21:57:55.709375 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:57:55.709335 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rgtcn" podStartSLOduration=1.709323544 podStartE2EDuration="1.709323544s" podCreationTimestamp="2026-05-20 21:57:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:57:55.706346993 +0000 UTC m=+586.636163737" watchObservedRunningTime="2026-05-20 21:57:55.709323544 +0000 UTC m=+586.639140286" May 20 21:58:06.680406 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:06.680368 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fpncx" May 20 21:58:06.680849 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:06.680491 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rgtcn" May 20 21:58:09.557043 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:09.557011 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/2.log" May 20 21:58:09.557043 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:09.557039 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/2.log" May 20 21:58:09.769215 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:09.769181 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rgtcn"] May 20 21:58:09.769434 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:09.769394 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rgtcn" podUID="dac3a443-ac30-47b8-ab1b-57a42c841e6a" containerName="manager" containerID="cri-o://e28bc6063182853a9c63a40b56aacfe883c0b31aee8f3e61b212e933efd7fcf4" gracePeriod=10 May 20 21:58:10.027972 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.027950 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rgtcn" May 20 21:58:10.037068 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.037042 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zwhb8"] May 20 21:58:10.037452 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.037436 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dac3a443-ac30-47b8-ab1b-57a42c841e6a" containerName="manager" May 20 21:58:10.037534 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.037455 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dac3a443-ac30-47b8-ab1b-57a42c841e6a" containerName="manager" May 20 21:58:10.037593 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.037543 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="dac3a443-ac30-47b8-ab1b-57a42c841e6a" containerName="manager" May 20 21:58:10.041295 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.041276 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zwhb8" May 20 21:58:10.051317 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.051294 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zwhb8"] May 20 21:58:10.127701 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.127675 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t592l\" (UniqueName: \"kubernetes.io/projected/dac3a443-ac30-47b8-ab1b-57a42c841e6a-kube-api-access-t592l\") pod \"dac3a443-ac30-47b8-ab1b-57a42c841e6a\" (UID: \"dac3a443-ac30-47b8-ab1b-57a42c841e6a\") " May 20 21:58:10.127844 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.127802 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dac3a443-ac30-47b8-ab1b-57a42c841e6a-extensions-socket-volume\") pod \"dac3a443-ac30-47b8-ab1b-57a42c841e6a\" (UID: \"dac3a443-ac30-47b8-ab1b-57a42c841e6a\") " May 20 21:58:10.128055 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.128037 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed8af764-6851-41b9-9674-3693c09bc877-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zwhb8\" (UID: \"ed8af764-6851-41b9-9674-3693c09bc877\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zwhb8" May 20 21:58:10.128156 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.128071 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7phhc\" (UniqueName: \"kubernetes.io/projected/ed8af764-6851-41b9-9674-3693c09bc877-kube-api-access-7phhc\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zwhb8\" (UID: \"ed8af764-6851-41b9-9674-3693c09bc877\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zwhb8" May 20 21:58:10.128156 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.128115 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dac3a443-ac30-47b8-ab1b-57a42c841e6a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dac3a443-ac30-47b8-ab1b-57a42c841e6a" (UID: "dac3a443-ac30-47b8-ab1b-57a42c841e6a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:58:10.129674 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.129651 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dac3a443-ac30-47b8-ab1b-57a42c841e6a-kube-api-access-t592l" (OuterVolumeSpecName: "kube-api-access-t592l") pod "dac3a443-ac30-47b8-ab1b-57a42c841e6a" (UID: "dac3a443-ac30-47b8-ab1b-57a42c841e6a"). InnerVolumeSpecName "kube-api-access-t592l". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:58:10.229148 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.229094 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed8af764-6851-41b9-9674-3693c09bc877-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zwhb8\" (UID: \"ed8af764-6851-41b9-9674-3693c09bc877\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zwhb8" May 20 21:58:10.229148 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.229124 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7phhc\" (UniqueName: \"kubernetes.io/projected/ed8af764-6851-41b9-9674-3693c09bc877-kube-api-access-7phhc\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zwhb8\" (UID: \"ed8af764-6851-41b9-9674-3693c09bc877\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zwhb8" May 20 21:58:10.229284 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.229162 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t592l\" (UniqueName: \"kubernetes.io/projected/dac3a443-ac30-47b8-ab1b-57a42c841e6a-kube-api-access-t592l\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:58:10.229284 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.229172 2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dac3a443-ac30-47b8-ab1b-57a42c841e6a-extensions-socket-volume\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:58:10.229425 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.229408 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed8af764-6851-41b9-9674-3693c09bc877-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zwhb8\" (UID: \"ed8af764-6851-41b9-9674-3693c09bc877\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zwhb8" May 20 21:58:10.238184 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.238165 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7phhc\" (UniqueName: \"kubernetes.io/projected/ed8af764-6851-41b9-9674-3693c09bc877-kube-api-access-7phhc\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zwhb8\" (UID: \"ed8af764-6851-41b9-9674-3693c09bc877\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zwhb8" May 20 21:58:10.351267 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.351234 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zwhb8" May 20 21:58:10.481739 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.481712 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zwhb8"] May 20 21:58:10.483218 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:58:10.483190 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded8af764_6851_41b9_9674_3693c09bc877.slice/crio-3ab10ec98ddce8adc8886a627ea6c1191a540d832b5c78cd914c3ac328e922c8 WatchSource:0}: Error finding container 3ab10ec98ddce8adc8886a627ea6c1191a540d832b5c78cd914c3ac328e922c8: Status 404 returned error can't find the container with id 3ab10ec98ddce8adc8886a627ea6c1191a540d832b5c78cd914c3ac328e922c8 May 20 21:58:10.730612 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.730522 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zwhb8" event={"ID":"ed8af764-6851-41b9-9674-3693c09bc877","Type":"ContainerStarted","Data":"d3db9225b8d610542354e3e0955b12965931647b5dceab1d1eec72c139fdaaaf"} May 20 21:58:10.730612 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.730561 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zwhb8" event={"ID":"ed8af764-6851-41b9-9674-3693c09bc877","Type":"ContainerStarted","Data":"3ab10ec98ddce8adc8886a627ea6c1191a540d832b5c78cd914c3ac328e922c8"} May 20 21:58:10.730612 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.730601 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zwhb8" May 20 21:58:10.731838 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.731811 2571 generic.go:358] "Generic (PLEG): container finished" podID="dac3a443-ac30-47b8-ab1b-57a42c841e6a" containerID="e28bc6063182853a9c63a40b56aacfe883c0b31aee8f3e61b212e933efd7fcf4" exitCode=0 May 20 21:58:10.731940 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.731875 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rgtcn" event={"ID":"dac3a443-ac30-47b8-ab1b-57a42c841e6a","Type":"ContainerDied","Data":"e28bc6063182853a9c63a40b56aacfe883c0b31aee8f3e61b212e933efd7fcf4"} May 20 21:58:10.731940 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.731899 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rgtcn" event={"ID":"dac3a443-ac30-47b8-ab1b-57a42c841e6a","Type":"ContainerDied","Data":"69d37fd4c9a320a454eb4ec4f15e8108d36a2c0b07f65e4361f2ce7729cbec98"} May 20 21:58:10.731940 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.731913 2571 scope.go:117] "RemoveContainer" containerID="e28bc6063182853a9c63a40b56aacfe883c0b31aee8f3e61b212e933efd7fcf4" May 20 21:58:10.732047 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.731879 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rgtcn" May 20 21:58:10.741421 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.741397 2571 scope.go:117] "RemoveContainer" containerID="e28bc6063182853a9c63a40b56aacfe883c0b31aee8f3e61b212e933efd7fcf4" May 20 21:58:10.741683 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:58:10.741657 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e28bc6063182853a9c63a40b56aacfe883c0b31aee8f3e61b212e933efd7fcf4\": container with ID starting with e28bc6063182853a9c63a40b56aacfe883c0b31aee8f3e61b212e933efd7fcf4 not found: ID does not exist" containerID="e28bc6063182853a9c63a40b56aacfe883c0b31aee8f3e61b212e933efd7fcf4" May 20 21:58:10.741757 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.741690 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e28bc6063182853a9c63a40b56aacfe883c0b31aee8f3e61b212e933efd7fcf4"} err="failed to get container status \"e28bc6063182853a9c63a40b56aacfe883c0b31aee8f3e61b212e933efd7fcf4\": rpc error: code = NotFound desc = could not find container \"e28bc6063182853a9c63a40b56aacfe883c0b31aee8f3e61b212e933efd7fcf4\": container with ID starting with e28bc6063182853a9c63a40b56aacfe883c0b31aee8f3e61b212e933efd7fcf4 not found: ID does not exist" May 20 21:58:10.758004 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.757949 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zwhb8" podStartSLOduration=0.757938052 podStartE2EDuration="757.938052ms" podCreationTimestamp="2026-05-20 21:58:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:58:10.755603463 +0000 UTC m=+601.685420206" watchObservedRunningTime="2026-05-20 21:58:10.757938052 +0000 UTC m=+601.687754839" May 20 21:58:10.776089 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.776065 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rgtcn"] May 20 21:58:10.779536 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:10.779516 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rgtcn"] May 20 21:58:11.629118 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:11.629084 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dac3a443-ac30-47b8-ab1b-57a42c841e6a" path="/var/lib/kubelet/pods/dac3a443-ac30-47b8-ab1b-57a42c841e6a/volumes" May 20 21:58:21.739342 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:21.739312 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zwhb8" May 20 21:58:25.961093 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:25.961063 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv"] May 20 21:58:25.963622 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:25.963597 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:25.967721 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:25.967701 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-glt9k\"" May 20 21:58:25.977547 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:25.977523 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv"] May 20 21:58:26.054169 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.054139 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0841e57f-0583-4c58-9cd5-8257923b24fc-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.054169 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.054170 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0841e57f-0583-4c58-9cd5-8257923b24fc-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.054352 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.054194 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0841e57f-0583-4c58-9cd5-8257923b24fc-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.054352 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.054235 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0841e57f-0583-4c58-9cd5-8257923b24fc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.054352 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.054265 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0841e57f-0583-4c58-9cd5-8257923b24fc-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.054352 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.054300 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr8rh\" (UniqueName: \"kubernetes.io/projected/0841e57f-0583-4c58-9cd5-8257923b24fc-kube-api-access-kr8rh\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.054569 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.054383 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0841e57f-0583-4c58-9cd5-8257923b24fc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.054569 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.054464 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0841e57f-0583-4c58-9cd5-8257923b24fc-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.054569 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.054537 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0841e57f-0583-4c58-9cd5-8257923b24fc-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.156005 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.155970 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0841e57f-0583-4c58-9cd5-8257923b24fc-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.156005 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.156009 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0841e57f-0583-4c58-9cd5-8257923b24fc-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.156214 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.156034 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0841e57f-0583-4c58-9cd5-8257923b24fc-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.156214 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.156071 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0841e57f-0583-4c58-9cd5-8257923b24fc-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.156214 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.156105 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0841e57f-0583-4c58-9cd5-8257923b24fc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.156214 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.156143 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0841e57f-0583-4c58-9cd5-8257923b24fc-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.156214 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.156183 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kr8rh\" (UniqueName: \"kubernetes.io/projected/0841e57f-0583-4c58-9cd5-8257923b24fc-kube-api-access-kr8rh\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.156493 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.156216 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0841e57f-0583-4c58-9cd5-8257923b24fc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.156493 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.156266 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0841e57f-0583-4c58-9cd5-8257923b24fc-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.156493 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.156398 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0841e57f-0583-4c58-9cd5-8257923b24fc-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.156493 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.156452 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0841e57f-0583-4c58-9cd5-8257923b24fc-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.156735 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.156665 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0841e57f-0583-4c58-9cd5-8257923b24fc-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.156801 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.156768 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0841e57f-0583-4c58-9cd5-8257923b24fc-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.156950 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.156925 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0841e57f-0583-4c58-9cd5-8257923b24fc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.158235 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.158219 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0841e57f-0583-4c58-9cd5-8257923b24fc-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.158762 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.158742 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0841e57f-0583-4c58-9cd5-8257923b24fc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.167018 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.166987 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr8rh\" (UniqueName: \"kubernetes.io/projected/0841e57f-0583-4c58-9cd5-8257923b24fc-kube-api-access-kr8rh\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.167120 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.166992 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0841e57f-0583-4c58-9cd5-8257923b24fc-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-65jrv\" (UID: \"0841e57f-0583-4c58-9cd5-8257923b24fc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.275755 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.275693 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:26.408401 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.408377 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv"] May 20 21:58:26.410338 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:58:26.410305 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0841e57f_0583_4c58_9cd5_8257923b24fc.slice/crio-c0981ed266315630719c8a35952cb8539add7185ef2549628d3d9ffbfa8e705b WatchSource:0}: Error finding container c0981ed266315630719c8a35952cb8539add7185ef2549628d3d9ffbfa8e705b: Status 404 returned error can't find the container with id c0981ed266315630719c8a35952cb8539add7185ef2549628d3d9ffbfa8e705b May 20 21:58:26.412055 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.412037 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 21:58:26.412424 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.412392 2571 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 20 21:58:26.412478 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.412450 2571 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 20 21:58:26.412528 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.412481 2571 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} May 20 21:58:26.793684 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.793626 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" event={"ID":"0841e57f-0583-4c58-9cd5-8257923b24fc","Type":"ContainerStarted","Data":"92440c3992cb6ba5069a43cb98f2cd8e523a8cff49ecd33d91052224ce818bdb"} May 20 21:58:26.793684 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.793686 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" event={"ID":"0841e57f-0583-4c58-9cd5-8257923b24fc","Type":"ContainerStarted","Data":"c0981ed266315630719c8a35952cb8539add7185ef2549628d3d9ffbfa8e705b"} May 20 21:58:26.846168 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:26.846123 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" podStartSLOduration=1.846108921 podStartE2EDuration="1.846108921s" podCreationTimestamp="2026-05-20 21:58:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:58:26.845293605 +0000 UTC m=+617.775110382" watchObservedRunningTime="2026-05-20 21:58:26.846108921 +0000 UTC m=+617.775925733" May 20 21:58:27.276496 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:27.276462 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:27.281086 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:27.281064 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:27.798919 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:27.798891 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:27.799846 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:27.799825 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-65jrv" May 20 21:58:44.746248 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:44.746212 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-bbkrc"] May 20 21:58:44.748862 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:44.748839 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-bbkrc" May 20 21:58:44.751333 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:44.751311 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-v9t8q\"" May 20 21:58:44.755486 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:44.755461 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-bbkrc"] May 20 21:58:44.810581 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:44.810557 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww9jg\" (UniqueName: \"kubernetes.io/projected/7766eab8-96a7-41d7-a399-ac9ed047d7f3-kube-api-access-ww9jg\") pod \"authorino-f99f4b5cd-bbkrc\" (UID: \"7766eab8-96a7-41d7-a399-ac9ed047d7f3\") " pod="kuadrant-system/authorino-f99f4b5cd-bbkrc" May 20 21:58:44.912076 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:44.912048 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ww9jg\" (UniqueName: \"kubernetes.io/projected/7766eab8-96a7-41d7-a399-ac9ed047d7f3-kube-api-access-ww9jg\") pod \"authorino-f99f4b5cd-bbkrc\" (UID: \"7766eab8-96a7-41d7-a399-ac9ed047d7f3\") " pod="kuadrant-system/authorino-f99f4b5cd-bbkrc" May 20 21:58:44.918864 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:44.918839 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-9qm2z"] May 20 21:58:44.920906 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:44.920886 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww9jg\" (UniqueName: \"kubernetes.io/projected/7766eab8-96a7-41d7-a399-ac9ed047d7f3-kube-api-access-ww9jg\") pod \"authorino-f99f4b5cd-bbkrc\" (UID: \"7766eab8-96a7-41d7-a399-ac9ed047d7f3\") " pod="kuadrant-system/authorino-f99f4b5cd-bbkrc" May 20 21:58:44.928674 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:44.928631 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-9qm2z"] May 20 21:58:44.928790 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:44.928759 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-9qm2z" May 20 21:58:45.013092 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:45.013025 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg54w\" (UniqueName: \"kubernetes.io/projected/46066a2f-80a8-4336-ae30-791ce913dcd4-kube-api-access-wg54w\") pod \"authorino-7498df8756-9qm2z\" (UID: \"46066a2f-80a8-4336-ae30-791ce913dcd4\") " pod="kuadrant-system/authorino-7498df8756-9qm2z" May 20 21:58:45.059419 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:45.059400 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-bbkrc" May 20 21:58:45.114209 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:45.114172 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wg54w\" (UniqueName: \"kubernetes.io/projected/46066a2f-80a8-4336-ae30-791ce913dcd4-kube-api-access-wg54w\") pod \"authorino-7498df8756-9qm2z\" (UID: \"46066a2f-80a8-4336-ae30-791ce913dcd4\") " pod="kuadrant-system/authorino-7498df8756-9qm2z" May 20 21:58:45.125759 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:45.125730 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg54w\" (UniqueName: \"kubernetes.io/projected/46066a2f-80a8-4336-ae30-791ce913dcd4-kube-api-access-wg54w\") pod \"authorino-7498df8756-9qm2z\" (UID: \"46066a2f-80a8-4336-ae30-791ce913dcd4\") " pod="kuadrant-system/authorino-7498df8756-9qm2z" May 20 21:58:45.187531 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:45.187504 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-bbkrc"] May 20 21:58:45.188522 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:58:45.188496 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7766eab8_96a7_41d7_a399_ac9ed047d7f3.slice/crio-b6bff7be64f667adcd42aa1ec9c78404fd0db78dd299ede9bcc2bb85127634a1 WatchSource:0}: Error finding container b6bff7be64f667adcd42aa1ec9c78404fd0db78dd299ede9bcc2bb85127634a1: Status 404 returned error can't find the container with id b6bff7be64f667adcd42aa1ec9c78404fd0db78dd299ede9bcc2bb85127634a1 May 20 21:58:45.238016 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:45.237997 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-9qm2z" May 20 21:58:45.377944 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:45.377916 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-9qm2z"] May 20 21:58:45.379201 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:58:45.379174 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46066a2f_80a8_4336_ae30_791ce913dcd4.slice/crio-79945f591ff374cfef8f248a6917911c094c0962d5565c57b4ff0f69485f299f WatchSource:0}: Error finding container 79945f591ff374cfef8f248a6917911c094c0962d5565c57b4ff0f69485f299f: Status 404 returned error can't find the container with id 79945f591ff374cfef8f248a6917911c094c0962d5565c57b4ff0f69485f299f May 20 21:58:45.870531 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:45.870463 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-9qm2z" event={"ID":"46066a2f-80a8-4336-ae30-791ce913dcd4","Type":"ContainerStarted","Data":"79945f591ff374cfef8f248a6917911c094c0962d5565c57b4ff0f69485f299f"} May 20 21:58:45.873112 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:45.873056 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-bbkrc" event={"ID":"7766eab8-96a7-41d7-a399-ac9ed047d7f3","Type":"ContainerStarted","Data":"b6bff7be64f667adcd42aa1ec9c78404fd0db78dd299ede9bcc2bb85127634a1"} May 20 21:58:48.888884 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:48.888841 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-bbkrc" event={"ID":"7766eab8-96a7-41d7-a399-ac9ed047d7f3","Type":"ContainerStarted","Data":"b4c02502e6e82f75adc0aeecc674c91a8e9277279495e6f8aa5e6fe380d460ad"} May 20 21:58:48.890241 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:48.890219 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-9qm2z" event={"ID":"46066a2f-80a8-4336-ae30-791ce913dcd4","Type":"ContainerStarted","Data":"56b50ddc5dcc845152b8fdee42eefdfe9a99996d715c6f749f6951c782e04225"} May 20 21:58:48.906182 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:48.906137 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-bbkrc" podStartSLOduration=1.603877306 podStartE2EDuration="4.906123806s" podCreationTimestamp="2026-05-20 21:58:44 +0000 UTC" firstStartedPulling="2026-05-20 21:58:45.189859013 +0000 UTC m=+636.119675734" lastFinishedPulling="2026-05-20 21:58:48.492105499 +0000 UTC m=+639.421922234" observedRunningTime="2026-05-20 21:58:48.904066074 +0000 UTC m=+639.833882819" watchObservedRunningTime="2026-05-20 21:58:48.906123806 +0000 UTC m=+639.835940546" May 20 21:58:48.922159 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:48.922108 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-9qm2z" podStartSLOduration=1.806750512 podStartE2EDuration="4.922090337s" podCreationTimestamp="2026-05-20 21:58:44 +0000 UTC" firstStartedPulling="2026-05-20 21:58:45.380548767 +0000 UTC m=+636.310365490" lastFinishedPulling="2026-05-20 21:58:48.495888594 +0000 UTC m=+639.425705315" observedRunningTime="2026-05-20 21:58:48.91816433 +0000 UTC m=+639.847981075" watchObservedRunningTime="2026-05-20 21:58:48.922090337 +0000 UTC m=+639.851907081" May 20 21:58:48.953043 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:48.953014 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-bbkrc"] May 20 21:58:50.898982 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:50.898936 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-bbkrc" podUID="7766eab8-96a7-41d7-a399-ac9ed047d7f3" containerName="authorino" containerID="cri-o://b4c02502e6e82f75adc0aeecc674c91a8e9277279495e6f8aa5e6fe380d460ad" gracePeriod=30 May 20 21:58:51.139947 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:51.139923 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-bbkrc" May 20 21:58:51.281046 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:51.280971 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ww9jg\" (UniqueName: \"kubernetes.io/projected/7766eab8-96a7-41d7-a399-ac9ed047d7f3-kube-api-access-ww9jg\") pod \"7766eab8-96a7-41d7-a399-ac9ed047d7f3\" (UID: \"7766eab8-96a7-41d7-a399-ac9ed047d7f3\") " May 20 21:58:51.282986 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:51.282956 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7766eab8-96a7-41d7-a399-ac9ed047d7f3-kube-api-access-ww9jg" (OuterVolumeSpecName: "kube-api-access-ww9jg") pod "7766eab8-96a7-41d7-a399-ac9ed047d7f3" (UID: "7766eab8-96a7-41d7-a399-ac9ed047d7f3"). InnerVolumeSpecName "kube-api-access-ww9jg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:58:51.381689 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:51.381663 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ww9jg\" (UniqueName: \"kubernetes.io/projected/7766eab8-96a7-41d7-a399-ac9ed047d7f3-kube-api-access-ww9jg\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:58:51.903585 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:51.903510 2571 generic.go:358] "Generic (PLEG): container finished" podID="7766eab8-96a7-41d7-a399-ac9ed047d7f3" containerID="b4c02502e6e82f75adc0aeecc674c91a8e9277279495e6f8aa5e6fe380d460ad" exitCode=0 May 20 21:58:51.903585 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:51.903567 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-bbkrc" May 20 21:58:51.904038 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:51.903585 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-bbkrc" event={"ID":"7766eab8-96a7-41d7-a399-ac9ed047d7f3","Type":"ContainerDied","Data":"b4c02502e6e82f75adc0aeecc674c91a8e9277279495e6f8aa5e6fe380d460ad"} May 20 21:58:51.904038 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:51.903609 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-bbkrc" event={"ID":"7766eab8-96a7-41d7-a399-ac9ed047d7f3","Type":"ContainerDied","Data":"b6bff7be64f667adcd42aa1ec9c78404fd0db78dd299ede9bcc2bb85127634a1"} May 20 21:58:51.904038 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:51.903623 2571 scope.go:117] "RemoveContainer" containerID="b4c02502e6e82f75adc0aeecc674c91a8e9277279495e6f8aa5e6fe380d460ad" May 20 21:58:51.915201 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:51.914902 2571 scope.go:117] "RemoveContainer" containerID="b4c02502e6e82f75adc0aeecc674c91a8e9277279495e6f8aa5e6fe380d460ad" May 20 21:58:51.915325 ip-10-0-135-24 kubenswrapper[2571]: E0520 21:58:51.915283 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4c02502e6e82f75adc0aeecc674c91a8e9277279495e6f8aa5e6fe380d460ad\": container with ID starting with b4c02502e6e82f75adc0aeecc674c91a8e9277279495e6f8aa5e6fe380d460ad not found: ID does not exist" containerID="b4c02502e6e82f75adc0aeecc674c91a8e9277279495e6f8aa5e6fe380d460ad" May 20 21:58:51.915410 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:51.915318 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4c02502e6e82f75adc0aeecc674c91a8e9277279495e6f8aa5e6fe380d460ad"} err="failed to get container status \"b4c02502e6e82f75adc0aeecc674c91a8e9277279495e6f8aa5e6fe380d460ad\": rpc error: code = NotFound desc = could not find container \"b4c02502e6e82f75adc0aeecc674c91a8e9277279495e6f8aa5e6fe380d460ad\": container with ID starting with b4c02502e6e82f75adc0aeecc674c91a8e9277279495e6f8aa5e6fe380d460ad not found: ID does not exist" May 20 21:58:51.919681 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:51.919657 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-bbkrc"] May 20 21:58:51.923185 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:51.923163 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-bbkrc"] May 20 21:58:53.629028 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:58:53.628995 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7766eab8-96a7-41d7-a399-ac9ed047d7f3" path="/var/lib/kubelet/pods/7766eab8-96a7-41d7-a399-ac9ed047d7f3/volumes" May 20 21:59:16.386138 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:16.386105 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r"] May 20 21:59:16.386597 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:16.386481 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7766eab8-96a7-41d7-a399-ac9ed047d7f3" containerName="authorino" May 20 21:59:16.386597 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:16.386491 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7766eab8-96a7-41d7-a399-ac9ed047d7f3" containerName="authorino" May 20 21:59:16.386597 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:16.386549 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="7766eab8-96a7-41d7-a399-ac9ed047d7f3" containerName="authorino" May 20 21:59:16.392018 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:16.391998 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r" May 20 21:59:16.394933 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:16.394906 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 20 21:59:16.394933 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:16.394929 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lgzrt\"" May 20 21:59:16.395151 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:16.394908 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 20 21:59:16.396686 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:16.396664 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r"] May 20 21:59:16.479844 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:16.479810 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjrp5\" (UniqueName: \"kubernetes.io/projected/cad3d381-6fb1-48d5-bc92-5be839431bcb-kube-api-access-fjrp5\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r\" (UID: \"cad3d381-6fb1-48d5-bc92-5be839431bcb\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r" May 20 21:59:16.479986 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:16.479880 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cad3d381-6fb1-48d5-bc92-5be839431bcb-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r\" (UID: \"cad3d381-6fb1-48d5-bc92-5be839431bcb\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r" May 20 21:59:16.479986 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:16.479936 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cad3d381-6fb1-48d5-bc92-5be839431bcb-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r\" (UID: \"cad3d381-6fb1-48d5-bc92-5be839431bcb\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r" May 20 21:59:16.580964 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:16.580932 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fjrp5\" (UniqueName: \"kubernetes.io/projected/cad3d381-6fb1-48d5-bc92-5be839431bcb-kube-api-access-fjrp5\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r\" (UID: \"cad3d381-6fb1-48d5-bc92-5be839431bcb\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r" May 20 21:59:16.581108 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:16.580992 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cad3d381-6fb1-48d5-bc92-5be839431bcb-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r\" (UID: \"cad3d381-6fb1-48d5-bc92-5be839431bcb\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r" May 20 21:59:16.581108 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:16.581048 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cad3d381-6fb1-48d5-bc92-5be839431bcb-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r\" (UID: \"cad3d381-6fb1-48d5-bc92-5be839431bcb\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r" May 20 21:59:16.581321 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:16.581301 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cad3d381-6fb1-48d5-bc92-5be839431bcb-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r\" (UID: \"cad3d381-6fb1-48d5-bc92-5be839431bcb\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r" May 20 21:59:16.581359 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:16.581343 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cad3d381-6fb1-48d5-bc92-5be839431bcb-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r\" (UID: \"cad3d381-6fb1-48d5-bc92-5be839431bcb\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r" May 20 21:59:16.589708 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:16.589683 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjrp5\" (UniqueName: \"kubernetes.io/projected/cad3d381-6fb1-48d5-bc92-5be839431bcb-kube-api-access-fjrp5\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r\" (UID: \"cad3d381-6fb1-48d5-bc92-5be839431bcb\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r" May 20 21:59:16.702093 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:16.702021 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r" May 20 21:59:16.833389 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:16.833365 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r"] May 20 21:59:16.835416 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:59:16.835389 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad3d381_6fb1_48d5_bc92_5be839431bcb.slice/crio-4cb1f90dcf147446b013a99b121f094907ab64abde2afe014815561c95b83dd5 WatchSource:0}: Error finding container 4cb1f90dcf147446b013a99b121f094907ab64abde2afe014815561c95b83dd5: Status 404 returned error can't find the container with id 4cb1f90dcf147446b013a99b121f094907ab64abde2afe014815561c95b83dd5 May 20 21:59:17.007563 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:17.007487 2571 generic.go:358] "Generic (PLEG): container finished" podID="cad3d381-6fb1-48d5-bc92-5be839431bcb" containerID="cbc13cd12ea6dc2648036fa0ac4ae9134524aa72c53a4f6c7cba9b7d35e6a7ed" exitCode=0 May 20 21:59:17.007713 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:17.007564 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r" event={"ID":"cad3d381-6fb1-48d5-bc92-5be839431bcb","Type":"ContainerDied","Data":"cbc13cd12ea6dc2648036fa0ac4ae9134524aa72c53a4f6c7cba9b7d35e6a7ed"} May 20 21:59:17.007713 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:17.007608 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r" event={"ID":"cad3d381-6fb1-48d5-bc92-5be839431bcb","Type":"ContainerStarted","Data":"4cb1f90dcf147446b013a99b121f094907ab64abde2afe014815561c95b83dd5"} May 20 21:59:18.013562 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:18.013522 2571 generic.go:358] "Generic (PLEG): container finished" podID="cad3d381-6fb1-48d5-bc92-5be839431bcb" containerID="5adc79aa52b389b6507873e328dbfc1f10772a33f4dde6fbb9d2c07e44b087b5" exitCode=0 May 20 21:59:18.014124 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:18.013589 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r" event={"ID":"cad3d381-6fb1-48d5-bc92-5be839431bcb","Type":"ContainerDied","Data":"5adc79aa52b389b6507873e328dbfc1f10772a33f4dde6fbb9d2c07e44b087b5"} May 20 21:59:19.019755 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:19.019721 2571 generic.go:358] "Generic (PLEG): container finished" podID="cad3d381-6fb1-48d5-bc92-5be839431bcb" containerID="f0b3287132cfb5a6405745c7c332336b544141069e8691aa25f1b548b5028b0b" exitCode=0 May 20 21:59:19.020135 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:19.019806 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r" event={"ID":"cad3d381-6fb1-48d5-bc92-5be839431bcb","Type":"ContainerDied","Data":"f0b3287132cfb5a6405745c7c332336b544141069e8691aa25f1b548b5028b0b"} May 20 21:59:20.165716 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:20.165686 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r" May 20 21:59:20.212559 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:20.212528 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjrp5\" (UniqueName: \"kubernetes.io/projected/cad3d381-6fb1-48d5-bc92-5be839431bcb-kube-api-access-fjrp5\") pod \"cad3d381-6fb1-48d5-bc92-5be839431bcb\" (UID: \"cad3d381-6fb1-48d5-bc92-5be839431bcb\") " May 20 21:59:20.212705 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:20.212576 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cad3d381-6fb1-48d5-bc92-5be839431bcb-util\") pod \"cad3d381-6fb1-48d5-bc92-5be839431bcb\" (UID: \"cad3d381-6fb1-48d5-bc92-5be839431bcb\") " May 20 21:59:20.212760 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:20.212711 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cad3d381-6fb1-48d5-bc92-5be839431bcb-bundle\") pod \"cad3d381-6fb1-48d5-bc92-5be839431bcb\" (UID: \"cad3d381-6fb1-48d5-bc92-5be839431bcb\") " May 20 21:59:20.213183 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:20.213160 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cad3d381-6fb1-48d5-bc92-5be839431bcb-bundle" (OuterVolumeSpecName: "bundle") pod "cad3d381-6fb1-48d5-bc92-5be839431bcb" (UID: "cad3d381-6fb1-48d5-bc92-5be839431bcb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:59:20.214608 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:20.214586 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cad3d381-6fb1-48d5-bc92-5be839431bcb-kube-api-access-fjrp5" (OuterVolumeSpecName: "kube-api-access-fjrp5") pod "cad3d381-6fb1-48d5-bc92-5be839431bcb" (UID: "cad3d381-6fb1-48d5-bc92-5be839431bcb"). InnerVolumeSpecName "kube-api-access-fjrp5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:59:20.218460 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:20.218432 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cad3d381-6fb1-48d5-bc92-5be839431bcb-util" (OuterVolumeSpecName: "util") pod "cad3d381-6fb1-48d5-bc92-5be839431bcb" (UID: "cad3d381-6fb1-48d5-bc92-5be839431bcb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:59:20.313668 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:20.313621 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjrp5\" (UniqueName: \"kubernetes.io/projected/cad3d381-6fb1-48d5-bc92-5be839431bcb-kube-api-access-fjrp5\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:59:20.313762 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:20.313670 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cad3d381-6fb1-48d5-bc92-5be839431bcb-util\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:59:20.313762 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:20.313680 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cad3d381-6fb1-48d5-bc92-5be839431bcb-bundle\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 21:59:21.029519 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:21.029475 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r" event={"ID":"cad3d381-6fb1-48d5-bc92-5be839431bcb","Type":"ContainerDied","Data":"4cb1f90dcf147446b013a99b121f094907ab64abde2afe014815561c95b83dd5"} May 20 21:59:21.029519 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:21.029516 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4cb1f90dcf147446b013a99b121f094907ab64abde2afe014815561c95b83dd5" May 20 21:59:21.029770 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:21.029528 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70l962r" May 20 21:59:38.798036 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:38.798004 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] May 20 21:59:38.798561 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:38.798365 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cad3d381-6fb1-48d5-bc92-5be839431bcb" containerName="extract" May 20 21:59:38.798561 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:38.798376 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="cad3d381-6fb1-48d5-bc92-5be839431bcb" containerName="extract" May 20 21:59:38.798561 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:38.798392 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cad3d381-6fb1-48d5-bc92-5be839431bcb" containerName="pull" May 20 21:59:38.798561 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:38.798397 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="cad3d381-6fb1-48d5-bc92-5be839431bcb" containerName="pull" May 20 21:59:38.798561 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:38.798418 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cad3d381-6fb1-48d5-bc92-5be839431bcb" containerName="util" May 20 21:59:38.798561 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:38.798422 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="cad3d381-6fb1-48d5-bc92-5be839431bcb" containerName="util" May 20 21:59:38.798561 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:38.798474 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="cad3d381-6fb1-48d5-bc92-5be839431bcb" containerName="extract" May 20 21:59:38.801569 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:38.801551 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 20 21:59:38.804490 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:38.804469 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-9r7bg\"" May 20 21:59:38.804787 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:38.804766 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" May 20 21:59:38.805509 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:38.805493 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" May 20 21:59:38.805582 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:38.805509 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" May 20 21:59:38.811672 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:38.811632 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 20 21:59:38.873246 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:38.873225 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjzw8\" (UniqueName: \"kubernetes.io/projected/6042d718-7555-4488-be3f-d28825093bb3-kube-api-access-zjzw8\") pod \"maas-keycloak-0\" (UID: \"6042d718-7555-4488-be3f-d28825093bb3\") " pod="keycloak-system/maas-keycloak-0" May 20 21:59:38.973955 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:38.973934 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zjzw8\" (UniqueName: \"kubernetes.io/projected/6042d718-7555-4488-be3f-d28825093bb3-kube-api-access-zjzw8\") pod \"maas-keycloak-0\" (UID: \"6042d718-7555-4488-be3f-d28825093bb3\") " pod="keycloak-system/maas-keycloak-0" May 20 21:59:38.982024 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:38.982001 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjzw8\" (UniqueName: \"kubernetes.io/projected/6042d718-7555-4488-be3f-d28825093bb3-kube-api-access-zjzw8\") pod \"maas-keycloak-0\" (UID: \"6042d718-7555-4488-be3f-d28825093bb3\") " pod="keycloak-system/maas-keycloak-0" May 20 21:59:39.112430 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:39.112400 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 20 21:59:39.261880 ip-10-0-135-24 kubenswrapper[2571]: W0520 21:59:39.261842 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6042d718_7555_4488_be3f_d28825093bb3.slice/crio-975abfca3805af6895be7c207f8606c90e1cf34a752103c79718b893242f10d7 WatchSource:0}: Error finding container 975abfca3805af6895be7c207f8606c90e1cf34a752103c79718b893242f10d7: Status 404 returned error can't find the container with id 975abfca3805af6895be7c207f8606c90e1cf34a752103c79718b893242f10d7 May 20 21:59:39.263207 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:39.263184 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 20 21:59:40.105243 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:40.105205 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6042d718-7555-4488-be3f-d28825093bb3","Type":"ContainerStarted","Data":"975abfca3805af6895be7c207f8606c90e1cf34a752103c79718b893242f10d7"} May 20 21:59:44.128893 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:44.128789 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6042d718-7555-4488-be3f-d28825093bb3","Type":"ContainerStarted","Data":"c7b0555b1be468d22e2f974a14c3429d5a7b1803a6556c1606699a7aedbbce94"} May 20 21:59:44.148246 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:44.148182 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.6016583660000001 podStartE2EDuration="6.148165412s" podCreationTimestamp="2026-05-20 21:59:38 +0000 UTC" firstStartedPulling="2026-05-20 21:59:39.263165824 +0000 UTC m=+690.192982545" lastFinishedPulling="2026-05-20 21:59:43.809672866 +0000 UTC m=+694.739489591" observedRunningTime="2026-05-20 21:59:44.14731085 +0000 UTC m=+695.077127607" watchObservedRunningTime="2026-05-20 21:59:44.148165412 +0000 UTC m=+695.077982156" May 20 21:59:45.113334 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:45.113280 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" May 20 21:59:45.114850 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:45.114812 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6042d718-7555-4488-be3f-d28825093bb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" May 20 21:59:46.113237 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:46.113173 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6042d718-7555-4488-be3f-d28825093bb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" May 20 21:59:47.113426 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:47.113361 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6042d718-7555-4488-be3f-d28825093bb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" May 20 21:59:48.113355 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:48.113293 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6042d718-7555-4488-be3f-d28825093bb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" May 20 21:59:49.113851 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:49.113809 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6042d718-7555-4488-be3f-d28825093bb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" May 20 21:59:49.115689 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:49.114871 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" May 20 21:59:50.113755 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:50.113702 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6042d718-7555-4488-be3f-d28825093bb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" May 20 21:59:51.113374 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:51.113329 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6042d718-7555-4488-be3f-d28825093bb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" May 20 21:59:52.113777 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:52.113721 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6042d718-7555-4488-be3f-d28825093bb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" May 20 21:59:53.113740 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:53.113695 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6042d718-7555-4488-be3f-d28825093bb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" May 20 21:59:54.113365 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:54.113311 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6042d718-7555-4488-be3f-d28825093bb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" May 20 21:59:55.112942 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:55.112889 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6042d718-7555-4488-be3f-d28825093bb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" May 20 21:59:56.112955 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:56.112908 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6042d718-7555-4488-be3f-d28825093bb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" May 20 21:59:57.239618 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:57.239574 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" May 20 21:59:57.258327 ip-10-0-135-24 kubenswrapper[2571]: I0520 21:59:57.258279 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="6042d718-7555-4488-be3f-d28825093bb3" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 20 22:00:07.247841 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:07.247608 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" May 20 22:00:08.092593 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.092557 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-9vb8z"] May 20 22:00:08.095564 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.095547 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-9vb8z" May 20 22:00:08.102120 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.102087 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-9vb8z"] May 20 22:00:08.156989 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.156959 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8x7q\" (UniqueName: \"kubernetes.io/projected/65b90524-98d6-48e6-9f9d-3bc9290d5459-kube-api-access-d8x7q\") pod \"authorino-8b475cf9f-9vb8z\" (UID: \"65b90524-98d6-48e6-9f9d-3bc9290d5459\") " pod="kuadrant-system/authorino-8b475cf9f-9vb8z" May 20 22:00:08.258449 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.258417 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d8x7q\" (UniqueName: \"kubernetes.io/projected/65b90524-98d6-48e6-9f9d-3bc9290d5459-kube-api-access-d8x7q\") pod \"authorino-8b475cf9f-9vb8z\" (UID: \"65b90524-98d6-48e6-9f9d-3bc9290d5459\") " pod="kuadrant-system/authorino-8b475cf9f-9vb8z" May 20 22:00:08.271139 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.271117 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8x7q\" (UniqueName: \"kubernetes.io/projected/65b90524-98d6-48e6-9f9d-3bc9290d5459-kube-api-access-d8x7q\") pod \"authorino-8b475cf9f-9vb8z\" (UID: \"65b90524-98d6-48e6-9f9d-3bc9290d5459\") " pod="kuadrant-system/authorino-8b475cf9f-9vb8z" May 20 22:00:08.281146 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.281124 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-9vb8z"] May 20 22:00:08.281387 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.281375 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-9vb8z" May 20 22:00:08.306509 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.306483 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56fdd757f5-hzc86"] May 20 22:00:08.309453 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.309433 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-hzc86" May 20 22:00:08.312501 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.312483 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 20 22:00:08.318036 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.318013 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-hzc86"] May 20 22:00:08.356066 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.355996 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-hzc86"] May 20 22:00:08.356275 ip-10-0-135-24 kubenswrapper[2571]: E0520 22:00:08.356254 2571 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-lwsdn tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-56fdd757f5-hzc86" podUID="9a3e26a3-43e6-4d6a-b50f-59100413959d" May 20 22:00:08.359512 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.359484 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9a3e26a3-43e6-4d6a-b50f-59100413959d-tls-cert\") pod \"authorino-56fdd757f5-hzc86\" (UID: \"9a3e26a3-43e6-4d6a-b50f-59100413959d\") " pod="kuadrant-system/authorino-56fdd757f5-hzc86" May 20 22:00:08.359618 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.359529 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwsdn\" (UniqueName: \"kubernetes.io/projected/9a3e26a3-43e6-4d6a-b50f-59100413959d-kube-api-access-lwsdn\") pod \"authorino-56fdd757f5-hzc86\" (UID: \"9a3e26a3-43e6-4d6a-b50f-59100413959d\") " pod="kuadrant-system/authorino-56fdd757f5-hzc86" May 20 22:00:08.384541 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.384509 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-989486db9-46t8p"] May 20 22:00:08.387342 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.387323 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-989486db9-46t8p" May 20 22:00:08.396337 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.396312 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-989486db9-46t8p"] May 20 22:00:08.418376 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.418349 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-9vb8z"] May 20 22:00:08.419524 ip-10-0-135-24 kubenswrapper[2571]: W0520 22:00:08.419494 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65b90524_98d6_48e6_9f9d_3bc9290d5459.slice/crio-dd04db5c947e94571f9e8acace01a340c594550bd2228c70dbc604791538d37a WatchSource:0}: Error finding container dd04db5c947e94571f9e8acace01a340c594550bd2228c70dbc604791538d37a: Status 404 returned error can't find the container with id dd04db5c947e94571f9e8acace01a340c594550bd2228c70dbc604791538d37a May 20 22:00:08.460996 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.460971 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9a3e26a3-43e6-4d6a-b50f-59100413959d-tls-cert\") pod \"authorino-56fdd757f5-hzc86\" (UID: \"9a3e26a3-43e6-4d6a-b50f-59100413959d\") " pod="kuadrant-system/authorino-56fdd757f5-hzc86" May 20 22:00:08.461101 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.461001 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lwsdn\" (UniqueName: \"kubernetes.io/projected/9a3e26a3-43e6-4d6a-b50f-59100413959d-kube-api-access-lwsdn\") pod \"authorino-56fdd757f5-hzc86\" (UID: \"9a3e26a3-43e6-4d6a-b50f-59100413959d\") " pod="kuadrant-system/authorino-56fdd757f5-hzc86" May 20 22:00:08.461101 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.461058 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cb6f358f-f45b-4885-9234-4586106a7061-tls-cert\") pod \"authorino-989486db9-46t8p\" (UID: \"cb6f358f-f45b-4885-9234-4586106a7061\") " pod="kuadrant-system/authorino-989486db9-46t8p" May 20 22:00:08.461194 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.461136 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzgtv\" (UniqueName: \"kubernetes.io/projected/cb6f358f-f45b-4885-9234-4586106a7061-kube-api-access-kzgtv\") pod \"authorino-989486db9-46t8p\" (UID: \"cb6f358f-f45b-4885-9234-4586106a7061\") " pod="kuadrant-system/authorino-989486db9-46t8p" May 20 22:00:08.463322 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.463301 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9a3e26a3-43e6-4d6a-b50f-59100413959d-tls-cert\") pod \"authorino-56fdd757f5-hzc86\" (UID: \"9a3e26a3-43e6-4d6a-b50f-59100413959d\") " pod="kuadrant-system/authorino-56fdd757f5-hzc86" May 20 22:00:08.470002 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.469977 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwsdn\" (UniqueName: \"kubernetes.io/projected/9a3e26a3-43e6-4d6a-b50f-59100413959d-kube-api-access-lwsdn\") pod \"authorino-56fdd757f5-hzc86\" (UID: \"9a3e26a3-43e6-4d6a-b50f-59100413959d\") " pod="kuadrant-system/authorino-56fdd757f5-hzc86" May 20 22:00:08.561753 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.561730 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cb6f358f-f45b-4885-9234-4586106a7061-tls-cert\") pod \"authorino-989486db9-46t8p\" (UID: \"cb6f358f-f45b-4885-9234-4586106a7061\") " pod="kuadrant-system/authorino-989486db9-46t8p" May 20 22:00:08.561839 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.561784 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kzgtv\" (UniqueName: \"kubernetes.io/projected/cb6f358f-f45b-4885-9234-4586106a7061-kube-api-access-kzgtv\") pod \"authorino-989486db9-46t8p\" (UID: \"cb6f358f-f45b-4885-9234-4586106a7061\") " pod="kuadrant-system/authorino-989486db9-46t8p" May 20 22:00:08.563728 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.563713 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cb6f358f-f45b-4885-9234-4586106a7061-tls-cert\") pod \"authorino-989486db9-46t8p\" (UID: \"cb6f358f-f45b-4885-9234-4586106a7061\") " pod="kuadrant-system/authorino-989486db9-46t8p" May 20 22:00:08.569932 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.569910 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzgtv\" (UniqueName: \"kubernetes.io/projected/cb6f358f-f45b-4885-9234-4586106a7061-kube-api-access-kzgtv\") pod \"authorino-989486db9-46t8p\" (UID: \"cb6f358f-f45b-4885-9234-4586106a7061\") " pod="kuadrant-system/authorino-989486db9-46t8p" May 20 22:00:08.698851 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.698777 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-989486db9-46t8p" May 20 22:00:08.834581 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:08.834556 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-989486db9-46t8p"] May 20 22:00:08.836293 ip-10-0-135-24 kubenswrapper[2571]: W0520 22:00:08.836268 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb6f358f_f45b_4885_9234_4586106a7061.slice/crio-35dfffb50e054d10f225fa128e2e583e7a619ba96f701a19c14377cde6014162 WatchSource:0}: Error finding container 35dfffb50e054d10f225fa128e2e583e7a619ba96f701a19c14377cde6014162: Status 404 returned error can't find the container with id 35dfffb50e054d10f225fa128e2e583e7a619ba96f701a19c14377cde6014162 May 20 22:00:09.259824 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.259785 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-989486db9-46t8p" event={"ID":"cb6f358f-f45b-4885-9234-4586106a7061","Type":"ContainerStarted","Data":"fa6816a47bf25bc4f5b7f8ff9bf98ade013011b3bcba0fc19516c14d8e07b3e6"} May 20 22:00:09.259824 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.259820 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-989486db9-46t8p" event={"ID":"cb6f358f-f45b-4885-9234-4586106a7061","Type":"ContainerStarted","Data":"35dfffb50e054d10f225fa128e2e583e7a619ba96f701a19c14377cde6014162"} May 20 22:00:09.261220 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.261194 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-9vb8z" event={"ID":"65b90524-98d6-48e6-9f9d-3bc9290d5459","Type":"ContainerStarted","Data":"a9fb5ef280afd5fe754bf6f800c85d68f3de8dd48b5cb4efb1227c26cf3b503f"} May 20 22:00:09.261220 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.261222 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-9vb8z" event={"ID":"65b90524-98d6-48e6-9f9d-3bc9290d5459","Type":"ContainerStarted","Data":"dd04db5c947e94571f9e8acace01a340c594550bd2228c70dbc604791538d37a"} May 20 22:00:09.261409 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.261236 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-hzc86" May 20 22:00:09.261409 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.261238 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-9vb8z" podUID="65b90524-98d6-48e6-9f9d-3bc9290d5459" containerName="authorino" containerID="cri-o://a9fb5ef280afd5fe754bf6f800c85d68f3de8dd48b5cb4efb1227c26cf3b503f" gracePeriod=30 May 20 22:00:09.266320 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.266302 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-hzc86" May 20 22:00:09.275603 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.275563 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-989486db9-46t8p" podStartSLOduration=1.022197559 podStartE2EDuration="1.275551786s" podCreationTimestamp="2026-05-20 22:00:08 +0000 UTC" firstStartedPulling="2026-05-20 22:00:08.838238507 +0000 UTC m=+719.768055242" lastFinishedPulling="2026-05-20 22:00:09.091592748 +0000 UTC m=+720.021409469" observedRunningTime="2026-05-20 22:00:09.274428579 +0000 UTC m=+720.204245323" watchObservedRunningTime="2026-05-20 22:00:09.275551786 +0000 UTC m=+720.205368574" May 20 22:00:09.291349 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.291230 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-9vb8z" podStartSLOduration=0.963051105 podStartE2EDuration="1.291217112s" podCreationTimestamp="2026-05-20 22:00:08 +0000 UTC" firstStartedPulling="2026-05-20 22:00:08.420819664 +0000 UTC m=+719.350636389" lastFinishedPulling="2026-05-20 22:00:08.74898566 +0000 UTC m=+719.678802396" observedRunningTime="2026-05-20 22:00:09.289122272 +0000 UTC m=+720.218939019" watchObservedRunningTime="2026-05-20 22:00:09.291217112 +0000 UTC m=+720.221033855" May 20 22:00:09.307097 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.307071 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-9qm2z"] May 20 22:00:09.307323 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.307299 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-9qm2z" podUID="46066a2f-80a8-4336-ae30-791ce913dcd4" containerName="authorino" containerID="cri-o://56b50ddc5dcc845152b8fdee42eefdfe9a99996d715c6f749f6951c782e04225" gracePeriod=30 May 20 22:00:09.370093 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.370042 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwsdn\" (UniqueName: \"kubernetes.io/projected/9a3e26a3-43e6-4d6a-b50f-59100413959d-kube-api-access-lwsdn\") pod \"9a3e26a3-43e6-4d6a-b50f-59100413959d\" (UID: \"9a3e26a3-43e6-4d6a-b50f-59100413959d\") " May 20 22:00:09.370093 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.370072 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9a3e26a3-43e6-4d6a-b50f-59100413959d-tls-cert\") pod \"9a3e26a3-43e6-4d6a-b50f-59100413959d\" (UID: \"9a3e26a3-43e6-4d6a-b50f-59100413959d\") " May 20 22:00:09.371943 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.371915 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a3e26a3-43e6-4d6a-b50f-59100413959d-kube-api-access-lwsdn" (OuterVolumeSpecName: "kube-api-access-lwsdn") pod "9a3e26a3-43e6-4d6a-b50f-59100413959d" (UID: "9a3e26a3-43e6-4d6a-b50f-59100413959d"). InnerVolumeSpecName "kube-api-access-lwsdn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 22:00:09.372047 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.372014 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a3e26a3-43e6-4d6a-b50f-59100413959d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9a3e26a3-43e6-4d6a-b50f-59100413959d" (UID: "9a3e26a3-43e6-4d6a-b50f-59100413959d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 22:00:09.470902 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.470869 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwsdn\" (UniqueName: \"kubernetes.io/projected/9a3e26a3-43e6-4d6a-b50f-59100413959d-kube-api-access-lwsdn\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 22:00:09.470902 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.470892 2571 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9a3e26a3-43e6-4d6a-b50f-59100413959d-tls-cert\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 22:00:09.578580 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.578556 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-9vb8z" May 20 22:00:09.581892 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.581873 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-9qm2z" May 20 22:00:09.673269 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.673244 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wg54w\" (UniqueName: \"kubernetes.io/projected/46066a2f-80a8-4336-ae30-791ce913dcd4-kube-api-access-wg54w\") pod \"46066a2f-80a8-4336-ae30-791ce913dcd4\" (UID: \"46066a2f-80a8-4336-ae30-791ce913dcd4\") " May 20 22:00:09.673422 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.673409 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8x7q\" (UniqueName: \"kubernetes.io/projected/65b90524-98d6-48e6-9f9d-3bc9290d5459-kube-api-access-d8x7q\") pod \"65b90524-98d6-48e6-9f9d-3bc9290d5459\" (UID: \"65b90524-98d6-48e6-9f9d-3bc9290d5459\") " May 20 22:00:09.675323 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.675297 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46066a2f-80a8-4336-ae30-791ce913dcd4-kube-api-access-wg54w" (OuterVolumeSpecName: "kube-api-access-wg54w") pod "46066a2f-80a8-4336-ae30-791ce913dcd4" (UID: "46066a2f-80a8-4336-ae30-791ce913dcd4"). InnerVolumeSpecName "kube-api-access-wg54w". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 22:00:09.675432 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.675353 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65b90524-98d6-48e6-9f9d-3bc9290d5459-kube-api-access-d8x7q" (OuterVolumeSpecName: "kube-api-access-d8x7q") pod "65b90524-98d6-48e6-9f9d-3bc9290d5459" (UID: "65b90524-98d6-48e6-9f9d-3bc9290d5459"). InnerVolumeSpecName "kube-api-access-d8x7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 22:00:09.774012 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.773988 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8x7q\" (UniqueName: \"kubernetes.io/projected/65b90524-98d6-48e6-9f9d-3bc9290d5459-kube-api-access-d8x7q\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 22:00:09.774012 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:09.774011 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wg54w\" (UniqueName: \"kubernetes.io/projected/46066a2f-80a8-4336-ae30-791ce913dcd4-kube-api-access-wg54w\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 22:00:10.266622 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:10.266587 2571 generic.go:358] "Generic (PLEG): container finished" podID="65b90524-98d6-48e6-9f9d-3bc9290d5459" containerID="a9fb5ef280afd5fe754bf6f800c85d68f3de8dd48b5cb4efb1227c26cf3b503f" exitCode=0 May 20 22:00:10.267017 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:10.266662 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-9vb8z" May 20 22:00:10.267017 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:10.266669 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-9vb8z" event={"ID":"65b90524-98d6-48e6-9f9d-3bc9290d5459","Type":"ContainerDied","Data":"a9fb5ef280afd5fe754bf6f800c85d68f3de8dd48b5cb4efb1227c26cf3b503f"} May 20 22:00:10.267017 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:10.266712 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-9vb8z" event={"ID":"65b90524-98d6-48e6-9f9d-3bc9290d5459","Type":"ContainerDied","Data":"dd04db5c947e94571f9e8acace01a340c594550bd2228c70dbc604791538d37a"} May 20 22:00:10.267017 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:10.266730 2571 scope.go:117] "RemoveContainer" containerID="a9fb5ef280afd5fe754bf6f800c85d68f3de8dd48b5cb4efb1227c26cf3b503f" May 20 22:00:10.267996 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:10.267976 2571 generic.go:358] "Generic (PLEG): container finished" podID="46066a2f-80a8-4336-ae30-791ce913dcd4" containerID="56b50ddc5dcc845152b8fdee42eefdfe9a99996d715c6f749f6951c782e04225" exitCode=0 May 20 22:00:10.268099 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:10.268043 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-9qm2z" May 20 22:00:10.268099 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:10.268054 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-9qm2z" event={"ID":"46066a2f-80a8-4336-ae30-791ce913dcd4","Type":"ContainerDied","Data":"56b50ddc5dcc845152b8fdee42eefdfe9a99996d715c6f749f6951c782e04225"} May 20 22:00:10.268099 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:10.268085 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-9qm2z" event={"ID":"46066a2f-80a8-4336-ae30-791ce913dcd4","Type":"ContainerDied","Data":"79945f591ff374cfef8f248a6917911c094c0962d5565c57b4ff0f69485f299f"} May 20 22:00:10.268253 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:10.268212 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-hzc86" May 20 22:00:10.284277 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:10.284261 2571 scope.go:117] "RemoveContainer" containerID="a9fb5ef280afd5fe754bf6f800c85d68f3de8dd48b5cb4efb1227c26cf3b503f" May 20 22:00:10.284540 ip-10-0-135-24 kubenswrapper[2571]: E0520 22:00:10.284523 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9fb5ef280afd5fe754bf6f800c85d68f3de8dd48b5cb4efb1227c26cf3b503f\": container with ID starting with a9fb5ef280afd5fe754bf6f800c85d68f3de8dd48b5cb4efb1227c26cf3b503f not found: ID does not exist" containerID="a9fb5ef280afd5fe754bf6f800c85d68f3de8dd48b5cb4efb1227c26cf3b503f" May 20 22:00:10.284589 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:10.284548 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9fb5ef280afd5fe754bf6f800c85d68f3de8dd48b5cb4efb1227c26cf3b503f"} err="failed to get container status \"a9fb5ef280afd5fe754bf6f800c85d68f3de8dd48b5cb4efb1227c26cf3b503f\": rpc error: code = NotFound desc = could not find container \"a9fb5ef280afd5fe754bf6f800c85d68f3de8dd48b5cb4efb1227c26cf3b503f\": container with ID starting with a9fb5ef280afd5fe754bf6f800c85d68f3de8dd48b5cb4efb1227c26cf3b503f not found: ID does not exist" May 20 22:00:10.284589 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:10.284566 2571 scope.go:117] "RemoveContainer" containerID="56b50ddc5dcc845152b8fdee42eefdfe9a99996d715c6f749f6951c782e04225" May 20 22:00:10.292283 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:10.292270 2571 scope.go:117] "RemoveContainer" containerID="56b50ddc5dcc845152b8fdee42eefdfe9a99996d715c6f749f6951c782e04225" May 20 22:00:10.292505 ip-10-0-135-24 kubenswrapper[2571]: E0520 22:00:10.292487 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56b50ddc5dcc845152b8fdee42eefdfe9a99996d715c6f749f6951c782e04225\": container with ID starting with 56b50ddc5dcc845152b8fdee42eefdfe9a99996d715c6f749f6951c782e04225 not found: ID does not exist" containerID="56b50ddc5dcc845152b8fdee42eefdfe9a99996d715c6f749f6951c782e04225" May 20 22:00:10.292566 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:10.292511 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b50ddc5dcc845152b8fdee42eefdfe9a99996d715c6f749f6951c782e04225"} err="failed to get container status \"56b50ddc5dcc845152b8fdee42eefdfe9a99996d715c6f749f6951c782e04225\": rpc error: code = NotFound desc = could not find container \"56b50ddc5dcc845152b8fdee42eefdfe9a99996d715c6f749f6951c782e04225\": container with ID starting with 56b50ddc5dcc845152b8fdee42eefdfe9a99996d715c6f749f6951c782e04225 not found: ID does not exist" May 20 22:00:10.298312 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:10.298287 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-9vb8z"] May 20 22:00:10.304745 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:10.304725 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-9vb8z"] May 20 22:00:10.327378 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:10.327356 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-hzc86"] May 20 22:00:10.331009 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:10.330987 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-hzc86"] May 20 22:00:10.342293 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:10.342275 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-9qm2z"] May 20 22:00:10.351735 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:10.351711 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-9qm2z"] May 20 22:00:11.629297 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:11.629265 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46066a2f-80a8-4336-ae30-791ce913dcd4" path="/var/lib/kubelet/pods/46066a2f-80a8-4336-ae30-791ce913dcd4/volumes" May 20 22:00:11.629700 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:11.629577 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65b90524-98d6-48e6-9f9d-3bc9290d5459" path="/var/lib/kubelet/pods/65b90524-98d6-48e6-9f9d-3bc9290d5459/volumes" May 20 22:00:11.630023 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:11.630006 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a3e26a3-43e6-4d6a-b50f-59100413959d" path="/var/lib/kubelet/pods/9a3e26a3-43e6-4d6a-b50f-59100413959d/volumes" May 20 22:00:12.243594 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.243562 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-8w6c8"] May 20 22:00:12.243987 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.243973 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46066a2f-80a8-4336-ae30-791ce913dcd4" containerName="authorino" May 20 22:00:12.244048 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.243988 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="46066a2f-80a8-4336-ae30-791ce913dcd4" containerName="authorino" May 20 22:00:12.244048 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.244002 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65b90524-98d6-48e6-9f9d-3bc9290d5459" containerName="authorino" May 20 22:00:12.244048 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.244007 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="65b90524-98d6-48e6-9f9d-3bc9290d5459" containerName="authorino" May 20 22:00:12.244203 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.244067 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="46066a2f-80a8-4336-ae30-791ce913dcd4" containerName="authorino" May 20 22:00:12.244203 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.244077 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="65b90524-98d6-48e6-9f9d-3bc9290d5459" containerName="authorino" May 20 22:00:12.246870 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.246847 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-8w6c8" May 20 22:00:12.250564 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.250545 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 20 22:00:12.250696 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.250545 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fnlnz\"" May 20 22:00:12.261718 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.260858 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-8w6c8"] May 20 22:00:12.296990 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.296962 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcmgh\" (UniqueName: \"kubernetes.io/projected/368ff2a1-7e19-4e7f-a0a0-e4e807013326-kube-api-access-qcmgh\") pod \"maas-controller-68fb5d86bc-8w6c8\" (UID: \"368ff2a1-7e19-4e7f-a0a0-e4e807013326\") " pod="opendatahub/maas-controller-68fb5d86bc-8w6c8" May 20 22:00:12.398344 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.398317 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qcmgh\" (UniqueName: \"kubernetes.io/projected/368ff2a1-7e19-4e7f-a0a0-e4e807013326-kube-api-access-qcmgh\") pod \"maas-controller-68fb5d86bc-8w6c8\" (UID: \"368ff2a1-7e19-4e7f-a0a0-e4e807013326\") " pod="opendatahub/maas-controller-68fb5d86bc-8w6c8" May 20 22:00:12.430612 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.430582 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcmgh\" (UniqueName: \"kubernetes.io/projected/368ff2a1-7e19-4e7f-a0a0-e4e807013326-kube-api-access-qcmgh\") pod \"maas-controller-68fb5d86bc-8w6c8\" (UID: \"368ff2a1-7e19-4e7f-a0a0-e4e807013326\") " pod="opendatahub/maas-controller-68fb5d86bc-8w6c8" May 20 22:00:12.447077 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.447051 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b68bc8469-bppdz"] May 20 22:00:12.449573 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.449559 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b68bc8469-bppdz" May 20 22:00:12.466085 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.466068 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b68bc8469-bppdz"] May 20 22:00:12.499237 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.499174 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7bq8\" (UniqueName: \"kubernetes.io/projected/d9c06ecd-e5fa-4002-99f1-64237f3792e6-kube-api-access-j7bq8\") pod \"maas-controller-6b68bc8469-bppdz\" (UID: \"d9c06ecd-e5fa-4002-99f1-64237f3792e6\") " pod="opendatahub/maas-controller-6b68bc8469-bppdz" May 20 22:00:12.535365 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.535339 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-8w6c8"] May 20 22:00:12.535567 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.535556 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-8w6c8" May 20 22:00:12.565000 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.564971 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75644447c8-5vhsx"] May 20 22:00:12.568233 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.568210 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75644447c8-5vhsx" May 20 22:00:12.589729 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.589660 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75644447c8-5vhsx"] May 20 22:00:12.600032 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.600002 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thqzj\" (UniqueName: \"kubernetes.io/projected/c316808a-b349-4b85-a3e5-91e6d15c7813-kube-api-access-thqzj\") pod \"maas-controller-75644447c8-5vhsx\" (UID: \"c316808a-b349-4b85-a3e5-91e6d15c7813\") " pod="opendatahub/maas-controller-75644447c8-5vhsx" May 20 22:00:12.600399 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.600375 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j7bq8\" (UniqueName: \"kubernetes.io/projected/d9c06ecd-e5fa-4002-99f1-64237f3792e6-kube-api-access-j7bq8\") pod \"maas-controller-6b68bc8469-bppdz\" (UID: \"d9c06ecd-e5fa-4002-99f1-64237f3792e6\") " pod="opendatahub/maas-controller-6b68bc8469-bppdz" May 20 22:00:12.620668 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.620573 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7bq8\" (UniqueName: \"kubernetes.io/projected/d9c06ecd-e5fa-4002-99f1-64237f3792e6-kube-api-access-j7bq8\") pod \"maas-controller-6b68bc8469-bppdz\" (UID: \"d9c06ecd-e5fa-4002-99f1-64237f3792e6\") " pod="opendatahub/maas-controller-6b68bc8469-bppdz" May 20 22:00:12.682781 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.682749 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-8w6c8"] May 20 22:00:12.683195 ip-10-0-135-24 kubenswrapper[2571]: W0520 22:00:12.683130 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod368ff2a1_7e19_4e7f_a0a0_e4e807013326.slice/crio-a08b994a23865349d3321f4d7c20477e9869b0f197ecac508f4748310904ff1d WatchSource:0}: Error finding container a08b994a23865349d3321f4d7c20477e9869b0f197ecac508f4748310904ff1d: Status 404 returned error can't find the container with id a08b994a23865349d3321f4d7c20477e9869b0f197ecac508f4748310904ff1d May 20 22:00:12.701126 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.701051 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thqzj\" (UniqueName: \"kubernetes.io/projected/c316808a-b349-4b85-a3e5-91e6d15c7813-kube-api-access-thqzj\") pod \"maas-controller-75644447c8-5vhsx\" (UID: \"c316808a-b349-4b85-a3e5-91e6d15c7813\") " pod="opendatahub/maas-controller-75644447c8-5vhsx" May 20 22:00:12.712953 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.712935 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thqzj\" (UniqueName: \"kubernetes.io/projected/c316808a-b349-4b85-a3e5-91e6d15c7813-kube-api-access-thqzj\") pod \"maas-controller-75644447c8-5vhsx\" (UID: \"c316808a-b349-4b85-a3e5-91e6d15c7813\") " pod="opendatahub/maas-controller-75644447c8-5vhsx" May 20 22:00:12.759782 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.759725 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b68bc8469-bppdz" May 20 22:00:12.879625 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.879599 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75644447c8-5vhsx" May 20 22:00:12.890718 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:12.890696 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b68bc8469-bppdz"] May 20 22:00:12.891468 ip-10-0-135-24 kubenswrapper[2571]: W0520 22:00:12.891441 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9c06ecd_e5fa_4002_99f1_64237f3792e6.slice/crio-3e1859f7dc90ceb145a4ae79887ad474602cd3563ca92f9f84cfd7a14668bc62 WatchSource:0}: Error finding container 3e1859f7dc90ceb145a4ae79887ad474602cd3563ca92f9f84cfd7a14668bc62: Status 404 returned error can't find the container with id 3e1859f7dc90ceb145a4ae79887ad474602cd3563ca92f9f84cfd7a14668bc62 May 20 22:00:13.012997 ip-10-0-135-24 kubenswrapper[2571]: W0520 22:00:13.012964 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc316808a_b349_4b85_a3e5_91e6d15c7813.slice/crio-d16048643a3c7cec9e23dd95302ac794f80a4f24c68089353342504f553198b3 WatchSource:0}: Error finding container d16048643a3c7cec9e23dd95302ac794f80a4f24c68089353342504f553198b3: Status 404 returned error can't find the container with id d16048643a3c7cec9e23dd95302ac794f80a4f24c68089353342504f553198b3 May 20 22:00:13.013943 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:13.013916 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75644447c8-5vhsx"] May 20 22:00:13.291042 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:13.290952 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b68bc8469-bppdz" event={"ID":"d9c06ecd-e5fa-4002-99f1-64237f3792e6","Type":"ContainerStarted","Data":"3e1859f7dc90ceb145a4ae79887ad474602cd3563ca92f9f84cfd7a14668bc62"} May 20 22:00:13.292733 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:13.292698 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75644447c8-5vhsx" event={"ID":"c316808a-b349-4b85-a3e5-91e6d15c7813","Type":"ContainerStarted","Data":"d16048643a3c7cec9e23dd95302ac794f80a4f24c68089353342504f553198b3"} May 20 22:00:13.294206 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:13.294157 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-8w6c8" event={"ID":"368ff2a1-7e19-4e7f-a0a0-e4e807013326","Type":"ContainerStarted","Data":"a08b994a23865349d3321f4d7c20477e9869b0f197ecac508f4748310904ff1d"} May 20 22:00:16.312606 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:16.312572 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b68bc8469-bppdz" event={"ID":"d9c06ecd-e5fa-4002-99f1-64237f3792e6","Type":"ContainerStarted","Data":"626c001f4a2380c96f8011eacb07cb037663b826abbf79c7fd2e6a27cc8ab8e2"} May 20 22:00:16.313050 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:16.312678 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b68bc8469-bppdz" May 20 22:00:16.314047 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:16.314019 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75644447c8-5vhsx" event={"ID":"c316808a-b349-4b85-a3e5-91e6d15c7813","Type":"ContainerStarted","Data":"7fde5a31f2daeec1ab8307f61d4098845a484d30388f963b4b6cd3a7eb25514b"} May 20 22:00:16.314186 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:16.314057 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75644447c8-5vhsx" May 20 22:00:16.315438 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:16.315418 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-8w6c8" event={"ID":"368ff2a1-7e19-4e7f-a0a0-e4e807013326","Type":"ContainerStarted","Data":"4549e918ad8273fcadd3688e70fbc549073233638414c50a22dcacefc19a2112"} May 20 22:00:16.315532 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:16.315461 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68fb5d86bc-8w6c8" May 20 22:00:16.315532 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:16.315457 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-68fb5d86bc-8w6c8" podUID="368ff2a1-7e19-4e7f-a0a0-e4e807013326" containerName="manager" containerID="cri-o://4549e918ad8273fcadd3688e70fbc549073233638414c50a22dcacefc19a2112" gracePeriod=30 May 20 22:00:16.330843 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:16.330798 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6b68bc8469-bppdz" podStartSLOduration=1.173276064 podStartE2EDuration="4.330785668s" podCreationTimestamp="2026-05-20 22:00:12 +0000 UTC" firstStartedPulling="2026-05-20 22:00:12.893390574 +0000 UTC m=+723.823207295" lastFinishedPulling="2026-05-20 22:00:16.050900167 +0000 UTC m=+726.980716899" observedRunningTime="2026-05-20 22:00:16.329309121 +0000 UTC m=+727.259125866" watchObservedRunningTime="2026-05-20 22:00:16.330785668 +0000 UTC m=+727.260602410" May 20 22:00:16.353392 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:16.353347 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-68fb5d86bc-8w6c8" podStartSLOduration=0.987280448 podStartE2EDuration="4.353333189s" podCreationTimestamp="2026-05-20 22:00:12 +0000 UTC" firstStartedPulling="2026-05-20 22:00:12.684536623 +0000 UTC m=+723.614353348" lastFinishedPulling="2026-05-20 22:00:16.050589353 +0000 UTC m=+726.980406089" observedRunningTime="2026-05-20 22:00:16.349982827 +0000 UTC m=+727.279799570" watchObservedRunningTime="2026-05-20 22:00:16.353333189 +0000 UTC m=+727.283149933" May 20 22:00:16.366192 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:16.366143 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-75644447c8-5vhsx" podStartSLOduration=1.318013991 podStartE2EDuration="4.366128282s" podCreationTimestamp="2026-05-20 22:00:12 +0000 UTC" firstStartedPulling="2026-05-20 22:00:13.014471332 +0000 UTC m=+723.944288070" lastFinishedPulling="2026-05-20 22:00:16.062585629 +0000 UTC m=+726.992402361" observedRunningTime="2026-05-20 22:00:16.365677985 +0000 UTC m=+727.295494728" watchObservedRunningTime="2026-05-20 22:00:16.366128282 +0000 UTC m=+727.295945027" May 20 22:00:16.580356 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:16.580332 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-8w6c8" May 20 22:00:16.639525 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:16.639492 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcmgh\" (UniqueName: \"kubernetes.io/projected/368ff2a1-7e19-4e7f-a0a0-e4e807013326-kube-api-access-qcmgh\") pod \"368ff2a1-7e19-4e7f-a0a0-e4e807013326\" (UID: \"368ff2a1-7e19-4e7f-a0a0-e4e807013326\") " May 20 22:00:16.642186 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:16.642157 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/368ff2a1-7e19-4e7f-a0a0-e4e807013326-kube-api-access-qcmgh" (OuterVolumeSpecName: "kube-api-access-qcmgh") pod "368ff2a1-7e19-4e7f-a0a0-e4e807013326" (UID: "368ff2a1-7e19-4e7f-a0a0-e4e807013326"). InnerVolumeSpecName "kube-api-access-qcmgh". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 22:00:16.740290 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:16.740259 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcmgh\" (UniqueName: \"kubernetes.io/projected/368ff2a1-7e19-4e7f-a0a0-e4e807013326-kube-api-access-qcmgh\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 22:00:17.320756 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:17.320722 2571 generic.go:358] "Generic (PLEG): container finished" podID="368ff2a1-7e19-4e7f-a0a0-e4e807013326" containerID="4549e918ad8273fcadd3688e70fbc549073233638414c50a22dcacefc19a2112" exitCode=0 May 20 22:00:17.321242 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:17.320786 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-8w6c8" May 20 22:00:17.321242 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:17.320809 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-8w6c8" event={"ID":"368ff2a1-7e19-4e7f-a0a0-e4e807013326","Type":"ContainerDied","Data":"4549e918ad8273fcadd3688e70fbc549073233638414c50a22dcacefc19a2112"} May 20 22:00:17.321242 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:17.320853 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-8w6c8" event={"ID":"368ff2a1-7e19-4e7f-a0a0-e4e807013326","Type":"ContainerDied","Data":"a08b994a23865349d3321f4d7c20477e9869b0f197ecac508f4748310904ff1d"} May 20 22:00:17.321242 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:17.320875 2571 scope.go:117] "RemoveContainer" containerID="4549e918ad8273fcadd3688e70fbc549073233638414c50a22dcacefc19a2112" May 20 22:00:17.330148 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:17.330126 2571 scope.go:117] "RemoveContainer" containerID="4549e918ad8273fcadd3688e70fbc549073233638414c50a22dcacefc19a2112" May 20 22:00:17.330421 ip-10-0-135-24 kubenswrapper[2571]: E0520 22:00:17.330399 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4549e918ad8273fcadd3688e70fbc549073233638414c50a22dcacefc19a2112\": container with ID starting with 4549e918ad8273fcadd3688e70fbc549073233638414c50a22dcacefc19a2112 not found: ID does not exist" containerID="4549e918ad8273fcadd3688e70fbc549073233638414c50a22dcacefc19a2112" May 20 22:00:17.330482 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:17.330428 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4549e918ad8273fcadd3688e70fbc549073233638414c50a22dcacefc19a2112"} err="failed to get container status \"4549e918ad8273fcadd3688e70fbc549073233638414c50a22dcacefc19a2112\": rpc error: code = NotFound desc = could not find container \"4549e918ad8273fcadd3688e70fbc549073233638414c50a22dcacefc19a2112\": container with ID starting with 4549e918ad8273fcadd3688e70fbc549073233638414c50a22dcacefc19a2112 not found: ID does not exist" May 20 22:00:17.343123 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:17.343102 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-8w6c8"] May 20 22:00:17.346572 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:17.346552 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-8w6c8"] May 20 22:00:17.628741 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:17.628665 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="368ff2a1-7e19-4e7f-a0a0-e4e807013326" path="/var/lib/kubelet/pods/368ff2a1-7e19-4e7f-a0a0-e4e807013326/volumes" May 20 22:00:27.325973 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:27.325941 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b68bc8469-bppdz" May 20 22:00:27.326352 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:27.325994 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75644447c8-5vhsx" May 20 22:00:27.380167 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:27.380135 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b68bc8469-bppdz"] May 20 22:00:27.380329 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:27.380301 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-6b68bc8469-bppdz" podUID="d9c06ecd-e5fa-4002-99f1-64237f3792e6" containerName="manager" containerID="cri-o://626c001f4a2380c96f8011eacb07cb037663b826abbf79c7fd2e6a27cc8ab8e2" gracePeriod=30 May 20 22:00:27.561117 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:27.561090 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c459d4f58-z8zpd"] May 20 22:00:27.561487 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:27.561475 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="368ff2a1-7e19-4e7f-a0a0-e4e807013326" containerName="manager" May 20 22:00:27.561532 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:27.561489 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="368ff2a1-7e19-4e7f-a0a0-e4e807013326" containerName="manager" May 20 22:00:27.561578 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:27.561569 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="368ff2a1-7e19-4e7f-a0a0-e4e807013326" containerName="manager" May 20 22:00:27.564652 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:27.564619 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c459d4f58-z8zpd" May 20 22:00:27.574875 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:27.574223 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c459d4f58-z8zpd"] May 20 22:00:27.627794 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:27.627771 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b68bc8469-bppdz" May 20 22:00:27.639767 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:27.639746 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zfsd\" (UniqueName: \"kubernetes.io/projected/ff3f0987-18b5-4310-ae5d-1bb67f399cc8-kube-api-access-9zfsd\") pod \"maas-controller-c459d4f58-z8zpd\" (UID: \"ff3f0987-18b5-4310-ae5d-1bb67f399cc8\") " pod="opendatahub/maas-controller-c459d4f58-z8zpd" May 20 22:00:27.741112 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:27.741070 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7bq8\" (UniqueName: \"kubernetes.io/projected/d9c06ecd-e5fa-4002-99f1-64237f3792e6-kube-api-access-j7bq8\") pod \"d9c06ecd-e5fa-4002-99f1-64237f3792e6\" (UID: \"d9c06ecd-e5fa-4002-99f1-64237f3792e6\") " May 20 22:00:27.741361 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:27.741340 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9zfsd\" (UniqueName: \"kubernetes.io/projected/ff3f0987-18b5-4310-ae5d-1bb67f399cc8-kube-api-access-9zfsd\") pod \"maas-controller-c459d4f58-z8zpd\" (UID: \"ff3f0987-18b5-4310-ae5d-1bb67f399cc8\") " pod="opendatahub/maas-controller-c459d4f58-z8zpd" May 20 22:00:27.743067 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:27.743045 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9c06ecd-e5fa-4002-99f1-64237f3792e6-kube-api-access-j7bq8" (OuterVolumeSpecName: "kube-api-access-j7bq8") pod "d9c06ecd-e5fa-4002-99f1-64237f3792e6" (UID: "d9c06ecd-e5fa-4002-99f1-64237f3792e6"). InnerVolumeSpecName "kube-api-access-j7bq8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 22:00:27.750153 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:27.750136 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zfsd\" (UniqueName: \"kubernetes.io/projected/ff3f0987-18b5-4310-ae5d-1bb67f399cc8-kube-api-access-9zfsd\") pod \"maas-controller-c459d4f58-z8zpd\" (UID: \"ff3f0987-18b5-4310-ae5d-1bb67f399cc8\") " pod="opendatahub/maas-controller-c459d4f58-z8zpd" May 20 22:00:27.842190 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:27.842164 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7bq8\" (UniqueName: \"kubernetes.io/projected/d9c06ecd-e5fa-4002-99f1-64237f3792e6-kube-api-access-j7bq8\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 22:00:27.878801 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:27.878739 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c459d4f58-z8zpd" May 20 22:00:28.010531 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:28.010505 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c459d4f58-z8zpd"] May 20 22:00:28.011466 ip-10-0-135-24 kubenswrapper[2571]: W0520 22:00:28.011440 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff3f0987_18b5_4310_ae5d_1bb67f399cc8.slice/crio-3bd6ddbb442da9824a1437963b6b25fea1ef87f5b240195fdcc1e139f082adc4 WatchSource:0}: Error finding container 3bd6ddbb442da9824a1437963b6b25fea1ef87f5b240195fdcc1e139f082adc4: Status 404 returned error can't find the container with id 3bd6ddbb442da9824a1437963b6b25fea1ef87f5b240195fdcc1e139f082adc4 May 20 22:00:28.367224 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:28.367193 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c459d4f58-z8zpd" event={"ID":"ff3f0987-18b5-4310-ae5d-1bb67f399cc8","Type":"ContainerStarted","Data":"3bd6ddbb442da9824a1437963b6b25fea1ef87f5b240195fdcc1e139f082adc4"} May 20 22:00:28.368415 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:28.368390 2571 generic.go:358] "Generic (PLEG): container finished" podID="d9c06ecd-e5fa-4002-99f1-64237f3792e6" containerID="626c001f4a2380c96f8011eacb07cb037663b826abbf79c7fd2e6a27cc8ab8e2" exitCode=0 May 20 22:00:28.368503 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:28.368452 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b68bc8469-bppdz" event={"ID":"d9c06ecd-e5fa-4002-99f1-64237f3792e6","Type":"ContainerDied","Data":"626c001f4a2380c96f8011eacb07cb037663b826abbf79c7fd2e6a27cc8ab8e2"} May 20 22:00:28.368503 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:28.368473 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b68bc8469-bppdz" event={"ID":"d9c06ecd-e5fa-4002-99f1-64237f3792e6","Type":"ContainerDied","Data":"3e1859f7dc90ceb145a4ae79887ad474602cd3563ca92f9f84cfd7a14668bc62"} May 20 22:00:28.368503 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:28.368488 2571 scope.go:117] "RemoveContainer" containerID="626c001f4a2380c96f8011eacb07cb037663b826abbf79c7fd2e6a27cc8ab8e2" May 20 22:00:28.368666 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:28.368453 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b68bc8469-bppdz" May 20 22:00:28.378470 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:28.378446 2571 scope.go:117] "RemoveContainer" containerID="626c001f4a2380c96f8011eacb07cb037663b826abbf79c7fd2e6a27cc8ab8e2" May 20 22:00:28.378760 ip-10-0-135-24 kubenswrapper[2571]: E0520 22:00:28.378741 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"626c001f4a2380c96f8011eacb07cb037663b826abbf79c7fd2e6a27cc8ab8e2\": container with ID starting with 626c001f4a2380c96f8011eacb07cb037663b826abbf79c7fd2e6a27cc8ab8e2 not found: ID does not exist" containerID="626c001f4a2380c96f8011eacb07cb037663b826abbf79c7fd2e6a27cc8ab8e2" May 20 22:00:28.378819 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:28.378769 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"626c001f4a2380c96f8011eacb07cb037663b826abbf79c7fd2e6a27cc8ab8e2"} err="failed to get container status \"626c001f4a2380c96f8011eacb07cb037663b826abbf79c7fd2e6a27cc8ab8e2\": rpc error: code = NotFound desc = could not find container \"626c001f4a2380c96f8011eacb07cb037663b826abbf79c7fd2e6a27cc8ab8e2\": container with ID starting with 626c001f4a2380c96f8011eacb07cb037663b826abbf79c7fd2e6a27cc8ab8e2 not found: ID does not exist" May 20 22:00:28.392711 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:28.392689 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b68bc8469-bppdz"] May 20 22:00:28.395202 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:28.395181 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b68bc8469-bppdz"] May 20 22:00:29.374872 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:29.374835 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c459d4f58-z8zpd" event={"ID":"ff3f0987-18b5-4310-ae5d-1bb67f399cc8","Type":"ContainerStarted","Data":"a1beca4358de009b02add97f6e919fa6b1c096a19dac2ef7c458967e4d542a15"} May 20 22:00:29.375234 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:29.374994 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c459d4f58-z8zpd" May 20 22:00:29.392102 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:29.392058 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-c459d4f58-z8zpd" podStartSLOduration=2.042285628 podStartE2EDuration="2.392045391s" podCreationTimestamp="2026-05-20 22:00:27 +0000 UTC" firstStartedPulling="2026-05-20 22:00:28.012667415 +0000 UTC m=+738.942484136" lastFinishedPulling="2026-05-20 22:00:28.362427165 +0000 UTC m=+739.292243899" observedRunningTime="2026-05-20 22:00:29.390064625 +0000 UTC m=+740.319881363" watchObservedRunningTime="2026-05-20 22:00:29.392045391 +0000 UTC m=+740.321862134" May 20 22:00:29.629604 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:29.629529 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9c06ecd-e5fa-4002-99f1-64237f3792e6" path="/var/lib/kubelet/pods/d9c06ecd-e5fa-4002-99f1-64237f3792e6/volumes" May 20 22:00:40.384790 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:40.384759 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c459d4f58-z8zpd" May 20 22:00:40.424864 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:40.424827 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75644447c8-5vhsx"] May 20 22:00:40.425079 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:40.425054 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-75644447c8-5vhsx" podUID="c316808a-b349-4b85-a3e5-91e6d15c7813" containerName="manager" containerID="cri-o://7fde5a31f2daeec1ab8307f61d4098845a484d30388f963b4b6cd3a7eb25514b" gracePeriod=30 May 20 22:00:40.668064 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:40.668043 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75644447c8-5vhsx" May 20 22:00:40.851806 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:40.851780 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thqzj\" (UniqueName: \"kubernetes.io/projected/c316808a-b349-4b85-a3e5-91e6d15c7813-kube-api-access-thqzj\") pod \"c316808a-b349-4b85-a3e5-91e6d15c7813\" (UID: \"c316808a-b349-4b85-a3e5-91e6d15c7813\") " May 20 22:00:40.853671 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:40.853651 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c316808a-b349-4b85-a3e5-91e6d15c7813-kube-api-access-thqzj" (OuterVolumeSpecName: "kube-api-access-thqzj") pod "c316808a-b349-4b85-a3e5-91e6d15c7813" (UID: "c316808a-b349-4b85-a3e5-91e6d15c7813"). InnerVolumeSpecName "kube-api-access-thqzj". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 22:00:40.952783 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:40.952703 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thqzj\" (UniqueName: \"kubernetes.io/projected/c316808a-b349-4b85-a3e5-91e6d15c7813-kube-api-access-thqzj\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 22:00:41.426678 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:41.426624 2571 generic.go:358] "Generic (PLEG): container finished" podID="c316808a-b349-4b85-a3e5-91e6d15c7813" containerID="7fde5a31f2daeec1ab8307f61d4098845a484d30388f963b4b6cd3a7eb25514b" exitCode=0 May 20 22:00:41.427132 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:41.426707 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75644447c8-5vhsx" May 20 22:00:41.427132 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:41.426711 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75644447c8-5vhsx" event={"ID":"c316808a-b349-4b85-a3e5-91e6d15c7813","Type":"ContainerDied","Data":"7fde5a31f2daeec1ab8307f61d4098845a484d30388f963b4b6cd3a7eb25514b"} May 20 22:00:41.427132 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:41.426749 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75644447c8-5vhsx" event={"ID":"c316808a-b349-4b85-a3e5-91e6d15c7813","Type":"ContainerDied","Data":"d16048643a3c7cec9e23dd95302ac794f80a4f24c68089353342504f553198b3"} May 20 22:00:41.427132 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:41.426766 2571 scope.go:117] "RemoveContainer" containerID="7fde5a31f2daeec1ab8307f61d4098845a484d30388f963b4b6cd3a7eb25514b" May 20 22:00:41.436519 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:41.436505 2571 scope.go:117] "RemoveContainer" containerID="7fde5a31f2daeec1ab8307f61d4098845a484d30388f963b4b6cd3a7eb25514b" May 20 22:00:41.436756 ip-10-0-135-24 kubenswrapper[2571]: E0520 22:00:41.436740 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fde5a31f2daeec1ab8307f61d4098845a484d30388f963b4b6cd3a7eb25514b\": container with ID starting with 7fde5a31f2daeec1ab8307f61d4098845a484d30388f963b4b6cd3a7eb25514b not found: ID does not exist" containerID="7fde5a31f2daeec1ab8307f61d4098845a484d30388f963b4b6cd3a7eb25514b" May 20 22:00:41.436817 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:41.436764 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fde5a31f2daeec1ab8307f61d4098845a484d30388f963b4b6cd3a7eb25514b"} err="failed to get container status \"7fde5a31f2daeec1ab8307f61d4098845a484d30388f963b4b6cd3a7eb25514b\": rpc error: code = NotFound desc = could not find container \"7fde5a31f2daeec1ab8307f61d4098845a484d30388f963b4b6cd3a7eb25514b\": container with ID starting with 7fde5a31f2daeec1ab8307f61d4098845a484d30388f963b4b6cd3a7eb25514b not found: ID does not exist" May 20 22:00:41.448949 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:41.448923 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75644447c8-5vhsx"] May 20 22:00:41.452665 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:41.452630 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75644447c8-5vhsx"] May 20 22:00:41.629394 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:00:41.629358 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c316808a-b349-4b85-a3e5-91e6d15c7813" path="/var/lib/kubelet/pods/c316808a-b349-4b85-a3e5-91e6d15c7813/volumes" May 20 22:01:12.087016 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:12.086983 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 20 22:01:12.087446 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:12.087192 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="6042d718-7555-4488-be3f-d28825093bb3" containerName="keycloak" containerID="cri-o://c7b0555b1be468d22e2f974a14c3429d5a7b1803a6556c1606699a7aedbbce94" gracePeriod=30 May 20 22:01:13.558425 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:13.558395 2571 generic.go:358] "Generic (PLEG): container finished" podID="6042d718-7555-4488-be3f-d28825093bb3" containerID="c7b0555b1be468d22e2f974a14c3429d5a7b1803a6556c1606699a7aedbbce94" exitCode=143 May 20 22:01:13.558838 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:13.558473 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6042d718-7555-4488-be3f-d28825093bb3","Type":"ContainerDied","Data":"c7b0555b1be468d22e2f974a14c3429d5a7b1803a6556c1606699a7aedbbce94"} May 20 22:01:13.638757 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:13.638734 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 20 22:01:13.727131 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:13.727103 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjzw8\" (UniqueName: \"kubernetes.io/projected/6042d718-7555-4488-be3f-d28825093bb3-kube-api-access-zjzw8\") pod \"6042d718-7555-4488-be3f-d28825093bb3\" (UID: \"6042d718-7555-4488-be3f-d28825093bb3\") " May 20 22:01:13.729129 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:13.729100 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6042d718-7555-4488-be3f-d28825093bb3-kube-api-access-zjzw8" (OuterVolumeSpecName: "kube-api-access-zjzw8") pod "6042d718-7555-4488-be3f-d28825093bb3" (UID: "6042d718-7555-4488-be3f-d28825093bb3"). InnerVolumeSpecName "kube-api-access-zjzw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 22:01:13.828142 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:13.828119 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjzw8\" (UniqueName: \"kubernetes.io/projected/6042d718-7555-4488-be3f-d28825093bb3-kube-api-access-zjzw8\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 22:01:14.564162 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.564122 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6042d718-7555-4488-be3f-d28825093bb3","Type":"ContainerDied","Data":"975abfca3805af6895be7c207f8606c90e1cf34a752103c79718b893242f10d7"} May 20 22:01:14.564691 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.564173 2571 scope.go:117] "RemoveContainer" containerID="c7b0555b1be468d22e2f974a14c3429d5a7b1803a6556c1606699a7aedbbce94" May 20 22:01:14.564691 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.564138 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 20 22:01:14.587446 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.587420 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 20 22:01:14.590784 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.590760 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 20 22:01:14.611747 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.611726 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] May 20 22:01:14.612121 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.612105 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c316808a-b349-4b85-a3e5-91e6d15c7813" containerName="manager" May 20 22:01:14.612189 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.612123 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c316808a-b349-4b85-a3e5-91e6d15c7813" containerName="manager" May 20 22:01:14.612189 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.612139 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6042d718-7555-4488-be3f-d28825093bb3" containerName="keycloak" May 20 22:01:14.612189 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.612148 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6042d718-7555-4488-be3f-d28825093bb3" containerName="keycloak" May 20 22:01:14.612189 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.612158 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9c06ecd-e5fa-4002-99f1-64237f3792e6" containerName="manager" May 20 22:01:14.612189 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.612165 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9c06ecd-e5fa-4002-99f1-64237f3792e6" containerName="manager" May 20 22:01:14.612363 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.612263 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="c316808a-b349-4b85-a3e5-91e6d15c7813" containerName="manager" May 20 22:01:14.612363 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.612271 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="d9c06ecd-e5fa-4002-99f1-64237f3792e6" containerName="manager" May 20 22:01:14.612363 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.612277 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="6042d718-7555-4488-be3f-d28825093bb3" containerName="keycloak" May 20 22:01:14.616409 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.616394 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 20 22:01:14.619836 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.619811 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" May 20 22:01:14.619836 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.619826 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" May 20 22:01:14.620019 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.619825 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" May 20 22:01:14.620019 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.619825 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" May 20 22:01:14.620206 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.620189 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-9r7bg\"" May 20 22:01:14.624203 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.624168 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 20 22:01:14.736302 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.736270 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/ca25234a-9e20-42cd-8910-d0463a27b0ab-test-realms\") pod \"maas-keycloak-0\" (UID: \"ca25234a-9e20-42cd-8910-d0463a27b0ab\") " pod="keycloak-system/maas-keycloak-0" May 20 22:01:14.736302 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.736307 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85gzm\" (UniqueName: \"kubernetes.io/projected/ca25234a-9e20-42cd-8910-d0463a27b0ab-kube-api-access-85gzm\") pod \"maas-keycloak-0\" (UID: \"ca25234a-9e20-42cd-8910-d0463a27b0ab\") " pod="keycloak-system/maas-keycloak-0" May 20 22:01:14.837285 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.837214 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/ca25234a-9e20-42cd-8910-d0463a27b0ab-test-realms\") pod \"maas-keycloak-0\" (UID: \"ca25234a-9e20-42cd-8910-d0463a27b0ab\") " pod="keycloak-system/maas-keycloak-0" May 20 22:01:14.837285 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.837248 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-85gzm\" (UniqueName: \"kubernetes.io/projected/ca25234a-9e20-42cd-8910-d0463a27b0ab-kube-api-access-85gzm\") pod \"maas-keycloak-0\" (UID: \"ca25234a-9e20-42cd-8910-d0463a27b0ab\") " pod="keycloak-system/maas-keycloak-0" May 20 22:01:14.837915 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.837890 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/ca25234a-9e20-42cd-8910-d0463a27b0ab-test-realms\") pod \"maas-keycloak-0\" (UID: \"ca25234a-9e20-42cd-8910-d0463a27b0ab\") " pod="keycloak-system/maas-keycloak-0" May 20 22:01:14.846271 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.846247 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85gzm\" (UniqueName: \"kubernetes.io/projected/ca25234a-9e20-42cd-8910-d0463a27b0ab-kube-api-access-85gzm\") pod \"maas-keycloak-0\" (UID: \"ca25234a-9e20-42cd-8910-d0463a27b0ab\") " pod="keycloak-system/maas-keycloak-0" May 20 22:01:14.927844 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:14.927816 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" May 20 22:01:15.061509 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:15.061483 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] May 20 22:01:15.062155 ip-10-0-135-24 kubenswrapper[2571]: W0520 22:01:15.062131 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca25234a_9e20_42cd_8910_d0463a27b0ab.slice/crio-7e40c01c4e5efe7ac3a8d761723fb994ffbd5bb7dde86eaef4bc8e7c4aa36e87 WatchSource:0}: Error finding container 7e40c01c4e5efe7ac3a8d761723fb994ffbd5bb7dde86eaef4bc8e7c4aa36e87: Status 404 returned error can't find the container with id 7e40c01c4e5efe7ac3a8d761723fb994ffbd5bb7dde86eaef4bc8e7c4aa36e87 May 20 22:01:15.570622 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:15.570585 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ca25234a-9e20-42cd-8910-d0463a27b0ab","Type":"ContainerStarted","Data":"2b365e6532e58c41612453f010860cefe99fc6c179bca87f30dbb79f470994e1"} May 20 22:01:15.570622 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:15.570623 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ca25234a-9e20-42cd-8910-d0463a27b0ab","Type":"ContainerStarted","Data":"7e40c01c4e5efe7ac3a8d761723fb994ffbd5bb7dde86eaef4bc8e7c4aa36e87"} May 20 22:01:15.588172 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:15.588118 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.213017418 podStartE2EDuration="1.58809481s" podCreationTimestamp="2026-05-20 22:01:14 +0000 UTC" firstStartedPulling="2026-05-20 22:01:15.063912065 +0000 UTC m=+785.993728786" lastFinishedPulling="2026-05-20 22:01:15.438989448 +0000 UTC m=+786.368806178" observedRunningTime="2026-05-20 22:01:15.58784771 +0000 UTC m=+786.517664453" watchObservedRunningTime="2026-05-20 22:01:15.58809481 +0000 UTC m=+786.517911554" May 20 22:01:15.634051 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:15.634012 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6042d718-7555-4488-be3f-d28825093bb3" path="/var/lib/kubelet/pods/6042d718-7555-4488-be3f-d28825093bb3/volumes" May 20 22:01:15.928858 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:15.928822 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" May 20 22:01:15.930578 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:15.930538 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ca25234a-9e20-42cd-8910-d0463a27b0ab" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.60:9000/health/started\": dial tcp 10.132.0.60:9000: connect: connection refused" May 20 22:01:16.928991 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:16.928940 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ca25234a-9e20-42cd-8910-d0463a27b0ab" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.60:9000/health/started\": dial tcp 10.132.0.60:9000: connect: connection refused" May 20 22:01:17.928840 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:17.928789 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ca25234a-9e20-42cd-8910-d0463a27b0ab" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.60:9000/health/started\": dial tcp 10.132.0.60:9000: connect: connection refused" May 20 22:01:18.928817 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:18.928770 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ca25234a-9e20-42cd-8910-d0463a27b0ab" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.60:9000/health/started\": dial tcp 10.132.0.60:9000: connect: connection refused" May 20 22:01:19.929516 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:19.929467 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ca25234a-9e20-42cd-8910-d0463a27b0ab" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.60:9000/health/started\": dial tcp 10.132.0.60:9000: connect: connection refused" May 20 22:01:20.928999 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:20.928943 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ca25234a-9e20-42cd-8910-d0463a27b0ab" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.60:9000/health/started\": dial tcp 10.132.0.60:9000: connect: connection refused" May 20 22:01:21.929228 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:21.928778 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ca25234a-9e20-42cd-8910-d0463a27b0ab" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.60:9000/health/started\": dial tcp 10.132.0.60:9000: connect: connection refused" May 20 22:01:22.929100 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:22.929041 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ca25234a-9e20-42cd-8910-d0463a27b0ab" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.60:9000/health/started\": dial tcp 10.132.0.60:9000: connect: connection refused" May 20 22:01:23.928525 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:23.928470 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ca25234a-9e20-42cd-8910-d0463a27b0ab" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.60:9000/health/started\": dial tcp 10.132.0.60:9000: connect: connection refused" May 20 22:01:24.928269 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:24.928230 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" May 20 22:01:24.928600 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:24.928569 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ca25234a-9e20-42cd-8910-d0463a27b0ab" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.60:9000/health/started\": dial tcp 10.132.0.60:9000: connect: connection refused" May 20 22:01:25.928946 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:25.928897 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ca25234a-9e20-42cd-8910-d0463a27b0ab" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.60:9000/health/started\": dial tcp 10.132.0.60:9000: connect: connection refused" May 20 22:01:26.928691 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:26.928626 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ca25234a-9e20-42cd-8910-d0463a27b0ab" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.60:9000/health/started\": dial tcp 10.132.0.60:9000: connect: connection refused" May 20 22:01:27.929163 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:27.929114 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ca25234a-9e20-42cd-8910-d0463a27b0ab" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.60:9000/health/started\": dial tcp 10.132.0.60:9000: connect: connection refused" May 20 22:01:29.051499 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:29.051450 2571 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" May 20 22:01:29.071153 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:29.070844 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="ca25234a-9e20-42cd-8910-d0463a27b0ab" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 20 22:01:39.057485 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:39.057449 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" May 20 22:01:49.740479 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:49.740449 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6c9445bf8c-wkn78"] May 20 22:01:49.744077 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:49.744060 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c9445bf8c-wkn78" May 20 22:01:49.746626 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:49.746606 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" May 20 22:01:49.754115 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:49.754092 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c9445bf8c-wkn78"] May 20 22:01:49.892785 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:49.892755 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/56da751e-05a3-42b8-ac53-93064c04729c-oidc-ca\") pod \"authorino-6c9445bf8c-wkn78\" (UID: \"56da751e-05a3-42b8-ac53-93064c04729c\") " pod="kuadrant-system/authorino-6c9445bf8c-wkn78" May 20 22:01:49.892965 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:49.892809 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/56da751e-05a3-42b8-ac53-93064c04729c-tls-cert\") pod \"authorino-6c9445bf8c-wkn78\" (UID: \"56da751e-05a3-42b8-ac53-93064c04729c\") " pod="kuadrant-system/authorino-6c9445bf8c-wkn78" May 20 22:01:49.892965 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:49.892923 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7ts7\" (UniqueName: \"kubernetes.io/projected/56da751e-05a3-42b8-ac53-93064c04729c-kube-api-access-t7ts7\") pod \"authorino-6c9445bf8c-wkn78\" (UID: \"56da751e-05a3-42b8-ac53-93064c04729c\") " pod="kuadrant-system/authorino-6c9445bf8c-wkn78" May 20 22:01:49.993681 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:49.993588 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/56da751e-05a3-42b8-ac53-93064c04729c-oidc-ca\") pod \"authorino-6c9445bf8c-wkn78\" (UID: \"56da751e-05a3-42b8-ac53-93064c04729c\") " pod="kuadrant-system/authorino-6c9445bf8c-wkn78" May 20 22:01:49.993681 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:49.993672 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/56da751e-05a3-42b8-ac53-93064c04729c-tls-cert\") pod \"authorino-6c9445bf8c-wkn78\" (UID: \"56da751e-05a3-42b8-ac53-93064c04729c\") " pod="kuadrant-system/authorino-6c9445bf8c-wkn78" May 20 22:01:49.993885 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:49.993720 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7ts7\" (UniqueName: \"kubernetes.io/projected/56da751e-05a3-42b8-ac53-93064c04729c-kube-api-access-t7ts7\") pod \"authorino-6c9445bf8c-wkn78\" (UID: \"56da751e-05a3-42b8-ac53-93064c04729c\") " pod="kuadrant-system/authorino-6c9445bf8c-wkn78" May 20 22:01:49.994325 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:49.994294 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/56da751e-05a3-42b8-ac53-93064c04729c-oidc-ca\") pod \"authorino-6c9445bf8c-wkn78\" (UID: \"56da751e-05a3-42b8-ac53-93064c04729c\") " pod="kuadrant-system/authorino-6c9445bf8c-wkn78" May 20 22:01:49.996061 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:49.996042 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/56da751e-05a3-42b8-ac53-93064c04729c-tls-cert\") pod \"authorino-6c9445bf8c-wkn78\" (UID: \"56da751e-05a3-42b8-ac53-93064c04729c\") " pod="kuadrant-system/authorino-6c9445bf8c-wkn78" May 20 22:01:50.002617 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:50.002597 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7ts7\" (UniqueName: \"kubernetes.io/projected/56da751e-05a3-42b8-ac53-93064c04729c-kube-api-access-t7ts7\") pod \"authorino-6c9445bf8c-wkn78\" (UID: \"56da751e-05a3-42b8-ac53-93064c04729c\") " pod="kuadrant-system/authorino-6c9445bf8c-wkn78" May 20 22:01:50.053686 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:50.053634 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c9445bf8c-wkn78" May 20 22:01:50.188036 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:50.188005 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c9445bf8c-wkn78"] May 20 22:01:50.189036 ip-10-0-135-24 kubenswrapper[2571]: W0520 22:01:50.189006 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56da751e_05a3_42b8_ac53_93064c04729c.slice/crio-de84deb0415fe19ba5930ac635f119d353820fe2414e4308d03d7aeba4dab8d9 WatchSource:0}: Error finding container de84deb0415fe19ba5930ac635f119d353820fe2414e4308d03d7aeba4dab8d9: Status 404 returned error can't find the container with id de84deb0415fe19ba5930ac635f119d353820fe2414e4308d03d7aeba4dab8d9 May 20 22:01:50.739863 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:50.739828 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c9445bf8c-wkn78" event={"ID":"56da751e-05a3-42b8-ac53-93064c04729c","Type":"ContainerStarted","Data":"14a4085b4c4679c8c7a5f6625b76700c8668237ebf018dfaaa2db80d3b9a0e4e"} May 20 22:01:50.739863 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:50.739867 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c9445bf8c-wkn78" event={"ID":"56da751e-05a3-42b8-ac53-93064c04729c","Type":"ContainerStarted","Data":"de84deb0415fe19ba5930ac635f119d353820fe2414e4308d03d7aeba4dab8d9"} May 20 22:01:50.759011 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:50.758952 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6c9445bf8c-wkn78" podStartSLOduration=1.355891908 podStartE2EDuration="1.758933901s" podCreationTimestamp="2026-05-20 22:01:49 +0000 UTC" firstStartedPulling="2026-05-20 22:01:50.1903535 +0000 UTC m=+821.120170220" lastFinishedPulling="2026-05-20 22:01:50.593395492 +0000 UTC m=+821.523212213" observedRunningTime="2026-05-20 22:01:50.75624416 +0000 UTC m=+821.686060903" watchObservedRunningTime="2026-05-20 22:01:50.758933901 +0000 UTC m=+821.688750657" May 20 22:01:50.790162 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:50.790129 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-989486db9-46t8p"] May 20 22:01:50.790361 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:50.790337 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-989486db9-46t8p" podUID="cb6f358f-f45b-4885-9234-4586106a7061" containerName="authorino" containerID="cri-o://fa6816a47bf25bc4f5b7f8ff9bf98ade013011b3bcba0fc19516c14d8e07b3e6" gracePeriod=30 May 20 22:01:51.077703 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:51.077671 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-989486db9-46t8p" May 20 22:01:51.208474 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:51.208390 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cb6f358f-f45b-4885-9234-4586106a7061-tls-cert\") pod \"cb6f358f-f45b-4885-9234-4586106a7061\" (UID: \"cb6f358f-f45b-4885-9234-4586106a7061\") " May 20 22:01:51.208630 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:51.208524 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzgtv\" (UniqueName: \"kubernetes.io/projected/cb6f358f-f45b-4885-9234-4586106a7061-kube-api-access-kzgtv\") pod \"cb6f358f-f45b-4885-9234-4586106a7061\" (UID: \"cb6f358f-f45b-4885-9234-4586106a7061\") " May 20 22:01:51.210547 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:51.210518 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb6f358f-f45b-4885-9234-4586106a7061-kube-api-access-kzgtv" (OuterVolumeSpecName: "kube-api-access-kzgtv") pod "cb6f358f-f45b-4885-9234-4586106a7061" (UID: "cb6f358f-f45b-4885-9234-4586106a7061"). InnerVolumeSpecName "kube-api-access-kzgtv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 22:01:51.219213 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:51.219188 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb6f358f-f45b-4885-9234-4586106a7061-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "cb6f358f-f45b-4885-9234-4586106a7061" (UID: "cb6f358f-f45b-4885-9234-4586106a7061"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 22:01:51.310156 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:51.310128 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzgtv\" (UniqueName: \"kubernetes.io/projected/cb6f358f-f45b-4885-9234-4586106a7061-kube-api-access-kzgtv\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 22:01:51.310156 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:51.310156 2571 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cb6f358f-f45b-4885-9234-4586106a7061-tls-cert\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 22:01:51.745089 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:51.745051 2571 generic.go:358] "Generic (PLEG): container finished" podID="cb6f358f-f45b-4885-9234-4586106a7061" containerID="fa6816a47bf25bc4f5b7f8ff9bf98ade013011b3bcba0fc19516c14d8e07b3e6" exitCode=0 May 20 22:01:51.745251 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:51.745105 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-989486db9-46t8p" May 20 22:01:51.745251 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:51.745105 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-989486db9-46t8p" event={"ID":"cb6f358f-f45b-4885-9234-4586106a7061","Type":"ContainerDied","Data":"fa6816a47bf25bc4f5b7f8ff9bf98ade013011b3bcba0fc19516c14d8e07b3e6"} May 20 22:01:51.745251 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:51.745146 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-989486db9-46t8p" event={"ID":"cb6f358f-f45b-4885-9234-4586106a7061","Type":"ContainerDied","Data":"35dfffb50e054d10f225fa128e2e583e7a619ba96f701a19c14377cde6014162"} May 20 22:01:51.745251 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:51.745164 2571 scope.go:117] "RemoveContainer" containerID="fa6816a47bf25bc4f5b7f8ff9bf98ade013011b3bcba0fc19516c14d8e07b3e6" May 20 22:01:51.754229 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:51.754204 2571 scope.go:117] "RemoveContainer" containerID="fa6816a47bf25bc4f5b7f8ff9bf98ade013011b3bcba0fc19516c14d8e07b3e6" May 20 22:01:51.754496 ip-10-0-135-24 kubenswrapper[2571]: E0520 22:01:51.754474 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa6816a47bf25bc4f5b7f8ff9bf98ade013011b3bcba0fc19516c14d8e07b3e6\": container with ID starting with fa6816a47bf25bc4f5b7f8ff9bf98ade013011b3bcba0fc19516c14d8e07b3e6 not found: ID does not exist" containerID="fa6816a47bf25bc4f5b7f8ff9bf98ade013011b3bcba0fc19516c14d8e07b3e6" May 20 22:01:51.754586 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:51.754506 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa6816a47bf25bc4f5b7f8ff9bf98ade013011b3bcba0fc19516c14d8e07b3e6"} err="failed to get container status \"fa6816a47bf25bc4f5b7f8ff9bf98ade013011b3bcba0fc19516c14d8e07b3e6\": rpc error: code = NotFound desc = could not find container \"fa6816a47bf25bc4f5b7f8ff9bf98ade013011b3bcba0fc19516c14d8e07b3e6\": container with ID starting with fa6816a47bf25bc4f5b7f8ff9bf98ade013011b3bcba0fc19516c14d8e07b3e6 not found: ID does not exist" May 20 22:01:51.761869 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:51.761844 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-989486db9-46t8p"] May 20 22:01:51.767957 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:51.767923 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-989486db9-46t8p"] May 20 22:01:53.629319 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:53.629285 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb6f358f-f45b-4885-9234-4586106a7061" path="/var/lib/kubelet/pods/cb6f358f-f45b-4885-9234-4586106a7061/volumes" May 20 22:01:59.393663 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.393605 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt"] May 20 22:01:59.394238 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.394218 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb6f358f-f45b-4885-9234-4586106a7061" containerName="authorino" May 20 22:01:59.394327 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.394242 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb6f358f-f45b-4885-9234-4586106a7061" containerName="authorino" May 20 22:01:59.394384 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.394363 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb6f358f-f45b-4885-9234-4586106a7061" containerName="authorino" May 20 22:01:59.398977 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.398956 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" May 20 22:01:59.403284 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.403233 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 20 22:01:59.403436 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.403313 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-h2g5p\"" May 20 22:01:59.403436 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.403346 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 20 22:01:59.403605 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.403588 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 20 22:01:59.406516 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.406484 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt"] May 20 22:01:59.482564 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.482521 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvf4v\" (UniqueName: \"kubernetes.io/projected/42a51c1a-9d61-4f97-a043-b54f8a46743e-kube-api-access-fvf4v\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt\" (UID: \"42a51c1a-9d61-4f97-a043-b54f8a46743e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" May 20 22:01:59.482764 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.482654 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42a51c1a-9d61-4f97-a043-b54f8a46743e-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt\" (UID: \"42a51c1a-9d61-4f97-a043-b54f8a46743e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" May 20 22:01:59.482764 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.482722 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42a51c1a-9d61-4f97-a043-b54f8a46743e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt\" (UID: \"42a51c1a-9d61-4f97-a043-b54f8a46743e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" May 20 22:01:59.482890 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.482787 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42a51c1a-9d61-4f97-a043-b54f8a46743e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt\" (UID: \"42a51c1a-9d61-4f97-a043-b54f8a46743e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" May 20 22:01:59.482890 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.482851 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/42a51c1a-9d61-4f97-a043-b54f8a46743e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt\" (UID: \"42a51c1a-9d61-4f97-a043-b54f8a46743e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" May 20 22:01:59.482890 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.482881 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42a51c1a-9d61-4f97-a043-b54f8a46743e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt\" (UID: \"42a51c1a-9d61-4f97-a043-b54f8a46743e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" May 20 22:01:59.583506 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.583472 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42a51c1a-9d61-4f97-a043-b54f8a46743e-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt\" (UID: \"42a51c1a-9d61-4f97-a043-b54f8a46743e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" May 20 22:01:59.583710 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.583528 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42a51c1a-9d61-4f97-a043-b54f8a46743e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt\" (UID: \"42a51c1a-9d61-4f97-a043-b54f8a46743e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" May 20 22:01:59.583710 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.583571 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42a51c1a-9d61-4f97-a043-b54f8a46743e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt\" (UID: \"42a51c1a-9d61-4f97-a043-b54f8a46743e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" May 20 22:01:59.583710 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.583614 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/42a51c1a-9d61-4f97-a043-b54f8a46743e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt\" (UID: \"42a51c1a-9d61-4f97-a043-b54f8a46743e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" May 20 22:01:59.583710 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.583650 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42a51c1a-9d61-4f97-a043-b54f8a46743e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt\" (UID: \"42a51c1a-9d61-4f97-a043-b54f8a46743e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" May 20 22:01:59.583971 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.583744 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fvf4v\" (UniqueName: \"kubernetes.io/projected/42a51c1a-9d61-4f97-a043-b54f8a46743e-kube-api-access-fvf4v\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt\" (UID: \"42a51c1a-9d61-4f97-a043-b54f8a46743e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" May 20 22:01:59.583971 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.583959 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42a51c1a-9d61-4f97-a043-b54f8a46743e-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt\" (UID: \"42a51c1a-9d61-4f97-a043-b54f8a46743e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" May 20 22:01:59.584363 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.584266 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42a51c1a-9d61-4f97-a043-b54f8a46743e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt\" (UID: \"42a51c1a-9d61-4f97-a043-b54f8a46743e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" May 20 22:01:59.584363 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.584321 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/42a51c1a-9d61-4f97-a043-b54f8a46743e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt\" (UID: \"42a51c1a-9d61-4f97-a043-b54f8a46743e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" May 20 22:01:59.586454 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.586430 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42a51c1a-9d61-4f97-a043-b54f8a46743e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt\" (UID: \"42a51c1a-9d61-4f97-a043-b54f8a46743e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" May 20 22:01:59.586862 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.586839 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42a51c1a-9d61-4f97-a043-b54f8a46743e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt\" (UID: \"42a51c1a-9d61-4f97-a043-b54f8a46743e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" May 20 22:01:59.592903 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.592873 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvf4v\" (UniqueName: \"kubernetes.io/projected/42a51c1a-9d61-4f97-a043-b54f8a46743e-kube-api-access-fvf4v\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt\" (UID: \"42a51c1a-9d61-4f97-a043-b54f8a46743e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" May 20 22:01:59.709983 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.709894 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" May 20 22:01:59.849259 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:01:59.849131 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt"] May 20 22:01:59.853207 ip-10-0-135-24 kubenswrapper[2571]: W0520 22:01:59.853177 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42a51c1a_9d61_4f97_a043_b54f8a46743e.slice/crio-efef323e957d0c2becd4562dcb86b3b5a97dbd2d25caee8002949e71cc95fd4e WatchSource:0}: Error finding container efef323e957d0c2becd4562dcb86b3b5a97dbd2d25caee8002949e71cc95fd4e: Status 404 returned error can't find the container with id efef323e957d0c2becd4562dcb86b3b5a97dbd2d25caee8002949e71cc95fd4e May 20 22:02:00.784222 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:00.784180 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" event={"ID":"42a51c1a-9d61-4f97-a043-b54f8a46743e","Type":"ContainerStarted","Data":"efef323e957d0c2becd4562dcb86b3b5a97dbd2d25caee8002949e71cc95fd4e"} May 20 22:02:05.810701 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:05.810657 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" event={"ID":"42a51c1a-9d61-4f97-a043-b54f8a46743e","Type":"ContainerStarted","Data":"0a54127f2debbb2e95aff3e8dba340e024fea697e1913323ffae02908c85bbe8"} May 20 22:02:15.854467 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:15.854421 2571 generic.go:358] "Generic (PLEG): container finished" podID="42a51c1a-9d61-4f97-a043-b54f8a46743e" containerID="0a54127f2debbb2e95aff3e8dba340e024fea697e1913323ffae02908c85bbe8" exitCode=0 May 20 22:02:15.854889 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:15.854497 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" event={"ID":"42a51c1a-9d61-4f97-a043-b54f8a46743e","Type":"ContainerDied","Data":"0a54127f2debbb2e95aff3e8dba340e024fea697e1913323ffae02908c85bbe8"} May 20 22:02:17.864989 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:17.864953 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" event={"ID":"42a51c1a-9d61-4f97-a043-b54f8a46743e","Type":"ContainerStarted","Data":"d8c86d76d76941b63a9af035d8d8c8ce97aa10c6e2659334569dfaf141c39870"} May 20 22:02:17.865424 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:17.865180 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" May 20 22:02:17.887888 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:17.887843 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" podStartSLOduration=1.741161467 podStartE2EDuration="18.887828981s" podCreationTimestamp="2026-05-20 22:01:59 +0000 UTC" firstStartedPulling="2026-05-20 22:01:59.85611885 +0000 UTC m=+830.785935584" lastFinishedPulling="2026-05-20 22:02:17.002786377 +0000 UTC m=+847.932603098" observedRunningTime="2026-05-20 22:02:17.88550926 +0000 UTC m=+848.815326003" watchObservedRunningTime="2026-05-20 22:02:17.887828981 +0000 UTC m=+848.817645724" May 20 22:02:27.794856 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:27.794823 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f"] May 20 22:02:27.943000 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:27.942959 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f"] May 20 22:02:27.943156 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:27.943052 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" May 20 22:02:27.945915 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:27.945892 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 20 22:02:28.064541 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:28.064513 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/595dd4bb-5c87-4970-8f78-541a5831754e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-8cn8f\" (UID: \"595dd4bb-5c87-4970-8f78-541a5831754e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" May 20 22:02:28.064720 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:28.064568 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/595dd4bb-5c87-4970-8f78-541a5831754e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-8cn8f\" (UID: \"595dd4bb-5c87-4970-8f78-541a5831754e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" May 20 22:02:28.064720 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:28.064697 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/595dd4bb-5c87-4970-8f78-541a5831754e-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-8cn8f\" (UID: \"595dd4bb-5c87-4970-8f78-541a5831754e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" May 20 22:02:28.064827 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:28.064735 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrrwr\" (UniqueName: \"kubernetes.io/projected/595dd4bb-5c87-4970-8f78-541a5831754e-kube-api-access-zrrwr\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-8cn8f\" (UID: \"595dd4bb-5c87-4970-8f78-541a5831754e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" May 20 22:02:28.064827 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:28.064765 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/595dd4bb-5c87-4970-8f78-541a5831754e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-8cn8f\" (UID: \"595dd4bb-5c87-4970-8f78-541a5831754e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" May 20 22:02:28.064827 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:28.064790 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/595dd4bb-5c87-4970-8f78-541a5831754e-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-8cn8f\" (UID: \"595dd4bb-5c87-4970-8f78-541a5831754e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" May 20 22:02:28.166420 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:28.166384 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/595dd4bb-5c87-4970-8f78-541a5831754e-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-8cn8f\" (UID: \"595dd4bb-5c87-4970-8f78-541a5831754e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" May 20 22:02:28.166420 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:28.166429 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zrrwr\" (UniqueName: \"kubernetes.io/projected/595dd4bb-5c87-4970-8f78-541a5831754e-kube-api-access-zrrwr\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-8cn8f\" (UID: \"595dd4bb-5c87-4970-8f78-541a5831754e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" May 20 22:02:28.166735 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:28.166458 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/595dd4bb-5c87-4970-8f78-541a5831754e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-8cn8f\" (UID: \"595dd4bb-5c87-4970-8f78-541a5831754e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" May 20 22:02:28.166735 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:28.166482 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/595dd4bb-5c87-4970-8f78-541a5831754e-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-8cn8f\" (UID: \"595dd4bb-5c87-4970-8f78-541a5831754e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" May 20 22:02:28.166735 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:28.166580 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/595dd4bb-5c87-4970-8f78-541a5831754e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-8cn8f\" (UID: \"595dd4bb-5c87-4970-8f78-541a5831754e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" May 20 22:02:28.166735 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:28.166618 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/595dd4bb-5c87-4970-8f78-541a5831754e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-8cn8f\" (UID: \"595dd4bb-5c87-4970-8f78-541a5831754e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" May 20 22:02:28.166947 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:28.166891 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/595dd4bb-5c87-4970-8f78-541a5831754e-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-8cn8f\" (UID: \"595dd4bb-5c87-4970-8f78-541a5831754e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" May 20 22:02:28.166947 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:28.166936 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/595dd4bb-5c87-4970-8f78-541a5831754e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-8cn8f\" (UID: \"595dd4bb-5c87-4970-8f78-541a5831754e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" May 20 22:02:28.167058 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:28.167035 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/595dd4bb-5c87-4970-8f78-541a5831754e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-8cn8f\" (UID: \"595dd4bb-5c87-4970-8f78-541a5831754e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" May 20 22:02:28.169350 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:28.169320 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/595dd4bb-5c87-4970-8f78-541a5831754e-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-8cn8f\" (UID: \"595dd4bb-5c87-4970-8f78-541a5831754e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" May 20 22:02:28.169666 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:28.169614 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/595dd4bb-5c87-4970-8f78-541a5831754e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-8cn8f\" (UID: \"595dd4bb-5c87-4970-8f78-541a5831754e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" May 20 22:02:28.173756 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:28.173733 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrrwr\" (UniqueName: \"kubernetes.io/projected/595dd4bb-5c87-4970-8f78-541a5831754e-kube-api-access-zrrwr\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-8cn8f\" (UID: \"595dd4bb-5c87-4970-8f78-541a5831754e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" May 20 22:02:28.253724 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:28.253695 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" May 20 22:02:28.386127 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:28.386090 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f"] May 20 22:02:28.387395 ip-10-0-135-24 kubenswrapper[2571]: W0520 22:02:28.387370 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod595dd4bb_5c87_4970_8f78_541a5831754e.slice/crio-2023115b0b3ae8c7891856e2ee8f26c9d5936105fdb9dbc76d1c30d6eb68c909 WatchSource:0}: Error finding container 2023115b0b3ae8c7891856e2ee8f26c9d5936105fdb9dbc76d1c30d6eb68c909: Status 404 returned error can't find the container with id 2023115b0b3ae8c7891856e2ee8f26c9d5936105fdb9dbc76d1c30d6eb68c909 May 20 22:02:28.889727 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:28.889691 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt" May 20 22:02:28.910243 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:28.910195 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" event={"ID":"595dd4bb-5c87-4970-8f78-541a5831754e","Type":"ContainerStarted","Data":"c67bbeda3ddcbef98ed9b188a08d8dc3df944660722f4fb47496ca59016b55e2"} May 20 22:02:28.910243 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:28.910235 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" event={"ID":"595dd4bb-5c87-4970-8f78-541a5831754e","Type":"ContainerStarted","Data":"2023115b0b3ae8c7891856e2ee8f26c9d5936105fdb9dbc76d1c30d6eb68c909"} May 20 22:02:31.794692 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:31.794658 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr"] May 20 22:02:31.876194 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:31.876154 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr"] May 20 22:02:31.876381 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:31.876341 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" May 20 22:02:31.879137 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:31.879114 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" May 20 22:02:32.006504 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.006464 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad477ccb-ca32-4926-8818-c964d961503d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr\" (UID: \"ad477ccb-ca32-4926-8818-c964d961503d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" May 20 22:02:32.006504 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.006515 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pfl9\" (UniqueName: \"kubernetes.io/projected/ad477ccb-ca32-4926-8818-c964d961503d-kube-api-access-9pfl9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr\" (UID: \"ad477ccb-ca32-4926-8818-c964d961503d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" May 20 22:02:32.006803 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.006655 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad477ccb-ca32-4926-8818-c964d961503d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr\" (UID: \"ad477ccb-ca32-4926-8818-c964d961503d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" May 20 22:02:32.006803 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.006760 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad477ccb-ca32-4926-8818-c964d961503d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr\" (UID: \"ad477ccb-ca32-4926-8818-c964d961503d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" May 20 22:02:32.006990 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.006961 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad477ccb-ca32-4926-8818-c964d961503d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr\" (UID: \"ad477ccb-ca32-4926-8818-c964d961503d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" May 20 22:02:32.007151 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.007124 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ad477ccb-ca32-4926-8818-c964d961503d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr\" (UID: \"ad477ccb-ca32-4926-8818-c964d961503d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" May 20 22:02:32.007350 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.007185 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6"] May 20 22:02:32.034500 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.034468 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6"] May 20 22:02:32.034683 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.034574 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" May 20 22:02:32.037419 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.037400 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 20 22:02:32.108435 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.108400 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad477ccb-ca32-4926-8818-c964d961503d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr\" (UID: \"ad477ccb-ca32-4926-8818-c964d961503d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" May 20 22:02:32.108630 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.108468 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad477ccb-ca32-4926-8818-c964d961503d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr\" (UID: \"ad477ccb-ca32-4926-8818-c964d961503d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" May 20 22:02:32.108630 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.108509 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cdbfc901-a29a-41dd-8aa7-f917e0c308c4-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6\" (UID: \"cdbfc901-a29a-41dd-8aa7-f917e0c308c4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" May 20 22:02:32.108630 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.108601 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad477ccb-ca32-4926-8818-c964d961503d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr\" (UID: \"ad477ccb-ca32-4926-8818-c964d961503d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" May 20 22:02:32.108858 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.108679 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9lfr\" (UniqueName: \"kubernetes.io/projected/cdbfc901-a29a-41dd-8aa7-f917e0c308c4-kube-api-access-s9lfr\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6\" (UID: \"cdbfc901-a29a-41dd-8aa7-f917e0c308c4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" May 20 22:02:32.108858 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.108746 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdbfc901-a29a-41dd-8aa7-f917e0c308c4-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6\" (UID: \"cdbfc901-a29a-41dd-8aa7-f917e0c308c4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" May 20 22:02:32.108858 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.108775 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdbfc901-a29a-41dd-8aa7-f917e0c308c4-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6\" (UID: \"cdbfc901-a29a-41dd-8aa7-f917e0c308c4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" May 20 22:02:32.109040 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.108859 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad477ccb-ca32-4926-8818-c964d961503d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr\" (UID: \"ad477ccb-ca32-4926-8818-c964d961503d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" May 20 22:02:32.109040 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.108865 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ad477ccb-ca32-4926-8818-c964d961503d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr\" (UID: \"ad477ccb-ca32-4926-8818-c964d961503d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" May 20 22:02:32.109040 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.108910 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad477ccb-ca32-4926-8818-c964d961503d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr\" (UID: \"ad477ccb-ca32-4926-8818-c964d961503d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" May 20 22:02:32.109040 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.108946 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdbfc901-a29a-41dd-8aa7-f917e0c308c4-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6\" (UID: \"cdbfc901-a29a-41dd-8aa7-f917e0c308c4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" May 20 22:02:32.109040 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.109004 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad477ccb-ca32-4926-8818-c964d961503d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr\" (UID: \"ad477ccb-ca32-4926-8818-c964d961503d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" May 20 22:02:32.109304 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.109041 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9pfl9\" (UniqueName: \"kubernetes.io/projected/ad477ccb-ca32-4926-8818-c964d961503d-kube-api-access-9pfl9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr\" (UID: \"ad477ccb-ca32-4926-8818-c964d961503d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" May 20 22:02:32.109304 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.109074 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdbfc901-a29a-41dd-8aa7-f917e0c308c4-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6\" (UID: \"cdbfc901-a29a-41dd-8aa7-f917e0c308c4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" May 20 22:02:32.109304 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.109136 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ad477ccb-ca32-4926-8818-c964d961503d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr\" (UID: \"ad477ccb-ca32-4926-8818-c964d961503d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" May 20 22:02:32.110885 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.110851 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad477ccb-ca32-4926-8818-c964d961503d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr\" (UID: \"ad477ccb-ca32-4926-8818-c964d961503d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" May 20 22:02:32.111269 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.111251 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad477ccb-ca32-4926-8818-c964d961503d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr\" (UID: \"ad477ccb-ca32-4926-8818-c964d961503d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" May 20 22:02:32.117692 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.117621 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pfl9\" (UniqueName: \"kubernetes.io/projected/ad477ccb-ca32-4926-8818-c964d961503d-kube-api-access-9pfl9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr\" (UID: \"ad477ccb-ca32-4926-8818-c964d961503d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" May 20 22:02:32.189974 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.189940 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" May 20 22:02:32.210064 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.210037 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdbfc901-a29a-41dd-8aa7-f917e0c308c4-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6\" (UID: \"cdbfc901-a29a-41dd-8aa7-f917e0c308c4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" May 20 22:02:32.210180 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.210070 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdbfc901-a29a-41dd-8aa7-f917e0c308c4-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6\" (UID: \"cdbfc901-a29a-41dd-8aa7-f917e0c308c4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" May 20 22:02:32.210180 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.210113 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdbfc901-a29a-41dd-8aa7-f917e0c308c4-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6\" (UID: \"cdbfc901-a29a-41dd-8aa7-f917e0c308c4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" May 20 22:02:32.210180 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.210150 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdbfc901-a29a-41dd-8aa7-f917e0c308c4-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6\" (UID: \"cdbfc901-a29a-41dd-8aa7-f917e0c308c4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" May 20 22:02:32.210351 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.210237 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cdbfc901-a29a-41dd-8aa7-f917e0c308c4-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6\" (UID: \"cdbfc901-a29a-41dd-8aa7-f917e0c308c4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" May 20 22:02:32.210351 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.210294 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s9lfr\" (UniqueName: \"kubernetes.io/projected/cdbfc901-a29a-41dd-8aa7-f917e0c308c4-kube-api-access-s9lfr\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6\" (UID: \"cdbfc901-a29a-41dd-8aa7-f917e0c308c4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" May 20 22:02:32.210598 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.210574 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdbfc901-a29a-41dd-8aa7-f917e0c308c4-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6\" (UID: \"cdbfc901-a29a-41dd-8aa7-f917e0c308c4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" May 20 22:02:32.210753 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.210654 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdbfc901-a29a-41dd-8aa7-f917e0c308c4-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6\" (UID: \"cdbfc901-a29a-41dd-8aa7-f917e0c308c4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" May 20 22:02:32.210930 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.210903 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cdbfc901-a29a-41dd-8aa7-f917e0c308c4-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6\" (UID: \"cdbfc901-a29a-41dd-8aa7-f917e0c308c4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" May 20 22:02:32.212311 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.212290 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdbfc901-a29a-41dd-8aa7-f917e0c308c4-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6\" (UID: \"cdbfc901-a29a-41dd-8aa7-f917e0c308c4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" May 20 22:02:32.212843 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.212821 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdbfc901-a29a-41dd-8aa7-f917e0c308c4-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6\" (UID: \"cdbfc901-a29a-41dd-8aa7-f917e0c308c4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" May 20 22:02:32.218940 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.218912 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9lfr\" (UniqueName: \"kubernetes.io/projected/cdbfc901-a29a-41dd-8aa7-f917e0c308c4-kube-api-access-s9lfr\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6\" (UID: \"cdbfc901-a29a-41dd-8aa7-f917e0c308c4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" May 20 22:02:32.330463 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.330433 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr"] May 20 22:02:32.331477 ip-10-0-135-24 kubenswrapper[2571]: W0520 22:02:32.331443 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad477ccb_ca32_4926_8818_c964d961503d.slice/crio-cbc6b079f5a19af2947707aea6901bc3205727b1bb88ce8b9d95f77cb7edb24c WatchSource:0}: Error finding container cbc6b079f5a19af2947707aea6901bc3205727b1bb88ce8b9d95f77cb7edb24c: Status 404 returned error can't find the container with id cbc6b079f5a19af2947707aea6901bc3205727b1bb88ce8b9d95f77cb7edb24c May 20 22:02:32.345404 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.345379 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" May 20 22:02:32.514374 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.514337 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6"] May 20 22:02:32.515947 ip-10-0-135-24 kubenswrapper[2571]: W0520 22:02:32.515917 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdbfc901_a29a_41dd_8aa7_f917e0c308c4.slice/crio-53856e7c13208e2708804ae77ee4eeeb8aa69f7620ea387b49322cfe65268d43 WatchSource:0}: Error finding container 53856e7c13208e2708804ae77ee4eeeb8aa69f7620ea387b49322cfe65268d43: Status 404 returned error can't find the container with id 53856e7c13208e2708804ae77ee4eeeb8aa69f7620ea387b49322cfe65268d43 May 20 22:02:32.931291 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.931144 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" event={"ID":"ad477ccb-ca32-4926-8818-c964d961503d","Type":"ContainerStarted","Data":"6fe60bb1baf74fce976d048c3f3572f63e855ac3563239beab7c6dfa58791092"} May 20 22:02:32.931291 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.931187 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" event={"ID":"ad477ccb-ca32-4926-8818-c964d961503d","Type":"ContainerStarted","Data":"cbc6b079f5a19af2947707aea6901bc3205727b1bb88ce8b9d95f77cb7edb24c"} May 20 22:02:32.933965 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.933927 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" event={"ID":"cdbfc901-a29a-41dd-8aa7-f917e0c308c4","Type":"ContainerStarted","Data":"f79f4b7a61d3c47b8f358001067476b38cb8824f9e548118aa6205cfbe8e6670"} May 20 22:02:32.934137 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:32.933970 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" event={"ID":"cdbfc901-a29a-41dd-8aa7-f917e0c308c4","Type":"ContainerStarted","Data":"53856e7c13208e2708804ae77ee4eeeb8aa69f7620ea387b49322cfe65268d43"} May 20 22:02:34.944746 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:34.944709 2571 generic.go:358] "Generic (PLEG): container finished" podID="595dd4bb-5c87-4970-8f78-541a5831754e" containerID="c67bbeda3ddcbef98ed9b188a08d8dc3df944660722f4fb47496ca59016b55e2" exitCode=0 May 20 22:02:34.945282 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:34.944801 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" event={"ID":"595dd4bb-5c87-4970-8f78-541a5831754e","Type":"ContainerDied","Data":"c67bbeda3ddcbef98ed9b188a08d8dc3df944660722f4fb47496ca59016b55e2"} May 20 22:02:35.693766 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.693731 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc"] May 20 22:02:35.696491 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.696466 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" May 20 22:02:35.699188 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.699167 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 20 22:02:35.709929 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.709909 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc"] May 20 22:02:35.850116 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.850081 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc\" (UID: \"1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" May 20 22:02:35.850116 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.850116 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf6w8\" (UniqueName: \"kubernetes.io/projected/1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f-kube-api-access-mf6w8\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc\" (UID: \"1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" May 20 22:02:35.850334 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.850160 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc\" (UID: \"1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" May 20 22:02:35.850334 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.850236 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc\" (UID: \"1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" May 20 22:02:35.850417 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.850356 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc\" (UID: \"1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" May 20 22:02:35.850417 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.850408 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc\" (UID: \"1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" May 20 22:02:35.951101 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.951012 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc\" (UID: \"1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" May 20 22:02:35.951101 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.951078 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc\" (UID: \"1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" May 20 22:02:35.951617 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.951137 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc\" (UID: \"1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" May 20 22:02:35.951617 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.951194 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mf6w8\" (UniqueName: \"kubernetes.io/projected/1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f-kube-api-access-mf6w8\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc\" (UID: \"1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" May 20 22:02:35.951617 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.951281 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc\" (UID: \"1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" May 20 22:02:35.951617 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.951325 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc\" (UID: \"1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" May 20 22:02:35.951617 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.951398 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc\" (UID: \"1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" May 20 22:02:35.951946 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.951802 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc\" (UID: \"1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" May 20 22:02:35.952061 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.952035 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc\" (UID: \"1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" May 20 22:02:35.952570 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.952523 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" event={"ID":"595dd4bb-5c87-4970-8f78-541a5831754e","Type":"ContainerStarted","Data":"8ad26dc73e0661f8d6d05ae49b8285d60f1f219a1ffe46842a7ffb5a22a2c1b3"} May 20 22:02:35.952843 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.952824 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" May 20 22:02:35.953952 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.953921 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc\" (UID: \"1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" May 20 22:02:35.954149 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.954133 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc\" (UID: \"1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" May 20 22:02:35.960561 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.960536 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf6w8\" (UniqueName: \"kubernetes.io/projected/1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f-kube-api-access-mf6w8\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc\" (UID: \"1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" May 20 22:02:35.975352 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:35.974164 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" podStartSLOduration=8.755745914 podStartE2EDuration="8.974149898s" podCreationTimestamp="2026-05-20 22:02:27 +0000 UTC" firstStartedPulling="2026-05-20 22:02:34.945531181 +0000 UTC m=+865.875347902" lastFinishedPulling="2026-05-20 22:02:35.163935163 +0000 UTC m=+866.093751886" observedRunningTime="2026-05-20 22:02:35.973435109 +0000 UTC m=+866.903251852" watchObservedRunningTime="2026-05-20 22:02:35.974149898 +0000 UTC m=+866.903966641" May 20 22:02:36.010847 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:36.010817 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" May 20 22:02:36.174690 ip-10-0-135-24 kubenswrapper[2571]: W0520 22:02:36.174597 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1283c7b8_cf3c_4dd3_a4ab_1bab8b09ec8f.slice/crio-4660c8d862a8d15d08746a5f958fd0e836c1fce6a563c72f63066ebf6ecf2262 WatchSource:0}: Error finding container 4660c8d862a8d15d08746a5f958fd0e836c1fce6a563c72f63066ebf6ecf2262: Status 404 returned error can't find the container with id 4660c8d862a8d15d08746a5f958fd0e836c1fce6a563c72f63066ebf6ecf2262 May 20 22:02:36.174690 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:36.174605 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc"] May 20 22:02:36.959858 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:36.959811 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" event={"ID":"1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f","Type":"ContainerStarted","Data":"1280b66a3a3064fa005d0d76e0a4f1996df576d848dfa0ae03700f06a5f6cfc9"} May 20 22:02:36.960338 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:36.959867 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" event={"ID":"1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f","Type":"ContainerStarted","Data":"4660c8d862a8d15d08746a5f958fd0e836c1fce6a563c72f63066ebf6ecf2262"} May 20 22:02:38.970337 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:38.970303 2571 generic.go:358] "Generic (PLEG): container finished" podID="cdbfc901-a29a-41dd-8aa7-f917e0c308c4" containerID="f79f4b7a61d3c47b8f358001067476b38cb8824f9e548118aa6205cfbe8e6670" exitCode=0 May 20 22:02:38.970754 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:38.970381 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" event={"ID":"cdbfc901-a29a-41dd-8aa7-f917e0c308c4","Type":"ContainerDied","Data":"f79f4b7a61d3c47b8f358001067476b38cb8824f9e548118aa6205cfbe8e6670"} May 20 22:02:38.972051 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:38.971978 2571 generic.go:358] "Generic (PLEG): container finished" podID="ad477ccb-ca32-4926-8818-c964d961503d" containerID="6fe60bb1baf74fce976d048c3f3572f63e855ac3563239beab7c6dfa58791092" exitCode=0 May 20 22:02:38.972051 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:38.972019 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" event={"ID":"ad477ccb-ca32-4926-8818-c964d961503d","Type":"ContainerDied","Data":"6fe60bb1baf74fce976d048c3f3572f63e855ac3563239beab7c6dfa58791092"} May 20 22:02:39.977710 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:39.977671 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" event={"ID":"ad477ccb-ca32-4926-8818-c964d961503d","Type":"ContainerStarted","Data":"221132f24cee71dac23c9c7683e3e8bc28905771212c5e4c35172e638cbf4e5d"} May 20 22:02:39.978185 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:39.977901 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" May 20 22:02:39.979418 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:39.979394 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" event={"ID":"cdbfc901-a29a-41dd-8aa7-f917e0c308c4","Type":"ContainerStarted","Data":"3a38961e061bb09337d457f97ea7ee3eab803a746325de99c36bbf418b23db4d"} May 20 22:02:39.979595 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:39.979579 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" May 20 22:02:40.003695 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:39.999954 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" podStartSLOduration=8.807710802999999 podStartE2EDuration="8.999929702s" podCreationTimestamp="2026-05-20 22:02:31 +0000 UTC" firstStartedPulling="2026-05-20 22:02:38.972609727 +0000 UTC m=+869.902426448" lastFinishedPulling="2026-05-20 22:02:39.164828618 +0000 UTC m=+870.094645347" observedRunningTime="2026-05-20 22:02:39.996003033 +0000 UTC m=+870.925819780" watchObservedRunningTime="2026-05-20 22:02:39.999929702 +0000 UTC m=+870.929746447" May 20 22:02:40.017777 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:40.017726 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" podStartSLOduration=8.824910086 podStartE2EDuration="9.017713783s" podCreationTimestamp="2026-05-20 22:02:31 +0000 UTC" firstStartedPulling="2026-05-20 22:02:38.971361863 +0000 UTC m=+869.901178598" lastFinishedPulling="2026-05-20 22:02:39.164165567 +0000 UTC m=+870.093982295" observedRunningTime="2026-05-20 22:02:40.014362351 +0000 UTC m=+870.944179094" watchObservedRunningTime="2026-05-20 22:02:40.017713783 +0000 UTC m=+870.947530526" May 20 22:02:41.989016 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:41.988931 2571 generic.go:358] "Generic (PLEG): container finished" podID="1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f" containerID="1280b66a3a3064fa005d0d76e0a4f1996df576d848dfa0ae03700f06a5f6cfc9" exitCode=0 May 20 22:02:41.989016 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:41.988984 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" event={"ID":"1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f","Type":"ContainerDied","Data":"1280b66a3a3064fa005d0d76e0a4f1996df576d848dfa0ae03700f06a5f6cfc9"} May 20 22:02:42.994899 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:42.994859 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" event={"ID":"1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f","Type":"ContainerStarted","Data":"4cb7306578c78ae03e41b6eac3db2efa8339c1acd7236c46756eb6a8d76bf516"} May 20 22:02:42.995288 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:42.995081 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" May 20 22:02:43.014388 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:43.014337 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" podStartSLOduration=7.792899945 podStartE2EDuration="8.014323718s" podCreationTimestamp="2026-05-20 22:02:35 +0000 UTC" firstStartedPulling="2026-05-20 22:02:41.989679415 +0000 UTC m=+872.919496136" lastFinishedPulling="2026-05-20 22:02:42.211103174 +0000 UTC m=+873.140919909" observedRunningTime="2026-05-20 22:02:43.01261695 +0000 UTC m=+873.942433709" watchObservedRunningTime="2026-05-20 22:02:43.014323718 +0000 UTC m=+873.944140500" May 20 22:02:46.973773 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:46.973744 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-8cn8f" May 20 22:02:50.997316 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:50.997276 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr" May 20 22:02:50.998610 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:50.998589 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6" May 20 22:02:54.012250 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:02:54.012217 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc" May 20 22:03:05.739856 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:03:05.739782 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c9445bf8c-wkn78"] May 20 22:03:05.740285 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:03:05.740049 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-6c9445bf8c-wkn78" podUID="56da751e-05a3-42b8-ac53-93064c04729c" containerName="authorino" containerID="cri-o://14a4085b4c4679c8c7a5f6625b76700c8668237ebf018dfaaa2db80d3b9a0e4e" gracePeriod=30 May 20 22:03:06.003017 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:03:06.002960 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c9445bf8c-wkn78" May 20 22:03:06.097525 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:03:06.097489 2571 generic.go:358] "Generic (PLEG): container finished" podID="56da751e-05a3-42b8-ac53-93064c04729c" containerID="14a4085b4c4679c8c7a5f6625b76700c8668237ebf018dfaaa2db80d3b9a0e4e" exitCode=0 May 20 22:03:06.097730 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:03:06.097538 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c9445bf8c-wkn78" May 20 22:03:06.097730 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:03:06.097571 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c9445bf8c-wkn78" event={"ID":"56da751e-05a3-42b8-ac53-93064c04729c","Type":"ContainerDied","Data":"14a4085b4c4679c8c7a5f6625b76700c8668237ebf018dfaaa2db80d3b9a0e4e"} May 20 22:03:06.097730 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:03:06.097610 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c9445bf8c-wkn78" event={"ID":"56da751e-05a3-42b8-ac53-93064c04729c","Type":"ContainerDied","Data":"de84deb0415fe19ba5930ac635f119d353820fe2414e4308d03d7aeba4dab8d9"} May 20 22:03:06.097730 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:03:06.097670 2571 scope.go:117] "RemoveContainer" containerID="14a4085b4c4679c8c7a5f6625b76700c8668237ebf018dfaaa2db80d3b9a0e4e" May 20 22:03:06.106813 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:03:06.106795 2571 scope.go:117] "RemoveContainer" containerID="14a4085b4c4679c8c7a5f6625b76700c8668237ebf018dfaaa2db80d3b9a0e4e" May 20 22:03:06.107060 ip-10-0-135-24 kubenswrapper[2571]: E0520 22:03:06.107042 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14a4085b4c4679c8c7a5f6625b76700c8668237ebf018dfaaa2db80d3b9a0e4e\": container with ID starting with 14a4085b4c4679c8c7a5f6625b76700c8668237ebf018dfaaa2db80d3b9a0e4e not found: ID does not exist" containerID="14a4085b4c4679c8c7a5f6625b76700c8668237ebf018dfaaa2db80d3b9a0e4e" May 20 22:03:06.107106 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:03:06.107069 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14a4085b4c4679c8c7a5f6625b76700c8668237ebf018dfaaa2db80d3b9a0e4e"} err="failed to get container status \"14a4085b4c4679c8c7a5f6625b76700c8668237ebf018dfaaa2db80d3b9a0e4e\": rpc error: code = NotFound desc = could not find container \"14a4085b4c4679c8c7a5f6625b76700c8668237ebf018dfaaa2db80d3b9a0e4e\": container with ID starting with 14a4085b4c4679c8c7a5f6625b76700c8668237ebf018dfaaa2db80d3b9a0e4e not found: ID does not exist" May 20 22:03:06.139935 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:03:06.139913 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7ts7\" (UniqueName: \"kubernetes.io/projected/56da751e-05a3-42b8-ac53-93064c04729c-kube-api-access-t7ts7\") pod \"56da751e-05a3-42b8-ac53-93064c04729c\" (UID: \"56da751e-05a3-42b8-ac53-93064c04729c\") " May 20 22:03:06.140042 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:03:06.139980 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/56da751e-05a3-42b8-ac53-93064c04729c-tls-cert\") pod \"56da751e-05a3-42b8-ac53-93064c04729c\" (UID: \"56da751e-05a3-42b8-ac53-93064c04729c\") " May 20 22:03:06.140094 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:03:06.140054 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/56da751e-05a3-42b8-ac53-93064c04729c-oidc-ca\") pod \"56da751e-05a3-42b8-ac53-93064c04729c\" (UID: \"56da751e-05a3-42b8-ac53-93064c04729c\") " May 20 22:03:06.142012 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:03:06.141983 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56da751e-05a3-42b8-ac53-93064c04729c-kube-api-access-t7ts7" (OuterVolumeSpecName: "kube-api-access-t7ts7") pod "56da751e-05a3-42b8-ac53-93064c04729c" (UID: "56da751e-05a3-42b8-ac53-93064c04729c"). InnerVolumeSpecName "kube-api-access-t7ts7". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 22:03:06.145556 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:03:06.145534 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56da751e-05a3-42b8-ac53-93064c04729c-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "56da751e-05a3-42b8-ac53-93064c04729c" (UID: "56da751e-05a3-42b8-ac53-93064c04729c"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 22:03:06.152695 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:03:06.152672 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56da751e-05a3-42b8-ac53-93064c04729c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "56da751e-05a3-42b8-ac53-93064c04729c" (UID: "56da751e-05a3-42b8-ac53-93064c04729c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 22:03:06.241380 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:03:06.241357 2571 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/56da751e-05a3-42b8-ac53-93064c04729c-tls-cert\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 22:03:06.241380 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:03:06.241378 2571 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/56da751e-05a3-42b8-ac53-93064c04729c-oidc-ca\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 22:03:06.241505 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:03:06.241389 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7ts7\" (UniqueName: \"kubernetes.io/projected/56da751e-05a3-42b8-ac53-93064c04729c-kube-api-access-t7ts7\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 22:03:06.419965 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:03:06.419939 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c9445bf8c-wkn78"] May 20 22:03:06.423883 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:03:06.423864 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6c9445bf8c-wkn78"] May 20 22:03:07.629685 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:03:07.629628 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56da751e-05a3-42b8-ac53-93064c04729c" path="/var/lib/kubelet/pods/56da751e-05a3-42b8-ac53-93064c04729c/volumes" May 20 22:03:09.602061 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:03:09.602031 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/2.log" May 20 22:03:09.605224 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:03:09.605200 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/2.log" May 20 22:04:29.436583 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:29.436491 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c459d4f58-z8zpd"] May 20 22:04:29.437152 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:29.436751 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-c459d4f58-z8zpd" podUID="ff3f0987-18b5-4310-ae5d-1bb67f399cc8" containerName="manager" containerID="cri-o://a1beca4358de009b02add97f6e919fa6b1c096a19dac2ef7c458967e4d542a15" gracePeriod=30 May 20 22:04:29.689812 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:29.689756 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c459d4f58-z8zpd" May 20 22:04:29.831334 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:29.831304 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zfsd\" (UniqueName: \"kubernetes.io/projected/ff3f0987-18b5-4310-ae5d-1bb67f399cc8-kube-api-access-9zfsd\") pod \"ff3f0987-18b5-4310-ae5d-1bb67f399cc8\" (UID: \"ff3f0987-18b5-4310-ae5d-1bb67f399cc8\") " May 20 22:04:29.833358 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:29.833333 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff3f0987-18b5-4310-ae5d-1bb67f399cc8-kube-api-access-9zfsd" (OuterVolumeSpecName: "kube-api-access-9zfsd") pod "ff3f0987-18b5-4310-ae5d-1bb67f399cc8" (UID: "ff3f0987-18b5-4310-ae5d-1bb67f399cc8"). InnerVolumeSpecName "kube-api-access-9zfsd". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 22:04:29.932403 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:29.932374 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zfsd\" (UniqueName: \"kubernetes.io/projected/ff3f0987-18b5-4310-ae5d-1bb67f399cc8-kube-api-access-9zfsd\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 22:04:30.468134 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:30.468093 2571 generic.go:358] "Generic (PLEG): container finished" podID="ff3f0987-18b5-4310-ae5d-1bb67f399cc8" containerID="a1beca4358de009b02add97f6e919fa6b1c096a19dac2ef7c458967e4d542a15" exitCode=0 May 20 22:04:30.468552 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:30.468140 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c459d4f58-z8zpd" event={"ID":"ff3f0987-18b5-4310-ae5d-1bb67f399cc8","Type":"ContainerDied","Data":"a1beca4358de009b02add97f6e919fa6b1c096a19dac2ef7c458967e4d542a15"} May 20 22:04:30.468552 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:30.468180 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c459d4f58-z8zpd" event={"ID":"ff3f0987-18b5-4310-ae5d-1bb67f399cc8","Type":"ContainerDied","Data":"3bd6ddbb442da9824a1437963b6b25fea1ef87f5b240195fdcc1e139f082adc4"} May 20 22:04:30.468552 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:30.468187 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c459d4f58-z8zpd" May 20 22:04:30.468552 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:30.468196 2571 scope.go:117] "RemoveContainer" containerID="a1beca4358de009b02add97f6e919fa6b1c096a19dac2ef7c458967e4d542a15" May 20 22:04:30.477854 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:30.477839 2571 scope.go:117] "RemoveContainer" containerID="a1beca4358de009b02add97f6e919fa6b1c096a19dac2ef7c458967e4d542a15" May 20 22:04:30.478104 ip-10-0-135-24 kubenswrapper[2571]: E0520 22:04:30.478087 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1beca4358de009b02add97f6e919fa6b1c096a19dac2ef7c458967e4d542a15\": container with ID starting with a1beca4358de009b02add97f6e919fa6b1c096a19dac2ef7c458967e4d542a15 not found: ID does not exist" containerID="a1beca4358de009b02add97f6e919fa6b1c096a19dac2ef7c458967e4d542a15" May 20 22:04:30.478148 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:30.478111 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1beca4358de009b02add97f6e919fa6b1c096a19dac2ef7c458967e4d542a15"} err="failed to get container status \"a1beca4358de009b02add97f6e919fa6b1c096a19dac2ef7c458967e4d542a15\": rpc error: code = NotFound desc = could not find container \"a1beca4358de009b02add97f6e919fa6b1c096a19dac2ef7c458967e4d542a15\": container with ID starting with a1beca4358de009b02add97f6e919fa6b1c096a19dac2ef7c458967e4d542a15 not found: ID does not exist" May 20 22:04:30.491351 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:30.491330 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c459d4f58-z8zpd"] May 20 22:04:30.494353 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:30.494335 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c459d4f58-z8zpd"] May 20 22:04:31.190872 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:31.190838 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c459d4f58-ttbhf"] May 20 22:04:31.191281 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:31.191268 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56da751e-05a3-42b8-ac53-93064c04729c" containerName="authorino" May 20 22:04:31.191326 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:31.191283 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="56da751e-05a3-42b8-ac53-93064c04729c" containerName="authorino" May 20 22:04:31.191326 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:31.191299 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff3f0987-18b5-4310-ae5d-1bb67f399cc8" containerName="manager" May 20 22:04:31.191326 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:31.191304 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff3f0987-18b5-4310-ae5d-1bb67f399cc8" containerName="manager" May 20 22:04:31.191419 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:31.191373 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="56da751e-05a3-42b8-ac53-93064c04729c" containerName="authorino" May 20 22:04:31.191419 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:31.191382 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff3f0987-18b5-4310-ae5d-1bb67f399cc8" containerName="manager" May 20 22:04:31.195887 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:31.195864 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c459d4f58-ttbhf" May 20 22:04:31.198602 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:31.198582 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 20 22:04:31.198717 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:31.198585 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fnlnz\"" May 20 22:04:31.205423 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:31.205404 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c459d4f58-ttbhf"] May 20 22:04:31.245502 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:31.245473 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d642c\" (UniqueName: \"kubernetes.io/projected/2b36a731-d328-4b06-acd2-30033654f13c-kube-api-access-d642c\") pod \"maas-controller-c459d4f58-ttbhf\" (UID: \"2b36a731-d328-4b06-acd2-30033654f13c\") " pod="opendatahub/maas-controller-c459d4f58-ttbhf" May 20 22:04:31.346300 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:31.346270 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d642c\" (UniqueName: \"kubernetes.io/projected/2b36a731-d328-4b06-acd2-30033654f13c-kube-api-access-d642c\") pod \"maas-controller-c459d4f58-ttbhf\" (UID: \"2b36a731-d328-4b06-acd2-30033654f13c\") " pod="opendatahub/maas-controller-c459d4f58-ttbhf" May 20 22:04:31.354656 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:31.354622 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d642c\" (UniqueName: \"kubernetes.io/projected/2b36a731-d328-4b06-acd2-30033654f13c-kube-api-access-d642c\") pod \"maas-controller-c459d4f58-ttbhf\" (UID: \"2b36a731-d328-4b06-acd2-30033654f13c\") " pod="opendatahub/maas-controller-c459d4f58-ttbhf" May 20 22:04:31.506976 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:31.506891 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c459d4f58-ttbhf" May 20 22:04:31.628738 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:31.628706 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff3f0987-18b5-4310-ae5d-1bb67f399cc8" path="/var/lib/kubelet/pods/ff3f0987-18b5-4310-ae5d-1bb67f399cc8/volumes" May 20 22:04:31.635326 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:31.635305 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c459d4f58-ttbhf"] May 20 22:04:31.637357 ip-10-0-135-24 kubenswrapper[2571]: W0520 22:04:31.637322 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b36a731_d328_4b06_acd2_30033654f13c.slice/crio-b04e688f6373e1b28c7f5c8b24560d3ac293e2905a148043ea21266acd8d5ae9 WatchSource:0}: Error finding container b04e688f6373e1b28c7f5c8b24560d3ac293e2905a148043ea21266acd8d5ae9: Status 404 returned error can't find the container with id b04e688f6373e1b28c7f5c8b24560d3ac293e2905a148043ea21266acd8d5ae9 May 20 22:04:31.638595 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:31.638578 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 22:04:32.479087 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:32.479049 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c459d4f58-ttbhf" event={"ID":"2b36a731-d328-4b06-acd2-30033654f13c","Type":"ContainerStarted","Data":"5e8d54ebd6530eda56e8aa2bcde39cc4283866d5cda7a553b3fe24cf447e2586"} May 20 22:04:32.479087 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:32.479093 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c459d4f58-ttbhf" event={"ID":"2b36a731-d328-4b06-acd2-30033654f13c","Type":"ContainerStarted","Data":"b04e688f6373e1b28c7f5c8b24560d3ac293e2905a148043ea21266acd8d5ae9"} May 20 22:04:32.479317 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:32.479110 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c459d4f58-ttbhf" May 20 22:04:32.496452 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:32.496407 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-c459d4f58-ttbhf" podStartSLOduration=1.128402522 podStartE2EDuration="1.496393087s" podCreationTimestamp="2026-05-20 22:04:31 +0000 UTC" firstStartedPulling="2026-05-20 22:04:31.638711379 +0000 UTC m=+982.568528099" lastFinishedPulling="2026-05-20 22:04:32.006701934 +0000 UTC m=+982.936518664" observedRunningTime="2026-05-20 22:04:32.494820872 +0000 UTC m=+983.424637616" watchObservedRunningTime="2026-05-20 22:04:32.496393087 +0000 UTC m=+983.426209830" May 20 22:04:43.493088 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:04:43.493052 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c459d4f58-ttbhf" May 20 22:08:09.644907 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:08:09.644878 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/2.log" May 20 22:08:09.649741 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:08:09.649717 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/2.log" May 20 22:13:09.688407 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:13:09.688380 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/2.log" May 20 22:13:09.694511 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:13:09.694482 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/2.log" May 20 22:14:50.066559 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:14:50.066520 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zwhb8"] May 20 22:14:50.067198 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:14:50.066949 2571 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zwhb8" podUID="ed8af764-6851-41b9-9674-3693c09bc877" containerName="manager" containerID="cri-o://d3db9225b8d610542354e3e0955b12965931647b5dceab1d1eec72c139fdaaaf" gracePeriod=10 May 20 22:14:51.027004 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:14:51.026982 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zwhb8" May 20 22:14:51.073978 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:14:51.073947 2571 generic.go:358] "Generic (PLEG): container finished" podID="ed8af764-6851-41b9-9674-3693c09bc877" containerID="d3db9225b8d610542354e3e0955b12965931647b5dceab1d1eec72c139fdaaaf" exitCode=0 May 20 22:14:51.074345 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:14:51.074013 2571 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zwhb8" May 20 22:14:51.074345 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:14:51.074029 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zwhb8" event={"ID":"ed8af764-6851-41b9-9674-3693c09bc877","Type":"ContainerDied","Data":"d3db9225b8d610542354e3e0955b12965931647b5dceab1d1eec72c139fdaaaf"} May 20 22:14:51.074345 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:14:51.074072 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zwhb8" event={"ID":"ed8af764-6851-41b9-9674-3693c09bc877","Type":"ContainerDied","Data":"3ab10ec98ddce8adc8886a627ea6c1191a540d832b5c78cd914c3ac328e922c8"} May 20 22:14:51.074345 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:14:51.074093 2571 scope.go:117] "RemoveContainer" containerID="d3db9225b8d610542354e3e0955b12965931647b5dceab1d1eec72c139fdaaaf" May 20 22:14:51.086125 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:14:51.086061 2571 scope.go:117] "RemoveContainer" containerID="d3db9225b8d610542354e3e0955b12965931647b5dceab1d1eec72c139fdaaaf" May 20 22:14:51.086367 ip-10-0-135-24 kubenswrapper[2571]: E0520 22:14:51.086350 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3db9225b8d610542354e3e0955b12965931647b5dceab1d1eec72c139fdaaaf\": container with ID starting with d3db9225b8d610542354e3e0955b12965931647b5dceab1d1eec72c139fdaaaf not found: ID does not exist" containerID="d3db9225b8d610542354e3e0955b12965931647b5dceab1d1eec72c139fdaaaf" May 20 22:14:51.086429 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:14:51.086375 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3db9225b8d610542354e3e0955b12965931647b5dceab1d1eec72c139fdaaaf"} err="failed to get container status \"d3db9225b8d610542354e3e0955b12965931647b5dceab1d1eec72c139fdaaaf\": rpc error: code = NotFound desc = could not find container \"d3db9225b8d610542354e3e0955b12965931647b5dceab1d1eec72c139fdaaaf\": container with ID starting with d3db9225b8d610542354e3e0955b12965931647b5dceab1d1eec72c139fdaaaf not found: ID does not exist" May 20 22:14:51.130781 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:14:51.130764 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7phhc\" (UniqueName: \"kubernetes.io/projected/ed8af764-6851-41b9-9674-3693c09bc877-kube-api-access-7phhc\") pod \"ed8af764-6851-41b9-9674-3693c09bc877\" (UID: \"ed8af764-6851-41b9-9674-3693c09bc877\") " May 20 22:14:51.130869 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:14:51.130808 2571 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed8af764-6851-41b9-9674-3693c09bc877-extensions-socket-volume\") pod \"ed8af764-6851-41b9-9674-3693c09bc877\" (UID: \"ed8af764-6851-41b9-9674-3693c09bc877\") " May 20 22:14:51.131215 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:14:51.131189 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed8af764-6851-41b9-9674-3693c09bc877-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ed8af764-6851-41b9-9674-3693c09bc877" (UID: "ed8af764-6851-41b9-9674-3693c09bc877"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 22:14:51.132692 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:14:51.132670 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed8af764-6851-41b9-9674-3693c09bc877-kube-api-access-7phhc" (OuterVolumeSpecName: "kube-api-access-7phhc") pod "ed8af764-6851-41b9-9674-3693c09bc877" (UID: "ed8af764-6851-41b9-9674-3693c09bc877"). InnerVolumeSpecName "kube-api-access-7phhc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 22:14:51.232120 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:14:51.232095 2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed8af764-6851-41b9-9674-3693c09bc877-extensions-socket-volume\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 22:14:51.232120 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:14:51.232119 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7phhc\" (UniqueName: \"kubernetes.io/projected/ed8af764-6851-41b9-9674-3693c09bc877-kube-api-access-7phhc\") on node \"ip-10-0-135-24.ec2.internal\" DevicePath \"\"" May 20 22:14:51.401517 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:14:51.401486 2571 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zwhb8"] May 20 22:14:51.406950 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:14:51.406924 2571 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zwhb8"] May 20 22:14:51.628775 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:14:51.628745 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed8af764-6851-41b9-9674-3693c09bc877" path="/var/lib/kubelet/pods/ed8af764-6851-41b9-9674-3693c09bc877/volumes" May 20 22:18:09.730992 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:18:09.730962 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/2.log" May 20 22:18:09.739054 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:18:09.739029 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/2.log" May 20 22:23:09.776425 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:23:09.776395 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/2.log" May 20 22:23:09.784508 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:23:09.784485 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/2.log" May 20 22:25:43.625222 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:43.625129 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c459d4f58-ttbhf_2b36a731-d328-4b06-acd2-30033654f13c/manager/0.log" May 20 22:25:43.960476 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:43.960377 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c897df989-sq265_6f223683-5c1b-4b8b-a433-ce20e7a0b67e/manager/0.log" May 20 22:25:44.909038 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:44.909008 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2_2094ce51-e1f3-4424-91bc-cb93e88ab260/pull/0.log" May 20 22:25:44.914568 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:44.914548 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2_2094ce51-e1f3-4424-91bc-cb93e88ab260/extract/0.log" May 20 22:25:44.919720 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:44.919703 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2_2094ce51-e1f3-4424-91bc-cb93e88ab260/util/0.log" May 20 22:25:45.025264 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:45.025236 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5_2410c929-7cc1-4de6-aff9-36f75fd86533/util/0.log" May 20 22:25:45.031485 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:45.031463 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5_2410c929-7cc1-4de6-aff9-36f75fd86533/pull/0.log" May 20 22:25:45.037246 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:45.037225 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5_2410c929-7cc1-4de6-aff9-36f75fd86533/extract/0.log" May 20 22:25:45.140786 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:45.140757 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb_755d76f4-f07d-4dfc-98bd-5d3703beada5/extract/0.log" May 20 22:25:45.146315 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:45.146293 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb_755d76f4-f07d-4dfc-98bd-5d3703beada5/util/0.log" May 20 22:25:45.151755 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:45.151730 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb_755d76f4-f07d-4dfc-98bd-5d3703beada5/pull/0.log" May 20 22:25:45.262784 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:45.262707 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44_62d23714-87c6-4535-8c45-e49f6ea5d80e/util/0.log" May 20 22:25:45.268775 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:45.268754 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44_62d23714-87c6-4535-8c45-e49f6ea5d80e/pull/0.log" May 20 22:25:45.274285 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:45.274268 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44_62d23714-87c6-4535-8c45-e49f6ea5d80e/extract/0.log" May 20 22:25:45.835956 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:45.835922 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gnfsf_34644ddc-a69b-49be-ab78-a4b3a1509a2f/registry-server/0.log" May 20 22:25:46.178488 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:46.178412 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-fpncx_22bb1e9f-6873-4f5b-8670-3bafbc10ab1f/manager/0.log" May 20 22:25:46.499409 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:46.499322 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz_bb6e7204-e17f-4755-9908-6dfc8d8cbbd0/istio-proxy/0.log" May 20 22:25:46.945171 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:46.945137 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-65jrv_0841e57f-0583-4c58-9cd5-8257923b24fc/istio-proxy/0.log" May 20 22:25:47.172560 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:47.172530 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79b4479bfb-qqx5p_3d9fa4f6-b0e6-4d16-bc9a-c659362811db/router/0.log" May 20 22:25:47.625437 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:47.625384 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6_cdbfc901-a29a-41dd-8aa7-f917e0c308c4/storage-initializer/0.log" May 20 22:25:47.634534 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:47.634509 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-5npr6_cdbfc901-a29a-41dd-8aa7-f917e0c308c4/main/0.log" May 20 22:25:47.739882 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:47.739856 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-8cn8f_595dd4bb-5c87-4970-8f78-541a5831754e/storage-initializer/0.log" May 20 22:25:47.747103 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:47.747078 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-8cn8f_595dd4bb-5c87-4970-8f78-541a5831754e/main/0.log" May 20 22:25:47.857745 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:47.857712 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr_ad477ccb-ca32-4926-8818-c964d961503d/storage-initializer/0.log" May 20 22:25:47.885497 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:47.885427 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgc5mr_ad477ccb-ca32-4926-8818-c964d961503d/main/0.log" May 20 22:25:47.989172 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:47.989125 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc_1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f/storage-initializer/0.log" May 20 22:25:47.998497 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:47.998473 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-vngcc_1283c7b8-cf3c-4dd3-a4ab-1bab8b09ec8f/main/0.log" May 20 22:25:48.104298 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:48.104268 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt_42a51c1a-9d61-4f97-a043-b54f8a46743e/storage-initializer/0.log" May 20 22:25:48.111724 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:48.111701 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-fk5lt_42a51c1a-9d61-4f97-a043-b54f8a46743e/main/0.log" May 20 22:25:54.838501 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:54.838461 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cbqtt_ba1d0d2b-e3d1-456b-be6f-4165fb2f2bfe/global-pull-secret-syncer/0.log" May 20 22:25:54.949132 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:54.949102 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d549q_05e755d7-426f-4016-96a8-c1593d299301/konnectivity-agent/0.log" May 20 22:25:55.109685 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:55.109582 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-24.ec2.internal_ec0c946b0168eebf1df2dbb6a8fd579a/haproxy/0.log" May 20 22:25:58.952049 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:58.952019 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2_2094ce51-e1f3-4424-91bc-cb93e88ab260/extract/0.log" May 20 22:25:58.984906 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:58.984877 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2_2094ce51-e1f3-4424-91bc-cb93e88ab260/util/0.log" May 20 22:25:59.014198 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:59.014169 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592s2c2_2094ce51-e1f3-4424-91bc-cb93e88ab260/pull/0.log" May 20 22:25:59.053840 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:59.053814 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5_2410c929-7cc1-4de6-aff9-36f75fd86533/extract/0.log" May 20 22:25:59.082231 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:59.082207 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5_2410c929-7cc1-4de6-aff9-36f75fd86533/util/0.log" May 20 22:25:59.109523 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:59.109498 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qzln5_2410c929-7cc1-4de6-aff9-36f75fd86533/pull/0.log" May 20 22:25:59.147901 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:59.147876 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb_755d76f4-f07d-4dfc-98bd-5d3703beada5/extract/0.log" May 20 22:25:59.185731 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:59.185703 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb_755d76f4-f07d-4dfc-98bd-5d3703beada5/util/0.log" May 20 22:25:59.217102 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:59.217036 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rbxlb_755d76f4-f07d-4dfc-98bd-5d3703beada5/pull/0.log" May 20 22:25:59.262996 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:59.262975 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44_62d23714-87c6-4535-8c45-e49f6ea5d80e/extract/0.log" May 20 22:25:59.290074 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:59.290052 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44_62d23714-87c6-4535-8c45-e49f6ea5d80e/util/0.log" May 20 22:25:59.321977 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:59.321931 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef168j44_62d23714-87c6-4535-8c45-e49f6ea5d80e/pull/0.log" May 20 22:25:59.786319 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:59.786290 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gnfsf_34644ddc-a69b-49be-ab78-a4b3a1509a2f/registry-server/0.log" May 20 22:25:59.955439 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:25:59.955406 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-fpncx_22bb1e9f-6873-4f5b-8670-3bafbc10ab1f/manager/0.log" May 20 22:26:01.655237 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:01.655191 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e46bc857-de87-4466-b497-efe8b44c7905/alertmanager/0.log" May 20 22:26:01.681169 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:01.681143 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e46bc857-de87-4466-b497-efe8b44c7905/config-reloader/0.log" May 20 22:26:01.706865 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:01.706838 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e46bc857-de87-4466-b497-efe8b44c7905/kube-rbac-proxy-web/0.log" May 20 22:26:01.728427 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:01.728407 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e46bc857-de87-4466-b497-efe8b44c7905/kube-rbac-proxy/0.log" May 20 22:26:01.750755 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:01.750722 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e46bc857-de87-4466-b497-efe8b44c7905/kube-rbac-proxy-metric/0.log" May 20 22:26:01.773987 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:01.773962 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e46bc857-de87-4466-b497-efe8b44c7905/prom-label-proxy/0.log" May 20 22:26:01.797001 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:01.796962 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e46bc857-de87-4466-b497-efe8b44c7905/init-config-reloader/0.log" May 20 22:26:01.852999 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:01.852971 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-k6p4v_68adcd35-40d1-4ced-95ff-bb6dd6ded88d/cluster-monitoring-operator/0.log" May 20 22:26:01.994928 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:01.994842 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-pz686_8404b49b-0a27-4041-8187-fa4fe70abe6c/monitoring-plugin/0.log" May 20 22:26:02.172270 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:02.172240 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t4tlq_dabab527-5248-49e1-862e-b9292ee3a982/node-exporter/0.log" May 20 22:26:02.192772 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:02.192746 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t4tlq_dabab527-5248-49e1-862e-b9292ee3a982/kube-rbac-proxy/0.log" May 20 22:26:02.212889 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:02.212871 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t4tlq_dabab527-5248-49e1-862e-b9292ee3a982/init-textfile/0.log" May 20 22:26:02.240367 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:02.240338 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-wss9v_dd691911-058c-4ebb-8eeb-c7bcb972f144/kube-rbac-proxy-main/0.log" May 20 22:26:02.261936 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:02.261865 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-wss9v_dd691911-058c-4ebb-8eeb-c7bcb972f144/kube-rbac-proxy-self/0.log" May 20 22:26:02.285110 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:02.285086 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-wss9v_dd691911-058c-4ebb-8eeb-c7bcb972f144/openshift-state-metrics/0.log" May 20 22:26:02.596999 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:02.596971 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c54d897ff-nx9kr_64a698a8-9681-45dd-889f-fb503d49ef30/telemeter-client/0.log" May 20 22:26:02.619263 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:02.619237 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c54d897ff-nx9kr_64a698a8-9681-45dd-889f-fb503d49ef30/reload/0.log" May 20 22:26:02.644302 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:02.644280 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c54d897ff-nx9kr_64a698a8-9681-45dd-889f-fb503d49ef30/kube-rbac-proxy/0.log" May 20 22:26:02.671837 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:02.671817 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5485f79869-fsfcl_f56ad553-52af-4cc6-8843-12b4991f98f0/thanos-query/0.log" May 20 22:26:02.693497 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:02.693474 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5485f79869-fsfcl_f56ad553-52af-4cc6-8843-12b4991f98f0/kube-rbac-proxy-web/0.log" May 20 22:26:02.716741 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:02.716723 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5485f79869-fsfcl_f56ad553-52af-4cc6-8843-12b4991f98f0/kube-rbac-proxy/0.log" May 20 22:26:02.738232 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:02.738212 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5485f79869-fsfcl_f56ad553-52af-4cc6-8843-12b4991f98f0/prom-label-proxy/0.log" May 20 22:26:02.758813 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:02.758790 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5485f79869-fsfcl_f56ad553-52af-4cc6-8843-12b4991f98f0/kube-rbac-proxy-rules/0.log" May 20 22:26:02.781023 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:02.781003 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5485f79869-fsfcl_f56ad553-52af-4cc6-8843-12b4991f98f0/kube-rbac-proxy-metrics/0.log" May 20 22:26:03.240356 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.240319 2571 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq"] May 20 22:26:03.240864 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.240846 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed8af764-6851-41b9-9674-3693c09bc877" containerName="manager" May 20 22:26:03.240864 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.240866 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed8af764-6851-41b9-9674-3693c09bc877" containerName="manager" May 20 22:26:03.241051 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.241013 2571 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed8af764-6851-41b9-9674-3693c09bc877" containerName="manager" May 20 22:26:03.244653 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.244618 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq" May 20 22:26:03.247489 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.247465 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2wgpr\"/\"kube-root-ca.crt\"" May 20 22:26:03.247593 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.247489 2571 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2wgpr\"/\"default-dockercfg-hdmrk\"" May 20 22:26:03.248902 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.248883 2571 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2wgpr\"/\"openshift-service-ca.crt\"" May 20 22:26:03.255684 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.255661 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq"] May 20 22:26:03.269335 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.269311 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/63427c27-ca04-44ab-bdc0-8a3c8646e061-podres\") pod \"perf-node-gather-daemonset-9czjq\" (UID: \"63427c27-ca04-44ab-bdc0-8a3c8646e061\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq" May 20 22:26:03.269442 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.269380 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63427c27-ca04-44ab-bdc0-8a3c8646e061-lib-modules\") pod \"perf-node-gather-daemonset-9czjq\" (UID: \"63427c27-ca04-44ab-bdc0-8a3c8646e061\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq" May 20 22:26:03.269495 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.269447 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzjlv\" (UniqueName: \"kubernetes.io/projected/63427c27-ca04-44ab-bdc0-8a3c8646e061-kube-api-access-rzjlv\") pod \"perf-node-gather-daemonset-9czjq\" (UID: \"63427c27-ca04-44ab-bdc0-8a3c8646e061\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq" May 20 22:26:03.269534 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.269507 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63427c27-ca04-44ab-bdc0-8a3c8646e061-sys\") pod \"perf-node-gather-daemonset-9czjq\" (UID: \"63427c27-ca04-44ab-bdc0-8a3c8646e061\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq" May 20 22:26:03.269579 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.269540 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/63427c27-ca04-44ab-bdc0-8a3c8646e061-proc\") pod \"perf-node-gather-daemonset-9czjq\" (UID: \"63427c27-ca04-44ab-bdc0-8a3c8646e061\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq" May 20 22:26:03.370814 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.370793 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63427c27-ca04-44ab-bdc0-8a3c8646e061-lib-modules\") pod \"perf-node-gather-daemonset-9czjq\" (UID: \"63427c27-ca04-44ab-bdc0-8a3c8646e061\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq" May 20 22:26:03.370936 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.370846 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rzjlv\" (UniqueName: \"kubernetes.io/projected/63427c27-ca04-44ab-bdc0-8a3c8646e061-kube-api-access-rzjlv\") pod \"perf-node-gather-daemonset-9czjq\" (UID: \"63427c27-ca04-44ab-bdc0-8a3c8646e061\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq" May 20 22:26:03.370936 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.370883 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63427c27-ca04-44ab-bdc0-8a3c8646e061-sys\") pod \"perf-node-gather-daemonset-9czjq\" (UID: \"63427c27-ca04-44ab-bdc0-8a3c8646e061\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq" May 20 22:26:03.370936 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.370913 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/63427c27-ca04-44ab-bdc0-8a3c8646e061-proc\") pod \"perf-node-gather-daemonset-9czjq\" (UID: \"63427c27-ca04-44ab-bdc0-8a3c8646e061\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq" May 20 22:26:03.371045 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.370987 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63427c27-ca04-44ab-bdc0-8a3c8646e061-lib-modules\") pod \"perf-node-gather-daemonset-9czjq\" (UID: \"63427c27-ca04-44ab-bdc0-8a3c8646e061\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq" May 20 22:26:03.371045 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.371005 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63427c27-ca04-44ab-bdc0-8a3c8646e061-sys\") pod \"perf-node-gather-daemonset-9czjq\" (UID: \"63427c27-ca04-44ab-bdc0-8a3c8646e061\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq" May 20 22:26:03.371045 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.370987 2571 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/63427c27-ca04-44ab-bdc0-8a3c8646e061-podres\") pod \"perf-node-gather-daemonset-9czjq\" (UID: \"63427c27-ca04-44ab-bdc0-8a3c8646e061\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq" May 20 22:26:03.371138 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.371049 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/63427c27-ca04-44ab-bdc0-8a3c8646e061-proc\") pod \"perf-node-gather-daemonset-9czjq\" (UID: \"63427c27-ca04-44ab-bdc0-8a3c8646e061\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq" May 20 22:26:03.371138 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.371056 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/63427c27-ca04-44ab-bdc0-8a3c8646e061-podres\") pod \"perf-node-gather-daemonset-9czjq\" (UID: \"63427c27-ca04-44ab-bdc0-8a3c8646e061\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq" May 20 22:26:03.381320 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.381293 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzjlv\" (UniqueName: \"kubernetes.io/projected/63427c27-ca04-44ab-bdc0-8a3c8646e061-kube-api-access-rzjlv\") pod \"perf-node-gather-daemonset-9czjq\" (UID: \"63427c27-ca04-44ab-bdc0-8a3c8646e061\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq" May 20 22:26:03.555247 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.555175 2571 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq" May 20 22:26:03.688600 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.688576 2571 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq"] May 20 22:26:03.689578 ip-10-0-135-24 kubenswrapper[2571]: W0520 22:26:03.689554 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod63427c27_ca04_44ab_bdc0_8a3c8646e061.slice/crio-9125a478117cea4704fdc8a93c6563c22e852e557e6b7aca9dbf89e4a3e33fdb WatchSource:0}: Error finding container 9125a478117cea4704fdc8a93c6563c22e852e557e6b7aca9dbf89e4a3e33fdb: Status 404 returned error can't find the container with id 9125a478117cea4704fdc8a93c6563c22e852e557e6b7aca9dbf89e4a3e33fdb May 20 22:26:03.691262 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.691242 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 22:26:03.824327 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.824294 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq" event={"ID":"63427c27-ca04-44ab-bdc0-8a3c8646e061","Type":"ContainerStarted","Data":"854db5ad9f412cd4f1a569530810581f69caf547db028480433b5d6dd54984dc"} May 20 22:26:03.824327 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.824327 2571 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq" event={"ID":"63427c27-ca04-44ab-bdc0-8a3c8646e061","Type":"ContainerStarted","Data":"9125a478117cea4704fdc8a93c6563c22e852e557e6b7aca9dbf89e4a3e33fdb"} May 20 22:26:03.824468 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.824401 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq" May 20 22:26:03.847337 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:03.847297 2571 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq" podStartSLOduration=0.847285133 podStartE2EDuration="847.285133ms" podCreationTimestamp="2026-05-20 22:26:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 22:26:03.844921995 +0000 UTC m=+2274.774738735" watchObservedRunningTime="2026-05-20 22:26:03.847285133 +0000 UTC m=+2274.777101874" May 20 22:26:04.431152 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:04.431119 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/2.log" May 20 22:26:04.441532 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:04.441504 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-5k5cf_19896b49-a875-4842-82b1-58df8c94a12f/console-operator/3.log" May 20 22:26:04.905345 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:04.905317 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-777d8787c4-r8g5g_93b7154a-6a4c-4b0e-96d3-08fb850b7546/console/0.log" May 20 22:26:04.941972 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:04.941939 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-br4g4_9024a82d-d325-4287-abdd-00322b2dd160/download-server/0.log" May 20 22:26:06.467287 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:06.467256 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nxnd2_53d29758-e039-4bd4-93ed-9848d16a4bb8/dns/0.log" May 20 22:26:06.495339 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:06.495315 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nxnd2_53d29758-e039-4bd4-93ed-9848d16a4bb8/kube-rbac-proxy/0.log" May 20 22:26:06.526787 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:06.526763 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6wwrr_cf000cdd-dfa0-43d2-9df8-84baf9a14af4/dns-node-resolver/0.log" May 20 22:26:07.166329 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:07.166297 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-f4bddfcf6-8tts7_f076b995-22bf-420a-aa9b-a1d15f41c868/registry/1.log" May 20 22:26:07.179625 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:07.179595 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-f4bddfcf6-8tts7_f076b995-22bf-420a-aa9b-a1d15f41c868/registry/2.log" May 20 22:26:07.216961 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:07.216939 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-68fgb_aec000a4-9bb5-43e5-b40a-cfe251c18da5/node-ca/0.log" May 20 22:26:08.429924 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:08.429883 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b9b9wz_bb6e7204-e17f-4755-9908-6dfc8d8cbbd0/istio-proxy/0.log" May 20 22:26:08.674181 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:08.674154 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-65jrv_0841e57f-0583-4c58-9cd5-8257923b24fc/istio-proxy/0.log" May 20 22:26:08.823316 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:08.823289 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79b4479bfb-qqx5p_3d9fa4f6-b0e6-4d16-bc9a-c659362811db/router/0.log" May 20 22:26:09.399736 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:09.399710 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rnmkn_3099afb3-7f12-4cc5-9916-e30f1ce42c8b/serve-healthcheck-canary/0.log" May 20 22:26:09.847156 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:09.847103 2571 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-9czjq" May 20 22:26:09.853708 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:09.853685 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-2fql2_4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc/insights-operator/0.log" May 20 22:26:09.858414 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:09.858394 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-2fql2_4bb6cdfb-f9d6-4abd-afdc-98075e9ca4bc/insights-operator/1.log" May 20 22:26:10.062598 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:10.062571 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wrb8d_d92c9a24-562d-4c33-bf6d-20a6a30063cc/kube-rbac-proxy/0.log" May 20 22:26:10.085899 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:10.085873 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wrb8d_d92c9a24-562d-4c33-bf6d-20a6a30063cc/exporter/0.log" May 20 22:26:10.110878 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:10.110811 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wrb8d_d92c9a24-562d-4c33-bf6d-20a6a30063cc/extractor/0.log" May 20 22:26:12.309717 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:12.309687 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c459d4f58-ttbhf_2b36a731-d328-4b06-acd2-30033654f13c/manager/0.log" May 20 22:26:12.409678 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:12.409634 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c897df989-sq265_6f223683-5c1b-4b8b-a433-ce20e7a0b67e/manager/0.log" May 20 22:26:14.069591 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:14.069562 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8647c47685-jgjh9_ae5f9c37-af29-446b-aa5d-3496c311f163/manager/0.log" May 20 22:26:20.507859 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:20.507781 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-76n7v_28a7dd6d-170c-416f-95dc-24a6280778e7/kube-multus-additional-cni-plugins/0.log" May 20 22:26:20.536375 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:20.536339 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-76n7v_28a7dd6d-170c-416f-95dc-24a6280778e7/egress-router-binary-copy/0.log" May 20 22:26:20.562715 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:20.562689 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-76n7v_28a7dd6d-170c-416f-95dc-24a6280778e7/cni-plugins/0.log" May 20 22:26:20.587376 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:20.587357 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-76n7v_28a7dd6d-170c-416f-95dc-24a6280778e7/bond-cni-plugin/0.log" May 20 22:26:20.617345 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:20.617322 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-76n7v_28a7dd6d-170c-416f-95dc-24a6280778e7/routeoverride-cni/0.log" May 20 22:26:20.658983 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:20.658963 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-76n7v_28a7dd6d-170c-416f-95dc-24a6280778e7/whereabouts-cni-bincopy/0.log" May 20 22:26:20.700138 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:20.700116 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-76n7v_28a7dd6d-170c-416f-95dc-24a6280778e7/whereabouts-cni/0.log" May 20 22:26:21.071372 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:21.071343 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dn8hq_d8a62d5e-8a30-41db-ba35-c34cf1c2e56d/kube-multus/0.log" May 20 22:26:21.270813 ip-10-0-135-24 kubenswrapper[2571]: I0520 22:26:21.270780 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hdgzt_b785e9ea-de17-443e-b54a-ca50c16abeb6/network-metrics-daemon/0.log"