May 21 03:17:00.585414 ip-10-0-137-251 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 21 03:17:00.585429 ip-10-0-137-251 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 21 03:17:00.585439 ip-10-0-137-251 systemd[1]: kubelet.service: Failed with result 'resources'. May 21 03:17:00.585776 ip-10-0-137-251 systemd[1]: Failed to start Kubernetes Kubelet. May 21 03:17:10.682052 ip-10-0-137-251 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 21 03:17:10.682071 ip-10-0-137-251 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 00a6f380d0c34e6e9eefba8de8844b36 -- May 21 03:19:35.513665 ip-10-0-137-251 systemd[1]: Starting Kubernetes Kubelet... May 21 03:19:35.963724 ip-10-0-137-251 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 03:19:35.963724 ip-10-0-137-251 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 03:19:35.963724 ip-10-0-137-251 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 03:19:35.963724 ip-10-0-137-251 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 03:19:35.963724 ip-10-0-137-251 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 03:19:35.966780 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.966679 2575 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 03:19:35.970328 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970306 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 03:19:35.970328 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970324 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 03:19:35.970328 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970329 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 03:19:35.970328 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970334 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 03:19:35.970598 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970338 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 03:19:35.970598 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970343 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 03:19:35.970598 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970363 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 03:19:35.970598 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970368 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 03:19:35.970598 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970371 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 03:19:35.970598 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970375 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 03:19:35.970598 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970379 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 03:19:35.970598 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970384 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 03:19:35.970598 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970387 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 03:19:35.970598 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970391 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 03:19:35.970598 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970395 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 03:19:35.970598 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970398 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 03:19:35.970598 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970402 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 03:19:35.970598 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970406 2575 feature_gate.go:328] unrecognized feature gate: Example May 21 03:19:35.970598 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970410 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 03:19:35.970598 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970413 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 03:19:35.970598 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970420 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 03:19:35.970598 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970427 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 03:19:35.970598 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970432 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 03:19:35.970598 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970436 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 03:19:35.971190 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970440 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 03:19:35.971190 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970444 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 03:19:35.971190 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970448 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 03:19:35.971190 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970452 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 03:19:35.971190 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970456 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 03:19:35.971190 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970461 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 03:19:35.971190 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970465 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 03:19:35.971190 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970469 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 03:19:35.971190 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970473 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 03:19:35.971190 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970477 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 03:19:35.971190 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970481 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 21 03:19:35.971190 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970486 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 03:19:35.971190 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970490 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 03:19:35.971190 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970495 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 03:19:35.971190 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970499 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 03:19:35.971190 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970504 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 03:19:35.971190 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970508 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 03:19:35.971190 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970512 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 03:19:35.971190 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970519 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 03:19:35.971717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970526 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 03:19:35.971717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970531 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 03:19:35.971717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970535 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 03:19:35.971717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970540 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 03:19:35.971717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970546 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 03:19:35.971717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970551 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 03:19:35.971717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970555 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 03:19:35.971717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970559 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 03:19:35.971717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970563 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 03:19:35.971717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970567 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 03:19:35.971717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970571 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 03:19:35.971717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970575 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 03:19:35.971717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970580 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 03:19:35.971717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970584 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 03:19:35.971717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970588 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 03:19:35.971717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970592 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 03:19:35.971717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970596 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 03:19:35.971717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970601 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 03:19:35.971717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970605 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 03:19:35.971717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970609 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 03:19:35.972255 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970613 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 03:19:35.972255 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970617 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 03:19:35.972255 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970621 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 03:19:35.972255 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970627 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 03:19:35.972255 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970631 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 03:19:35.972255 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970635 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 03:19:35.972255 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970641 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 03:19:35.972255 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970646 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 03:19:35.972255 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970650 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 03:19:35.972255 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970655 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 03:19:35.972255 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970659 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 03:19:35.972255 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970663 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 03:19:35.972255 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970667 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 03:19:35.972255 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970672 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 03:19:35.972255 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970677 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 03:19:35.972255 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970682 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 03:19:35.972255 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970687 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 03:19:35.972255 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970691 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 03:19:35.972255 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970695 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 03:19:35.973054 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970699 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 03:19:35.973054 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970703 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 03:19:35.973054 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970708 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 03:19:35.973054 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.970712 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 03:19:35.973054 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972727 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 03:19:35.973054 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972738 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 03:19:35.973054 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972743 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 03:19:35.973054 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972748 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 03:19:35.973054 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972753 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 03:19:35.973054 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972758 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 03:19:35.973054 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972762 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 03:19:35.973054 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972766 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 03:19:35.973054 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972771 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 03:19:35.973054 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972775 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 03:19:35.973054 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972779 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 03:19:35.973054 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972784 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 03:19:35.973054 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972796 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 03:19:35.973054 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972801 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 03:19:35.973054 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972805 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 03:19:35.973054 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972809 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 03:19:35.973908 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972814 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 03:19:35.973908 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972818 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 21 03:19:35.973908 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972822 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 03:19:35.973908 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972826 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 03:19:35.973908 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972830 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 03:19:35.973908 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972834 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 03:19:35.973908 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972838 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 03:19:35.973908 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972843 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 03:19:35.973908 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972847 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 03:19:35.973908 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972851 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 03:19:35.973908 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972855 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 03:19:35.973908 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972859 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 03:19:35.973908 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972863 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 03:19:35.973908 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972869 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 03:19:35.973908 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972873 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 03:19:35.973908 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972878 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 03:19:35.973908 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972882 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 03:19:35.973908 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972886 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 03:19:35.973908 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972890 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 03:19:35.973908 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972894 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 03:19:35.974766 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972899 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 03:19:35.974766 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972904 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 03:19:35.974766 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972908 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 03:19:35.974766 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972915 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 03:19:35.974766 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972920 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 03:19:35.974766 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972925 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 03:19:35.974766 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972930 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 03:19:35.974766 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972934 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 03:19:35.974766 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972938 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 03:19:35.974766 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972952 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 03:19:35.974766 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972957 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 03:19:35.974766 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972961 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 03:19:35.974766 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972965 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 03:19:35.974766 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972969 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 03:19:35.974766 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972973 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 03:19:35.974766 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972978 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 03:19:35.974766 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972982 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 03:19:35.974766 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972986 2575 feature_gate.go:328] unrecognized feature gate: Example May 21 03:19:35.974766 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972990 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 03:19:35.974766 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972994 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 03:19:35.975282 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.972999 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 03:19:35.975282 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973003 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 03:19:35.975282 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973007 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 03:19:35.975282 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973010 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 03:19:35.975282 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973014 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 03:19:35.975282 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973020 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 03:19:35.975282 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973025 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 03:19:35.975282 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973029 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 03:19:35.975282 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973035 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 03:19:35.975282 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973039 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 03:19:35.975282 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973043 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 03:19:35.975282 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973047 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 03:19:35.975282 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973051 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 03:19:35.975282 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973056 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 03:19:35.975282 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973059 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 03:19:35.975282 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973063 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 03:19:35.975282 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973067 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 03:19:35.975282 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973073 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 03:19:35.975282 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973079 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 03:19:35.975873 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973084 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 03:19:35.975873 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973088 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 03:19:35.975873 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973092 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 03:19:35.975873 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973107 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 03:19:35.975873 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973112 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 03:19:35.975873 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973116 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 03:19:35.975873 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973120 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 03:19:35.975873 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973124 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 03:19:35.975873 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973128 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 03:19:35.975873 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973132 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 03:19:35.975873 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.973136 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 03:19:35.975873 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973248 2575 flags.go:64] FLAG: --address="0.0.0.0" May 21 03:19:35.975873 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973260 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 03:19:35.975873 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973276 2575 flags.go:64] FLAG: --anonymous-auth="true" May 21 03:19:35.975873 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973283 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 03:19:35.975873 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973290 2575 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 03:19:35.975873 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973295 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 03:19:35.975873 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973302 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 03:19:35.975873 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973310 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 03:19:35.975873 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973315 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 03:19:35.975873 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973320 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973325 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973331 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973336 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973342 2575 flags.go:64] FLAG: --cgroup-root="" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973362 2575 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973368 2575 flags.go:64] FLAG: --client-ca-file="" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973372 2575 flags.go:64] FLAG: --cloud-config="" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973377 2575 flags.go:64] FLAG: --cloud-provider="external" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973382 2575 flags.go:64] FLAG: --cluster-dns="[]" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973388 2575 flags.go:64] FLAG: --cluster-domain="" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973393 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973398 2575 flags.go:64] FLAG: --config-dir="" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973403 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973409 2575 flags.go:64] FLAG: --container-log-max-files="5" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973415 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973421 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973426 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973432 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973437 2575 flags.go:64] FLAG: --contention-profiling="false" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973442 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973447 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973452 2575 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973456 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973463 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 03:19:35.976462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973468 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973474 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973478 2575 flags.go:64] FLAG: --enable-load-reader="false" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973484 2575 flags.go:64] FLAG: --enable-server="true" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973489 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973496 2575 flags.go:64] FLAG: --event-burst="100" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973501 2575 flags.go:64] FLAG: --event-qps="50" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973506 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973511 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973516 2575 flags.go:64] FLAG: --eviction-hard="" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973522 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973527 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973532 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973536 2575 flags.go:64] FLAG: --eviction-soft="" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973541 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973545 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973550 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973555 2575 flags.go:64] FLAG: --experimental-mounter-path="" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973560 2575 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973565 2575 flags.go:64] FLAG: --fail-swap-on="true" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973569 2575 flags.go:64] FLAG: --feature-gates="" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973576 2575 flags.go:64] FLAG: --file-check-frequency="20s" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973581 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973586 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973592 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973598 2575 flags.go:64] FLAG: --healthz-port="10248" May 21 03:19:35.977067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973603 2575 flags.go:64] FLAG: --help="false" May 21 03:19:35.977741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973608 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-137-251.ec2.internal" May 21 03:19:35.977741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973613 2575 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 03:19:35.977741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973617 2575 flags.go:64] FLAG: --http-check-frequency="20s" May 21 03:19:35.977741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973622 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 03:19:35.977741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973627 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 03:19:35.977741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973633 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 03:19:35.977741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973639 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 03:19:35.977741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973643 2575 flags.go:64] FLAG: --image-service-endpoint="" May 21 03:19:35.977741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973648 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 03:19:35.977741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973653 2575 flags.go:64] FLAG: --kube-api-burst="100" May 21 03:19:35.977741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973658 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 03:19:35.977741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973664 2575 flags.go:64] FLAG: --kube-api-qps="50" May 21 03:19:35.977741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973668 2575 flags.go:64] FLAG: --kube-reserved="" May 21 03:19:35.977741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973674 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 03:19:35.977741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973679 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 03:19:35.977741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973684 2575 flags.go:64] FLAG: --kubelet-cgroups="" May 21 03:19:35.977741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973688 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 03:19:35.977741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973693 2575 flags.go:64] FLAG: --lock-file="" May 21 03:19:35.977741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973697 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 03:19:35.977741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973702 2575 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 03:19:35.977741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973707 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 03:19:35.977741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973716 2575 flags.go:64] FLAG: --log-json-split-stream="false" May 21 03:19:35.977741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973721 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 03:19:35.978294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973725 2575 flags.go:64] FLAG: --log-text-split-stream="false" May 21 03:19:35.978294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973730 2575 flags.go:64] FLAG: --logging-format="text" May 21 03:19:35.978294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973735 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 03:19:35.978294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973740 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 03:19:35.978294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973745 2575 flags.go:64] FLAG: --manifest-url="" May 21 03:19:35.978294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973749 2575 flags.go:64] FLAG: --manifest-url-header="" May 21 03:19:35.978294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973757 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 03:19:35.978294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973763 2575 flags.go:64] FLAG: --max-open-files="1000000" May 21 03:19:35.978294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973769 2575 flags.go:64] FLAG: --max-pods="110" May 21 03:19:35.978294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973774 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 03:19:35.978294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973779 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 03:19:35.978294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973784 2575 flags.go:64] FLAG: --memory-manager-policy="None" May 21 03:19:35.978294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973788 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 03:19:35.978294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973793 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 03:19:35.978294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973798 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 03:19:35.978294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973803 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 03:19:35.978294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973815 2575 flags.go:64] FLAG: --node-status-max-images="50" May 21 03:19:35.978294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973820 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 03:19:35.978294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973825 2575 flags.go:64] FLAG: --oom-score-adj="-999" May 21 03:19:35.978294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973829 2575 flags.go:64] FLAG: --pod-cidr="" May 21 03:19:35.978294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973835 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 03:19:35.978294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973846 2575 flags.go:64] FLAG: --pod-manifest-path="" May 21 03:19:35.978294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973851 2575 flags.go:64] FLAG: --pod-max-pids="-1" May 21 03:19:35.978294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973856 2575 flags.go:64] FLAG: --pods-per-core="0" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973860 2575 flags.go:64] FLAG: --port="10250" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973865 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973870 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a7da0f21c9dcc150" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973875 2575 flags.go:64] FLAG: --qos-reserved="" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973880 2575 flags.go:64] FLAG: --read-only-port="10255" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973885 2575 flags.go:64] FLAG: --register-node="true" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973890 2575 flags.go:64] FLAG: --register-schedulable="true" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973894 2575 flags.go:64] FLAG: --register-with-taints="" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973901 2575 flags.go:64] FLAG: --registry-burst="10" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973905 2575 flags.go:64] FLAG: --registry-qps="5" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973910 2575 flags.go:64] FLAG: --reserved-cpus="" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973914 2575 flags.go:64] FLAG: --reserved-memory="" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973920 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973925 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973930 2575 flags.go:64] FLAG: --rotate-certificates="false" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973934 2575 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973940 2575 flags.go:64] FLAG: --runonce="false" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973945 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973951 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973956 2575 flags.go:64] FLAG: --seccomp-default="false" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973960 2575 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973965 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973970 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973975 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973980 2575 flags.go:64] FLAG: --storage-driver-password="root" May 21 03:19:35.978932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973986 2575 flags.go:64] FLAG: --storage-driver-secure="false" May 21 03:19:35.979585 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973991 2575 flags.go:64] FLAG: --storage-driver-table="stats" May 21 03:19:35.979585 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.973996 2575 flags.go:64] FLAG: --storage-driver-user="root" May 21 03:19:35.979585 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.974001 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 03:19:35.979585 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.974006 2575 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 03:19:35.979585 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.974011 2575 flags.go:64] FLAG: --system-cgroups="" May 21 03:19:35.979585 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.974015 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 03:19:35.979585 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.974025 2575 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 03:19:35.979585 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.974030 2575 flags.go:64] FLAG: --tls-cert-file="" May 21 03:19:35.979585 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.974035 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 03:19:35.979585 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.974041 2575 flags.go:64] FLAG: --tls-min-version="" May 21 03:19:35.979585 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.974046 2575 flags.go:64] FLAG: --tls-private-key-file="" May 21 03:19:35.979585 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.974050 2575 flags.go:64] FLAG: --topology-manager-policy="none" May 21 03:19:35.979585 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.974055 2575 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 03:19:35.979585 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.974059 2575 flags.go:64] FLAG: --topology-manager-scope="container" May 21 03:19:35.979585 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.974064 2575 flags.go:64] FLAG: --v="2" May 21 03:19:35.979585 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.974071 2575 flags.go:64] FLAG: --version="false" May 21 03:19:35.979585 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.974078 2575 flags.go:64] FLAG: --vmodule="" May 21 03:19:35.979585 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.974084 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 03:19:35.979585 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.974089 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 03:19:35.979585 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974254 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 03:19:35.979585 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974260 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 03:19:35.979585 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974265 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 03:19:35.979585 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974269 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 03:19:35.979585 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974275 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 03:19:35.980163 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974284 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 03:19:35.980163 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974288 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 03:19:35.980163 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974294 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 03:19:35.980163 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974298 2575 feature_gate.go:328] unrecognized feature gate: Example May 21 03:19:35.980163 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974302 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 03:19:35.980163 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974306 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 03:19:35.980163 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974310 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 03:19:35.980163 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974314 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 03:19:35.980163 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974321 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 03:19:35.980163 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974325 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 03:19:35.980163 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974330 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 03:19:35.980163 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974334 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 03:19:35.980163 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974338 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 03:19:35.980163 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974342 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 03:19:35.980163 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974365 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 03:19:35.980163 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974370 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 03:19:35.980163 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974374 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 03:19:35.980163 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974378 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 03:19:35.980163 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974382 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 03:19:35.980163 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974386 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 03:19:35.980699 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974390 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 03:19:35.980699 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974395 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 03:19:35.980699 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974399 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 03:19:35.980699 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974403 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 03:19:35.980699 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974407 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 03:19:35.980699 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974411 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 03:19:35.980699 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974415 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 03:19:35.980699 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974419 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 03:19:35.980699 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974423 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 03:19:35.980699 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974427 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 03:19:35.980699 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974433 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 03:19:35.980699 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974437 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 03:19:35.980699 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974444 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 03:19:35.980699 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974449 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 03:19:35.980699 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974453 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 03:19:35.980699 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974457 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 03:19:35.980699 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974461 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 03:19:35.980699 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974465 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 03:19:35.980699 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974469 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 03:19:35.980699 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974474 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 03:19:35.981213 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974480 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 03:19:35.981213 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974484 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 03:19:35.981213 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974489 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 03:19:35.981213 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974494 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 03:19:35.981213 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974498 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 03:19:35.981213 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974502 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 03:19:35.981213 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974506 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 03:19:35.981213 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974510 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 03:19:35.981213 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974514 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 03:19:35.981213 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974519 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 03:19:35.981213 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974524 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 03:19:35.981213 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974528 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 03:19:35.981213 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974532 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 03:19:35.981213 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974536 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 03:19:35.981213 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974540 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 03:19:35.981213 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974545 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 03:19:35.981213 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974549 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 03:19:35.981213 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974552 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 03:19:35.981213 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974557 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 21 03:19:35.981717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974561 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 03:19:35.981717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974565 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 03:19:35.981717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974570 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 03:19:35.981717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974574 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 03:19:35.981717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974578 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 03:19:35.981717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974584 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 03:19:35.981717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974590 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 03:19:35.981717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974597 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 03:19:35.981717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974603 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 03:19:35.981717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974610 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 03:19:35.981717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974617 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 03:19:35.981717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974621 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 03:19:35.981717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974627 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 03:19:35.981717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974636 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 03:19:35.981717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974641 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 03:19:35.981717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974646 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 03:19:35.981717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974650 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 03:19:35.981717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974655 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 03:19:35.981717 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974659 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 03:19:35.982218 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974663 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 03:19:35.982218 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974667 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 03:19:35.982218 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.974671 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 03:19:35.982218 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.975398 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 03:19:35.982218 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.982082 2575 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 03:19:35.982218 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.982100 2575 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 03:19:35.982218 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982149 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 03:19:35.982218 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982154 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 03:19:35.982218 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982158 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 03:19:35.982218 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982161 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 03:19:35.982218 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982164 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 03:19:35.982218 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982167 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 03:19:35.982218 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982170 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 03:19:35.982218 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982173 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 03:19:35.982218 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982175 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 03:19:35.982616 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982178 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 03:19:35.982616 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982181 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 03:19:35.982616 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982183 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 03:19:35.982616 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982186 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 03:19:35.982616 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982189 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 03:19:35.982616 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982191 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 03:19:35.982616 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982194 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 03:19:35.982616 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982197 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 03:19:35.982616 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982200 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 03:19:35.982616 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982202 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 03:19:35.982616 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982205 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 03:19:35.982616 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982207 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 03:19:35.982616 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982210 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 03:19:35.982616 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982212 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 03:19:35.982616 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982215 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 03:19:35.982616 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982217 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 03:19:35.982616 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982220 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 03:19:35.982616 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982223 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 03:19:35.982616 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982226 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 03:19:35.983099 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982229 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 03:19:35.983099 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982232 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 03:19:35.983099 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982250 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 03:19:35.983099 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982255 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 03:19:35.983099 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982258 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 03:19:35.983099 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982263 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 03:19:35.983099 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982267 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 03:19:35.983099 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982270 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 03:19:35.983099 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982272 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 03:19:35.983099 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982275 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 03:19:35.983099 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982277 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 03:19:35.983099 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982280 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 03:19:35.983099 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982282 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 03:19:35.983099 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982285 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 03:19:35.983099 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982288 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 03:19:35.983099 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982291 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 03:19:35.983099 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982294 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 03:19:35.983099 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982298 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 03:19:35.983099 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982303 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 03:19:35.983603 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982306 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 03:19:35.983603 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982309 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 03:19:35.983603 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982312 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 03:19:35.983603 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982315 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 03:19:35.983603 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982318 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 03:19:35.983603 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982321 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 03:19:35.983603 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982323 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 03:19:35.983603 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982326 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 03:19:35.983603 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982329 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 03:19:35.983603 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982331 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 03:19:35.983603 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982334 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 03:19:35.983603 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982337 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 03:19:35.983603 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982339 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 03:19:35.983603 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982342 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 03:19:35.983603 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982345 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 03:19:35.983603 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982361 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 03:19:35.983603 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982364 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 03:19:35.983603 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982367 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 03:19:35.983603 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982370 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 03:19:35.983603 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982373 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 03:19:35.984096 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982375 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 03:19:35.984096 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982378 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 03:19:35.984096 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982380 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 03:19:35.984096 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982383 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 03:19:35.984096 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982385 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 03:19:35.984096 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982388 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 21 03:19:35.984096 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982391 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 03:19:35.984096 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982394 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 03:19:35.984096 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982397 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 03:19:35.984096 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982400 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 03:19:35.984096 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982403 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 03:19:35.984096 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982405 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 03:19:35.984096 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982408 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 03:19:35.984096 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982411 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 03:19:35.984096 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982414 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 03:19:35.984096 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982417 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 03:19:35.984096 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982420 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 03:19:35.984096 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982422 2575 feature_gate.go:328] unrecognized feature gate: Example May 21 03:19:35.984096 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982425 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 03:19:35.984593 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.982430 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 03:19:35.984593 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982535 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 03:19:35.984593 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982539 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 03:19:35.984593 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982542 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 03:19:35.984593 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982546 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 03:19:35.984593 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982548 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 03:19:35.984593 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982552 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 03:19:35.984593 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982556 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 03:19:35.984593 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982559 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 03:19:35.984593 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982562 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 03:19:35.984593 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982565 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 03:19:35.984593 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982568 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 03:19:35.984593 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982571 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 03:19:35.984593 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982573 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 03:19:35.984593 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982576 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 03:19:35.984959 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982578 2575 feature_gate.go:328] unrecognized feature gate: Example May 21 03:19:35.984959 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982581 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 03:19:35.984959 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982583 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 03:19:35.984959 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982586 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 03:19:35.984959 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982589 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 03:19:35.984959 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982591 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 03:19:35.984959 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982594 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 03:19:35.984959 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982597 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 03:19:35.984959 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982600 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 03:19:35.984959 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982602 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 03:19:35.984959 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982605 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 03:19:35.984959 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982607 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 03:19:35.984959 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982610 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 03:19:35.984959 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982612 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 03:19:35.984959 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982615 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 03:19:35.984959 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982618 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 03:19:35.984959 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982621 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 03:19:35.984959 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982623 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 03:19:35.984959 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982626 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 03:19:35.984959 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982629 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 03:19:35.985460 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982632 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 03:19:35.985460 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982635 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 03:19:35.985460 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982637 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 03:19:35.985460 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982640 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 03:19:35.985460 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982642 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 03:19:35.985460 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982645 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 03:19:35.985460 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982647 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 03:19:35.985460 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982649 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 03:19:35.985460 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982652 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 03:19:35.985460 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982655 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 03:19:35.985460 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982658 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 03:19:35.985460 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982660 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 03:19:35.985460 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982662 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 03:19:35.985460 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982665 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 03:19:35.985460 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982667 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 03:19:35.985460 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982670 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 03:19:35.985460 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982673 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 03:19:35.985460 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982675 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 03:19:35.985460 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982677 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 03:19:35.985460 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982680 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 03:19:35.986023 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982683 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 03:19:35.986023 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982686 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 03:19:35.986023 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982688 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 03:19:35.986023 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982691 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 03:19:35.986023 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982693 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 03:19:35.986023 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982696 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 03:19:35.986023 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982698 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 03:19:35.986023 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982701 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 03:19:35.986023 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982703 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 03:19:35.986023 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982705 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 03:19:35.986023 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982708 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 03:19:35.986023 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982710 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 03:19:35.986023 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982713 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 03:19:35.986023 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982716 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 03:19:35.986023 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982719 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 03:19:35.986023 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982721 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 03:19:35.986023 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982724 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 03:19:35.986023 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982727 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 03:19:35.986023 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982729 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 03:19:35.986513 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982732 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 03:19:35.986513 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982734 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 03:19:35.986513 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982737 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 03:19:35.986513 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982740 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 03:19:35.986513 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982744 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 03:19:35.986513 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982747 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 03:19:35.986513 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982750 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 21 03:19:35.986513 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982753 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 03:19:35.986513 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982756 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 03:19:35.986513 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982758 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 03:19:35.986513 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982761 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 03:19:35.986513 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982763 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 03:19:35.986513 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:35.982766 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 03:19:35.986513 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.982771 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 03:19:35.986513 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.983565 2575 server.go:962] "Client rotation is on, will bootstrap in background" May 21 03:19:35.986979 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.985527 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 03:19:35.986979 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.986483 2575 server.go:1019] "Starting client certificate rotation" May 21 03:19:35.986979 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.986616 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 03:19:35.986979 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:35.986669 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 03:19:36.018650 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.018618 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 03:19:36.020559 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.020539 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 03:19:36.037003 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.036981 2575 log.go:25] "Validated CRI v1 runtime API" May 21 03:19:36.042503 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.042488 2575 log.go:25] "Validated CRI v1 image API" May 21 03:19:36.044324 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.044311 2575 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 03:19:36.048537 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.048517 2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 03:19:36.048791 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.048768 2575 fs.go:135] Filesystem UUIDs: map[6b34862e-af8f-4eb5-9a4f-425fd357345e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9d693294-beb2-458c-aa50-8872442f9013:/dev/nvme0n1p4] May 21 03:19:36.048867 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.048791 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 03:19:36.053060 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.052943 2575 manager.go:217] Machine: {Timestamp:2026-05-21 03:19:36.052448087 +0000 UTC m=+0.418668470 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3019750 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec293206a9c376aa84446be17f7dd970 SystemUUID:ec293206-a9c3-76aa-8444-6be17f7dd970 BootID:00a6f380-d0c3-4e6e-9eef-ba8de8844b36 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c7:db:64:77:07 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c7:db:64:77:07 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:aa:d4:c0:78:53 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 03:19:36.053060 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.053045 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 03:19:36.053217 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.053162 2575 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 03:19:36.054988 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.054960 2575 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 03:19:36.055138 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.054990 2575 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-251.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 03:19:36.055182 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.055150 2575 topology_manager.go:138] "Creating topology manager with none policy" May 21 03:19:36.055182 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.055160 2575 container_manager_linux.go:306] "Creating device plugin manager" May 21 03:19:36.055182 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.055167 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 03:19:36.056079 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.056068 2575 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 03:19:36.058076 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.058065 2575 state_mem.go:36] "Initialized new in-memory state store" May 21 03:19:36.058197 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.058189 2575 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 03:19:36.060615 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.060604 2575 kubelet.go:491] "Attempting to sync node with API server" May 21 03:19:36.060653 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.060621 2575 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 03:19:36.060653 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.060635 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 03:19:36.060653 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.060644 2575 kubelet.go:397] "Adding apiserver pod source" May 21 03:19:36.060653 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.060653 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 03:19:36.062038 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.062020 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 03:19:36.062128 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.062048 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 03:19:36.064067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.064045 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hgsf6" May 21 03:19:36.066900 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.066884 2575 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 03:19:36.068683 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.068667 2575 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 03:19:36.069608 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.069594 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 03:19:36.069689 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.069615 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 03:19:36.069689 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.069624 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 03:19:36.069689 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.069632 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 03:19:36.069689 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.069644 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 03:19:36.069689 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.069652 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 03:19:36.069689 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.069663 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 03:19:36.069689 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.069672 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 03:19:36.069689 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.069683 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 03:19:36.069689 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.069693 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 03:19:36.069924 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.069707 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 03:19:36.069971 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.069937 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 03:19:36.070833 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.070822 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 03:19:36.070889 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.070836 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 03:19:36.071316 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.071296 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hgsf6" May 21 03:19:36.071967 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:36.071943 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-251.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 03:19:36.071967 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:36.071943 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 03:19:36.074222 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.074204 2575 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 03:19:36.074306 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.074250 2575 server.go:1295] "Started kubelet" May 21 03:19:36.074445 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.074325 2575 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 03:19:36.074498 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.074464 2575 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 03:19:36.075138 ip-10-0-137-251 systemd[1]: Started Kubernetes Kubelet. May 21 03:19:36.075690 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.075195 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 03:19:36.076175 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.076163 2575 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 03:19:36.077915 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.077900 2575 server.go:317] "Adding debug handlers to kubelet server" May 21 03:19:36.080141 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.080126 2575 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-251.ec2.internal" not found May 21 03:19:36.080914 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.080899 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 03:19:36.081488 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.081471 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 03:19:36.081603 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.081588 2575 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 03:19:36.081603 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.081603 2575 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 03:19:36.081728 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.081718 2575 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 03:19:36.081796 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.081785 2575 reconstruct.go:97] "Volume reconstruction finished" May 21 03:19:36.081836 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.081797 2575 reconciler.go:26] "Reconciler: start to sync state" May 21 03:19:36.082367 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.082331 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 03:19:36.082367 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.082366 2575 factory.go:55] Registering systemd factory May 21 03:19:36.082478 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.082377 2575 factory.go:223] Registration of the systemd container factory successfully May 21 03:19:36.082478 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:36.082400 2575 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 03:19:36.082588 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.082573 2575 factory.go:153] Registering CRI-O factory May 21 03:19:36.082621 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.082591 2575 factory.go:223] Registration of the crio container factory successfully May 21 03:19:36.082621 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.082605 2575 factory.go:103] Registering Raw factory May 21 03:19:36.082621 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.082614 2575 manager.go:1196] Started watching for new ooms in manager May 21 03:19:36.082726 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:36.082709 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-251.ec2.internal\" not found" May 21 03:19:36.083204 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.083189 2575 manager.go:319] Starting recovery of all containers May 21 03:19:36.084479 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.084453 2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 03:19:36.087449 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:36.087424 2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-251.ec2.internal\" not found" node="ip-10-0-137-251.ec2.internal" May 21 03:19:36.090255 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.090167 2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 03:19:36.096133 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.096018 2575 manager.go:324] Recovery completed May 21 03:19:36.097442 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.097427 2575 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-251.ec2.internal" not found May 21 03:19:36.100181 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.100169 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 03:19:36.101792 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.101778 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-251.ec2.internal" event="NodeHasSufficientMemory" May 21 03:19:36.101851 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.101803 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-251.ec2.internal" event="NodeHasNoDiskPressure" May 21 03:19:36.101851 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.101815 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-251.ec2.internal" event="NodeHasSufficientPID" May 21 03:19:36.102323 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.102310 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 03:19:36.102323 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.102321 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 03:19:36.102452 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.102337 2575 state_mem.go:36] "Initialized new in-memory state store" May 21 03:19:36.104533 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.104521 2575 policy_none.go:49] "None policy: Start" May 21 03:19:36.104574 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.104537 2575 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 03:19:36.104574 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.104547 2575 state_mem.go:35] "Initializing new in-memory state store" May 21 03:19:36.144979 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.144952 2575 manager.go:341] "Starting Device Plugin manager" May 21 03:19:36.144979 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:36.144984 2575 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 03:19:36.153827 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.144994 2575 server.go:85] "Starting device plugin registration server" May 21 03:19:36.153827 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.145269 2575 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 03:19:36.153827 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.145282 2575 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 03:19:36.153827 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.145374 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 03:19:36.153827 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.145453 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 03:19:36.153827 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.145466 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 03:19:36.153827 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:36.145995 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 03:19:36.153827 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:36.146028 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-251.ec2.internal\" not found" May 21 03:19:36.157401 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.157386 2575 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-251.ec2.internal" not found May 21 03:19:36.199934 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.199909 2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 03:19:36.200076 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.199945 2575 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 03:19:36.200076 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.199968 2575 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 03:19:36.200076 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.199977 2575 kubelet.go:2451] "Starting kubelet main sync loop" May 21 03:19:36.200076 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:36.200025 2575 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 03:19:36.202397 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.202365 2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 03:19:36.245603 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.245522 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 03:19:36.246664 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.246642 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-251.ec2.internal" event="NodeHasSufficientMemory" May 21 03:19:36.246746 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.246701 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-251.ec2.internal" event="NodeHasNoDiskPressure" May 21 03:19:36.246746 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.246712 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-251.ec2.internal" event="NodeHasSufficientPID" May 21 03:19:36.246746 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.246734 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-251.ec2.internal" May 21 03:19:36.253716 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.253700 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-251.ec2.internal" May 21 03:19:36.253776 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:36.253724 2575 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-251.ec2.internal\": node \"ip-10-0-137-251.ec2.internal\" not found" May 21 03:19:36.269013 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:36.268989 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-251.ec2.internal\" not found" May 21 03:19:36.300254 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.300223 2575 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-251.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-251.ec2.internal"] May 21 03:19:36.300323 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.300293 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 03:19:36.301670 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.301656 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-251.ec2.internal" event="NodeHasSufficientMemory" May 21 03:19:36.301746 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.301686 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-251.ec2.internal" event="NodeHasNoDiskPressure" May 21 03:19:36.301746 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.301696 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-251.ec2.internal" event="NodeHasSufficientPID" May 21 03:19:36.302868 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.302855 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 03:19:36.303055 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.303039 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-251.ec2.internal" May 21 03:19:36.303121 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.303077 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 03:19:36.303549 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.303531 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-251.ec2.internal" event="NodeHasSufficientMemory" May 21 03:19:36.303549 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.303546 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-251.ec2.internal" event="NodeHasSufficientMemory" May 21 03:19:36.303673 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.303563 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-251.ec2.internal" event="NodeHasNoDiskPressure" May 21 03:19:36.303673 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.303568 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-251.ec2.internal" event="NodeHasNoDiskPressure" May 21 03:19:36.303673 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.303575 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-251.ec2.internal" event="NodeHasSufficientPID" May 21 03:19:36.303673 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.303578 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-251.ec2.internal" event="NodeHasSufficientPID" May 21 03:19:36.304652 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.304636 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-251.ec2.internal" May 21 03:19:36.304739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.304665 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 03:19:36.305291 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.305276 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-251.ec2.internal" event="NodeHasSufficientMemory" May 21 03:19:36.305402 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.305304 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-251.ec2.internal" event="NodeHasNoDiskPressure" May 21 03:19:36.305402 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.305316 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-251.ec2.internal" event="NodeHasSufficientPID" May 21 03:19:36.328997 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:36.328977 2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-251.ec2.internal\" not found" node="ip-10-0-137-251.ec2.internal" May 21 03:19:36.333342 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:36.333324 2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-251.ec2.internal\" not found" node="ip-10-0-137-251.ec2.internal" May 21 03:19:36.369416 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:36.369383 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-251.ec2.internal\" not found" May 21 03:19:36.384223 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.384192 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0752d5a0a46de664f26314b021480f9d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-251.ec2.internal\" (UID: \"0752d5a0a46de664f26314b021480f9d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-251.ec2.internal" May 21 03:19:36.384223 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.384227 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0752d5a0a46de664f26314b021480f9d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-251.ec2.internal\" (UID: \"0752d5a0a46de664f26314b021480f9d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-251.ec2.internal" May 21 03:19:36.384408 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.384249 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d2d7b9af40cbe531b6adc203c8d4859b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-251.ec2.internal\" (UID: \"d2d7b9af40cbe531b6adc203c8d4859b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-251.ec2.internal" May 21 03:19:36.469544 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:36.469498 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-251.ec2.internal\" not found" May 21 03:19:36.484849 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.484820 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0752d5a0a46de664f26314b021480f9d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-251.ec2.internal\" (UID: \"0752d5a0a46de664f26314b021480f9d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-251.ec2.internal" May 21 03:19:36.484923 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.484853 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0752d5a0a46de664f26314b021480f9d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-251.ec2.internal\" (UID: \"0752d5a0a46de664f26314b021480f9d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-251.ec2.internal" May 21 03:19:36.484923 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.484869 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d2d7b9af40cbe531b6adc203c8d4859b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-251.ec2.internal\" (UID: \"d2d7b9af40cbe531b6adc203c8d4859b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-251.ec2.internal" May 21 03:19:36.484990 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.484941 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0752d5a0a46de664f26314b021480f9d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-251.ec2.internal\" (UID: \"0752d5a0a46de664f26314b021480f9d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-251.ec2.internal" May 21 03:19:36.484990 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.484972 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d2d7b9af40cbe531b6adc203c8d4859b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-251.ec2.internal\" (UID: \"d2d7b9af40cbe531b6adc203c8d4859b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-251.ec2.internal" May 21 03:19:36.484990 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.484941 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0752d5a0a46de664f26314b021480f9d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-251.ec2.internal\" (UID: \"0752d5a0a46de664f26314b021480f9d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-251.ec2.internal" May 21 03:19:36.570295 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:36.570217 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-251.ec2.internal\" not found" May 21 03:19:36.632710 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.632678 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-251.ec2.internal" May 21 03:19:36.636431 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.636414 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-251.ec2.internal" May 21 03:19:36.671363 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:36.671318 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-251.ec2.internal\" not found" May 21 03:19:36.771784 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:36.771741 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-251.ec2.internal\" not found" May 21 03:19:36.872300 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:36.872231 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-251.ec2.internal\" not found" May 21 03:19:36.972748 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:36.972707 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-251.ec2.internal\" not found" May 21 03:19:36.987023 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.986998 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 03:19:36.987168 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.987139 2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 03:19:36.987211 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:36.987179 2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 03:19:37.072760 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:37.072719 2575 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 03:19:37.072974 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:37.072819 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 03:14:36 +0000 UTC" deadline="2027-10-15 21:49:36.626333204 +0000 UTC" May 21 03:19:37.072974 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:37.072857 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12306h29m59.553480255s" May 21 03:19:37.077066 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:37.077043 2575 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 03:19:37.081819 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:37.081798 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 03:19:37.082231 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:37.082210 2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-251.ec2.internal" May 21 03:19:37.092738 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:37.092714 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 03:19:37.093754 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:37.093729 2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-251.ec2.internal" May 21 03:19:37.094020 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:37.094002 2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 03:19:37.101049 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:37.101032 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 03:19:37.109268 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:37.109248 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-m5pn2" May 21 03:19:37.116023 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:37.115996 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-m5pn2" May 21 03:19:37.147565 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:37.147532 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2d7b9af40cbe531b6adc203c8d4859b.slice/crio-9dc6c87878de6f9d350d0aaea2410a79f6a832018acd7132906e651de60b11f8 WatchSource:0}: Error finding container 9dc6c87878de6f9d350d0aaea2410a79f6a832018acd7132906e651de60b11f8: Status 404 returned error can't find the container with id 9dc6c87878de6f9d350d0aaea2410a79f6a832018acd7132906e651de60b11f8 May 21 03:19:37.147864 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:37.147843 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0752d5a0a46de664f26314b021480f9d.slice/crio-2ff7ce75fe797597b2fff08dd619a605058625c2271d534979616788ce35bf4c WatchSource:0}: Error finding container 2ff7ce75fe797597b2fff08dd619a605058625c2271d534979616788ce35bf4c: Status 404 returned error can't find the container with id 2ff7ce75fe797597b2fff08dd619a605058625c2271d534979616788ce35bf4c May 21 03:19:37.151327 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:37.151304 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 03:19:37.203406 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:37.203336 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-251.ec2.internal" event={"ID":"0752d5a0a46de664f26314b021480f9d","Type":"ContainerStarted","Data":"2ff7ce75fe797597b2fff08dd619a605058625c2271d534979616788ce35bf4c"} May 21 03:19:37.204232 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:37.204207 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-251.ec2.internal" event={"ID":"d2d7b9af40cbe531b6adc203c8d4859b","Type":"ContainerStarted","Data":"9dc6c87878de6f9d350d0aaea2410a79f6a832018acd7132906e651de60b11f8"} May 21 03:19:38.062932 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.062896 2575 apiserver.go:52] "Watching apiserver" May 21 03:19:38.070541 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.070517 2575 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 03:19:38.072558 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.072529 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-251.ec2.internal","openshift-multus/multus-additional-cni-plugins-svx44","openshift-multus/multus-ds6kj","openshift-multus/network-metrics-daemon-6qc5c","openshift-network-operator/iptables-alerter-g84kv","kube-system/konnectivity-agent-7wn9q","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96","openshift-cluster-node-tuning-operator/tuned-6xdsh","openshift-dns/node-resolver-nm86d","openshift-image-registry/node-ca-4jxvp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-251.ec2.internal","openshift-network-diagnostics/network-check-target-fqzfs","openshift-ovn-kubernetes/ovnkube-node-hkgwf"] May 21 03:19:38.074130 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.074111 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" May 21 03:19:38.075303 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.075283 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.076460 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.076441 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ds6kj" May 21 03:19:38.076680 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.076657 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 03:19:38.076865 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.076844 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-s6zgd\"" May 21 03:19:38.076965 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.076940 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 03:19:38.076965 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.076953 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 03:19:38.077664 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.077640 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 03:19:38.077775 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.077754 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:19:38.077875 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:38.077839 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qc5c" podUID="ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad" May 21 03:19:38.077938 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.077886 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 03:19:38.077990 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.077936 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 03:19:38.078047 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.077887 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 03:19:38.078098 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.078070 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 03:19:38.078098 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.078082 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-whh2n\"" May 21 03:19:38.078403 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.078384 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 03:19:38.078730 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.078686 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-clx5z\"" May 21 03:19:38.080055 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.079970 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g84kv" May 21 03:19:38.080254 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.080228 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7wn9q" May 21 03:19:38.081294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.081274 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.082182 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.082164 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 03:19:38.082279 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.082194 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 03:19:38.082672 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.082307 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-97flt\"" May 21 03:19:38.082888 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.082865 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nm86d" May 21 03:19:38.084624 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.084498 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 03:19:38.084718 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.084693 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 03:19:38.084936 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.084911 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kkfnr\"" May 21 03:19:38.085007 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.084957 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 03:19:38.085079 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.085062 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4zvfz\"" May 21 03:19:38.085469 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.085451 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 03:19:38.085550 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.085489 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 03:19:38.085975 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.085835 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tfzg8\"" May 21 03:19:38.086484 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.086143 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 03:19:38.086484 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.086225 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 03:19:38.087788 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.087766 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4jxvp" May 21 03:19:38.089601 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.089577 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.089697 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.089599 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:19:38.089697 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.089642 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 03:19:38.090183 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.089891 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 03:19:38.090183 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:38.089916 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqzfs" podUID="6b69a092-73c1-4098-b3af-3d38cce0cdb5" May 21 03:19:38.090183 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.090001 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 03:19:38.090407 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.090389 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8tq2p\"" May 21 03:19:38.091945 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.091925 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 03:19:38.092049 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.091955 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 03:19:38.092430 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.092413 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 03:19:38.092515 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.092451 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 03:19:38.092638 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.092621 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tt2q2\"" May 21 03:19:38.092715 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.092660 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-multus-conf-dir\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.092715 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.092692 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dc4295eb-090f-4bcb-9429-fb127fd63fa8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-svx44\" (UID: \"dc4295eb-090f-4bcb-9429-fb127fd63fa8\") " pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.092825 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.092769 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/48fa57f3-8bf4-4643-8fda-195ac1776d3c-hosts-file\") pod \"node-resolver-nm86d\" (UID: \"48fa57f3-8bf4-4643-8fda-195ac1776d3c\") " pod="openshift-dns/node-resolver-nm86d" May 21 03:19:38.092825 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.092798 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/407f0a95-fdbd-4818-bdcc-95d18dd22e70-device-dir\") pod \"aws-ebs-csi-driver-node-rtf96\" (UID: \"407f0a95-fdbd-4818-bdcc-95d18dd22e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" May 21 03:19:38.092923 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.092828 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-multus-socket-dir-parent\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.092923 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.092881 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/407f0a95-fdbd-4818-bdcc-95d18dd22e70-registration-dir\") pod \"aws-ebs-csi-driver-node-rtf96\" (UID: \"407f0a95-fdbd-4818-bdcc-95d18dd22e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" May 21 03:19:38.092923 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.092918 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/407f0a95-fdbd-4818-bdcc-95d18dd22e70-sys-fs\") pod \"aws-ebs-csi-driver-node-rtf96\" (UID: \"407f0a95-fdbd-4818-bdcc-95d18dd22e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" May 21 03:19:38.093069 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.092933 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 03:19:38.093069 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.092942 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5c127909-772f-4e17-8b3f-f221290a6efb-konnectivity-ca\") pod \"konnectivity-agent-7wn9q\" (UID: \"5c127909-772f-4e17-8b3f-f221290a6efb\") " pod="kube-system/konnectivity-agent-7wn9q" May 21 03:19:38.093069 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.092965 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc4295eb-090f-4bcb-9429-fb127fd63fa8-cnibin\") pod \"multus-additional-cni-plugins-svx44\" (UID: \"dc4295eb-090f-4bcb-9429-fb127fd63fa8\") " pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.093069 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.092995 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 03:19:38.093069 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.092989 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/407f0a95-fdbd-4818-bdcc-95d18dd22e70-etc-selinux\") pod \"aws-ebs-csi-driver-node-rtf96\" (UID: \"407f0a95-fdbd-4818-bdcc-95d18dd22e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" May 21 03:19:38.093069 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093031 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-cnibin\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.093069 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093054 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/407f0a95-fdbd-4818-bdcc-95d18dd22e70-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rtf96\" (UID: \"407f0a95-fdbd-4818-bdcc-95d18dd22e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" May 21 03:19:38.093384 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093093 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/407f0a95-fdbd-4818-bdcc-95d18dd22e70-socket-dir\") pod \"aws-ebs-csi-driver-node-rtf96\" (UID: \"407f0a95-fdbd-4818-bdcc-95d18dd22e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" May 21 03:19:38.093384 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093130 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-host-run-netns\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.093384 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093190 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-host-run-multus-certs\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.093384 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093217 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3bb551d3-f382-4950-b711-e3cfcde00d83-host-slash\") pod \"iptables-alerter-g84kv\" (UID: \"3bb551d3-f382-4950-b711-e3cfcde00d83\") " pod="openshift-network-operator/iptables-alerter-g84kv" May 21 03:19:38.093384 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093241 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8mlr\" (UniqueName: \"kubernetes.io/projected/48fa57f3-8bf4-4643-8fda-195ac1776d3c-kube-api-access-q8mlr\") pod \"node-resolver-nm86d\" (UID: \"48fa57f3-8bf4-4643-8fda-195ac1776d3c\") " pod="openshift-dns/node-resolver-nm86d" May 21 03:19:38.093384 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093263 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-sys\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.093384 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093277 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-os-release\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.093384 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093304 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dc4295eb-090f-4bcb-9429-fb127fd63fa8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-svx44\" (UID: \"dc4295eb-090f-4bcb-9429-fb127fd63fa8\") " pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.093691 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093376 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-etc-sysctl-d\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.093691 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093425 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-run\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.093691 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093449 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-etc-sysctl-conf\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.093691 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093487 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-var-lib-kubelet\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.093691 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093514 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-etc-tuned\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.093691 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093539 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-host-var-lib-cni-bin\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.093691 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093565 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-host-var-lib-kubelet\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.093691 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093589 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-hostroot\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.093691 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093613 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-multus-daemon-config\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.093691 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093649 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx2jm\" (UniqueName: \"kubernetes.io/projected/407f0a95-fdbd-4818-bdcc-95d18dd22e70-kube-api-access-wx2jm\") pod \"aws-ebs-csi-driver-node-rtf96\" (UID: \"407f0a95-fdbd-4818-bdcc-95d18dd22e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" May 21 03:19:38.093691 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093673 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-multus-cni-dir\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.094180 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093710 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl8jp\" (UniqueName: \"kubernetes.io/projected/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-kube-api-access-sl8jp\") pod \"network-metrics-daemon-6qc5c\" (UID: \"ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad\") " pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:19:38.094180 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093765 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3bb551d3-f382-4950-b711-e3cfcde00d83-iptables-alerter-script\") pod \"iptables-alerter-g84kv\" (UID: \"3bb551d3-f382-4950-b711-e3cfcde00d83\") " pod="openshift-network-operator/iptables-alerter-g84kv" May 21 03:19:38.094180 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093796 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5c127909-772f-4e17-8b3f-f221290a6efb-agent-certs\") pod \"konnectivity-agent-7wn9q\" (UID: \"5c127909-772f-4e17-8b3f-f221290a6efb\") " pod="kube-system/konnectivity-agent-7wn9q" May 21 03:19:38.094180 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093822 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48fa57f3-8bf4-4643-8fda-195ac1776d3c-tmp-dir\") pod \"node-resolver-nm86d\" (UID: \"48fa57f3-8bf4-4643-8fda-195ac1776d3c\") " pod="openshift-dns/node-resolver-nm86d" May 21 03:19:38.094180 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093850 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc4295eb-090f-4bcb-9429-fb127fd63fa8-cni-binary-copy\") pod \"multus-additional-cni-plugins-svx44\" (UID: \"dc4295eb-090f-4bcb-9429-fb127fd63fa8\") " pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.094180 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093874 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-etc-modprobe-d\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.094180 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093898 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs\") pod \"network-metrics-daemon-6qc5c\" (UID: \"ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad\") " pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:19:38.094180 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093922 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mkht\" (UniqueName: \"kubernetes.io/projected/3bb551d3-f382-4950-b711-e3cfcde00d83-kube-api-access-8mkht\") pod \"iptables-alerter-g84kv\" (UID: \"3bb551d3-f382-4950-b711-e3cfcde00d83\") " pod="openshift-network-operator/iptables-alerter-g84kv" May 21 03:19:38.094180 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093946 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc4295eb-090f-4bcb-9429-fb127fd63fa8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-svx44\" (UID: \"dc4295eb-090f-4bcb-9429-fb127fd63fa8\") " pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.094180 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093969 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-tmp\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.094180 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.093993 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-host-var-lib-cni-multus\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.094180 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.094017 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc4295eb-090f-4bcb-9429-fb127fd63fa8-system-cni-dir\") pod \"multus-additional-cni-plugins-svx44\" (UID: \"dc4295eb-090f-4bcb-9429-fb127fd63fa8\") " pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.094180 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.094053 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dc4295eb-090f-4bcb-9429-fb127fd63fa8-os-release\") pod \"multus-additional-cni-plugins-svx44\" (UID: \"dc4295eb-090f-4bcb-9429-fb127fd63fa8\") " pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.094180 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.094115 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-etc-kubernetes\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.094180 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.094170 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnvct\" (UniqueName: \"kubernetes.io/projected/dc4295eb-090f-4bcb-9429-fb127fd63fa8-kube-api-access-pnvct\") pod \"multus-additional-cni-plugins-svx44\" (UID: \"dc4295eb-090f-4bcb-9429-fb127fd63fa8\") " pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.094797 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.094201 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-etc-sysconfig\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.094797 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.094227 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjns6\" (UniqueName: \"kubernetes.io/projected/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-kube-api-access-cjns6\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.094797 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.094266 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-lib-modules\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.094797 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.094311 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-system-cni-dir\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.094797 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.094343 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-host-run-k8s-cni-cncf-io\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.094797 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.094393 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgktf\" (UniqueName: \"kubernetes.io/projected/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-kube-api-access-rgktf\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.094797 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.094416 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-etc-kubernetes\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.094797 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.094438 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-etc-systemd\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.094797 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.094460 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-cni-binary-copy\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.094797 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.094481 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-host\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.117304 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.117270 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 03:14:37 +0000 UTC" deadline="2028-03-07 06:28:53.74062397 +0000 UTC" May 21 03:19:38.117304 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.117303 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15747h9m15.623324604s" May 21 03:19:38.183607 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.183579 2575 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 03:19:38.194940 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.194912 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-host-var-lib-cni-bin\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.194940 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.194941 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-host-var-lib-kubelet\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.195164 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.194964 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-hostroot\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.195164 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.194982 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-multus-daemon-config\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.195164 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195023 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-host-slash\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.195164 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195043 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-host-var-lib-kubelet\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.195164 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195057 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-hostroot\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.195164 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195044 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-host-var-lib-cni-bin\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.195164 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195156 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wx2jm\" (UniqueName: \"kubernetes.io/projected/407f0a95-fdbd-4818-bdcc-95d18dd22e70-kube-api-access-wx2jm\") pod \"aws-ebs-csi-driver-node-rtf96\" (UID: \"407f0a95-fdbd-4818-bdcc-95d18dd22e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" May 21 03:19:38.196205 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195198 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-multus-cni-dir\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.196205 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195225 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sl8jp\" (UniqueName: \"kubernetes.io/projected/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-kube-api-access-sl8jp\") pod \"network-metrics-daemon-6qc5c\" (UID: \"ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad\") " pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:19:38.196205 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195253 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3bb551d3-f382-4950-b711-e3cfcde00d83-iptables-alerter-script\") pod \"iptables-alerter-g84kv\" (UID: \"3bb551d3-f382-4950-b711-e3cfcde00d83\") " pod="openshift-network-operator/iptables-alerter-g84kv" May 21 03:19:38.196205 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195280 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5c127909-772f-4e17-8b3f-f221290a6efb-agent-certs\") pod \"konnectivity-agent-7wn9q\" (UID: \"5c127909-772f-4e17-8b3f-f221290a6efb\") " pod="kube-system/konnectivity-agent-7wn9q" May 21 03:19:38.196205 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195325 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48fa57f3-8bf4-4643-8fda-195ac1776d3c-tmp-dir\") pod \"node-resolver-nm86d\" (UID: \"48fa57f3-8bf4-4643-8fda-195ac1776d3c\") " pod="openshift-dns/node-resolver-nm86d" May 21 03:19:38.196205 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195368 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc4295eb-090f-4bcb-9429-fb127fd63fa8-cni-binary-copy\") pod \"multus-additional-cni-plugins-svx44\" (UID: \"dc4295eb-090f-4bcb-9429-fb127fd63fa8\") " pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.196205 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195398 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-etc-modprobe-d\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.196205 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195425 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs\") pod \"network-metrics-daemon-6qc5c\" (UID: \"ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad\") " pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:19:38.196205 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195451 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8mkht\" (UniqueName: \"kubernetes.io/projected/3bb551d3-f382-4950-b711-e3cfcde00d83-kube-api-access-8mkht\") pod \"iptables-alerter-g84kv\" (UID: \"3bb551d3-f382-4950-b711-e3cfcde00d83\") " pod="openshift-network-operator/iptables-alerter-g84kv" May 21 03:19:38.196205 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195471 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-multus-cni-dir\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.196205 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195478 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc4295eb-090f-4bcb-9429-fb127fd63fa8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-svx44\" (UID: \"dc4295eb-090f-4bcb-9429-fb127fd63fa8\") " pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.196205 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195525 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-tmp\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.196205 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195565 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cb7a5cdb-9dde-424b-ac12-d08fbe5e86b6-serviceca\") pod \"node-ca-4jxvp\" (UID: \"cb7a5cdb-9dde-424b-ac12-d08fbe5e86b6\") " pod="openshift-image-registry/node-ca-4jxvp" May 21 03:19:38.196205 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195587 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-node-log\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.196205 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195607 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-host-cni-netd\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.196205 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195625 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc4295eb-090f-4bcb-9429-fb127fd63fa8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-svx44\" (UID: \"dc4295eb-090f-4bcb-9429-fb127fd63fa8\") " pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.196205 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195629 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-multus-daemon-config\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.197571 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195631 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-host-var-lib-cni-multus\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.197571 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195664 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-host-var-lib-cni-multus\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.197571 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195682 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc4295eb-090f-4bcb-9429-fb127fd63fa8-system-cni-dir\") pod \"multus-additional-cni-plugins-svx44\" (UID: \"dc4295eb-090f-4bcb-9429-fb127fd63fa8\") " pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.197571 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195707 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dc4295eb-090f-4bcb-9429-fb127fd63fa8-os-release\") pod \"multus-additional-cni-plugins-svx44\" (UID: \"dc4295eb-090f-4bcb-9429-fb127fd63fa8\") " pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.197571 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195723 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48fa57f3-8bf4-4643-8fda-195ac1776d3c-tmp-dir\") pod \"node-resolver-nm86d\" (UID: \"48fa57f3-8bf4-4643-8fda-195ac1776d3c\") " pod="openshift-dns/node-resolver-nm86d" May 21 03:19:38.197571 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195739 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddbq2\" (UniqueName: \"kubernetes.io/projected/6b69a092-73c1-4098-b3af-3d38cce0cdb5-kube-api-access-ddbq2\") pod \"network-check-target-fqzfs\" (UID: \"6b69a092-73c1-4098-b3af-3d38cce0cdb5\") " pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:19:38.197571 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195767 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-host-kubelet\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.197571 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195801 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-run-systemd\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.197571 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195830 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-etc-kubernetes\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.197571 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195859 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pnvct\" (UniqueName: \"kubernetes.io/projected/dc4295eb-090f-4bcb-9429-fb127fd63fa8-kube-api-access-pnvct\") pod \"multus-additional-cni-plugins-svx44\" (UID: \"dc4295eb-090f-4bcb-9429-fb127fd63fa8\") " pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.197571 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195888 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-etc-sysconfig\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.197571 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195916 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cjns6\" (UniqueName: \"kubernetes.io/projected/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-kube-api-access-cjns6\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.197571 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195943 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb7a5cdb-9dde-424b-ac12-d08fbe5e86b6-host\") pod \"node-ca-4jxvp\" (UID: \"cb7a5cdb-9dde-424b-ac12-d08fbe5e86b6\") " pod="openshift-image-registry/node-ca-4jxvp" May 21 03:19:38.197571 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195946 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dc4295eb-090f-4bcb-9429-fb127fd63fa8-os-release\") pod \"multus-additional-cni-plugins-svx44\" (UID: \"dc4295eb-090f-4bcb-9429-fb127fd63fa8\") " pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.197571 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195973 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-lib-modules\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.197571 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.195951 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 03:19:38.197571 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196021 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3bb551d3-f382-4950-b711-e3cfcde00d83-iptables-alerter-script\") pod \"iptables-alerter-g84kv\" (UID: \"3bb551d3-f382-4950-b711-e3cfcde00d83\") " pod="openshift-network-operator/iptables-alerter-g84kv" May 21 03:19:38.197571 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:38.196067 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:19:38.198490 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:38.196139 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs podName:ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad nodeName:}" failed. No retries permitted until 2026-05-21 03:19:38.696118896 +0000 UTC m=+3.062339268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs") pod "network-metrics-daemon-6qc5c" (UID: "ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:19:38.198490 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196304 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-etc-sysconfig\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.198490 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196345 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc4295eb-090f-4bcb-9429-fb127fd63fa8-system-cni-dir\") pod \"multus-additional-cni-plugins-svx44\" (UID: \"dc4295eb-090f-4bcb-9429-fb127fd63fa8\") " pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.198490 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196342 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-system-cni-dir\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.198490 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196405 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-host-run-k8s-cni-cncf-io\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.198490 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196430 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rgktf\" (UniqueName: \"kubernetes.io/projected/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-kube-api-access-rgktf\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.198490 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196454 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-systemd-units\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.198490 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196462 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-etc-kubernetes\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.198490 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196478 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-host-run-ovn-kubernetes\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.198490 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196505 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3b16d171-5803-4a52-8faa-b6290af8b5dc-ovnkube-script-lib\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.198490 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196511 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-lib-modules\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.198490 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196532 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-etc-kubernetes\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.198490 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196544 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-etc-modprobe-d\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.198490 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196558 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-etc-systemd\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.198490 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196562 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-system-cni-dir\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.198490 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196451 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc4295eb-090f-4bcb-9429-fb127fd63fa8-cni-binary-copy\") pod \"multus-additional-cni-plugins-svx44\" (UID: \"dc4295eb-090f-4bcb-9429-fb127fd63fa8\") " pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.198490 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196596 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-host-run-k8s-cni-cncf-io\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.199299 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196617 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-etc-kubernetes\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.199299 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196623 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-etc-systemd\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.199299 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196627 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-var-lib-openvswitch\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.199299 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196661 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-cni-binary-copy\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.199299 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196680 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-host\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.199299 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196703 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-multus-conf-dir\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.199299 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196727 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dc4295eb-090f-4bcb-9429-fb127fd63fa8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-svx44\" (UID: \"dc4295eb-090f-4bcb-9429-fb127fd63fa8\") " pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.199299 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196757 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-host-run-netns\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.199299 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196767 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-host\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.199299 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196780 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-run-ovn\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.199299 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196812 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/48fa57f3-8bf4-4643-8fda-195ac1776d3c-hosts-file\") pod \"node-resolver-nm86d\" (UID: \"48fa57f3-8bf4-4643-8fda-195ac1776d3c\") " pod="openshift-dns/node-resolver-nm86d" May 21 03:19:38.199299 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196850 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3b16d171-5803-4a52-8faa-b6290af8b5dc-ovnkube-config\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.199299 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196915 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/407f0a95-fdbd-4818-bdcc-95d18dd22e70-device-dir\") pod \"aws-ebs-csi-driver-node-rtf96\" (UID: \"407f0a95-fdbd-4818-bdcc-95d18dd22e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" May 21 03:19:38.199299 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196953 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-multus-socket-dir-parent\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.199299 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.196992 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-run-openvswitch\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.199299 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197014 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-log-socket\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.199299 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197040 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgt4r\" (UniqueName: \"kubernetes.io/projected/3b16d171-5803-4a52-8faa-b6290af8b5dc-kube-api-access-lgt4r\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.200071 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197069 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/407f0a95-fdbd-4818-bdcc-95d18dd22e70-registration-dir\") pod \"aws-ebs-csi-driver-node-rtf96\" (UID: \"407f0a95-fdbd-4818-bdcc-95d18dd22e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" May 21 03:19:38.200071 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197094 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/407f0a95-fdbd-4818-bdcc-95d18dd22e70-sys-fs\") pod \"aws-ebs-csi-driver-node-rtf96\" (UID: \"407f0a95-fdbd-4818-bdcc-95d18dd22e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" May 21 03:19:38.200071 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197125 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5c127909-772f-4e17-8b3f-f221290a6efb-konnectivity-ca\") pod \"konnectivity-agent-7wn9q\" (UID: \"5c127909-772f-4e17-8b3f-f221290a6efb\") " pod="kube-system/konnectivity-agent-7wn9q" May 21 03:19:38.200071 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197152 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc4295eb-090f-4bcb-9429-fb127fd63fa8-cnibin\") pod \"multus-additional-cni-plugins-svx44\" (UID: \"dc4295eb-090f-4bcb-9429-fb127fd63fa8\") " pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.200071 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197177 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/407f0a95-fdbd-4818-bdcc-95d18dd22e70-etc-selinux\") pod \"aws-ebs-csi-driver-node-rtf96\" (UID: \"407f0a95-fdbd-4818-bdcc-95d18dd22e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" May 21 03:19:38.200071 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197184 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-cni-binary-copy\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.200071 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197200 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-cnibin\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.200071 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197229 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-etc-openvswitch\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.200071 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197257 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/407f0a95-fdbd-4818-bdcc-95d18dd22e70-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rtf96\" (UID: \"407f0a95-fdbd-4818-bdcc-95d18dd22e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" May 21 03:19:38.200071 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197273 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dc4295eb-090f-4bcb-9429-fb127fd63fa8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-svx44\" (UID: \"dc4295eb-090f-4bcb-9429-fb127fd63fa8\") " pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.200071 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197281 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/407f0a95-fdbd-4818-bdcc-95d18dd22e70-socket-dir\") pod \"aws-ebs-csi-driver-node-rtf96\" (UID: \"407f0a95-fdbd-4818-bdcc-95d18dd22e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" May 21 03:19:38.200071 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197315 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/48fa57f3-8bf4-4643-8fda-195ac1776d3c-hosts-file\") pod \"node-resolver-nm86d\" (UID: \"48fa57f3-8bf4-4643-8fda-195ac1776d3c\") " pod="openshift-dns/node-resolver-nm86d" May 21 03:19:38.200071 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197339 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-host-run-netns\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.200071 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197364 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/407f0a95-fdbd-4818-bdcc-95d18dd22e70-registration-dir\") pod \"aws-ebs-csi-driver-node-rtf96\" (UID: \"407f0a95-fdbd-4818-bdcc-95d18dd22e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" May 21 03:19:38.200071 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197390 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-host-run-multus-certs\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.200071 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197393 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/407f0a95-fdbd-4818-bdcc-95d18dd22e70-device-dir\") pod \"aws-ebs-csi-driver-node-rtf96\" (UID: \"407f0a95-fdbd-4818-bdcc-95d18dd22e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" May 21 03:19:38.200071 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197231 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-multus-conf-dir\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.200904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197444 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/407f0a95-fdbd-4818-bdcc-95d18dd22e70-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rtf96\" (UID: \"407f0a95-fdbd-4818-bdcc-95d18dd22e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" May 21 03:19:38.200904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197467 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-multus-socket-dir-parent\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.200904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197493 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-host-run-netns\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.200904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197499 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/407f0a95-fdbd-4818-bdcc-95d18dd22e70-sys-fs\") pod \"aws-ebs-csi-driver-node-rtf96\" (UID: \"407f0a95-fdbd-4818-bdcc-95d18dd22e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" May 21 03:19:38.200904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197511 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-host-run-multus-certs\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.200904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197547 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc4295eb-090f-4bcb-9429-fb127fd63fa8-cnibin\") pod \"multus-additional-cni-plugins-svx44\" (UID: \"dc4295eb-090f-4bcb-9429-fb127fd63fa8\") " pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.200904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197578 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/407f0a95-fdbd-4818-bdcc-95d18dd22e70-socket-dir\") pod \"aws-ebs-csi-driver-node-rtf96\" (UID: \"407f0a95-fdbd-4818-bdcc-95d18dd22e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" May 21 03:19:38.200904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197580 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3bb551d3-f382-4950-b711-e3cfcde00d83-host-slash\") pod \"iptables-alerter-g84kv\" (UID: \"3bb551d3-f382-4950-b711-e3cfcde00d83\") " pod="openshift-network-operator/iptables-alerter-g84kv" May 21 03:19:38.200904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197601 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/407f0a95-fdbd-4818-bdcc-95d18dd22e70-etc-selinux\") pod \"aws-ebs-csi-driver-node-rtf96\" (UID: \"407f0a95-fdbd-4818-bdcc-95d18dd22e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" May 21 03:19:38.200904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197607 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3bb551d3-f382-4950-b711-e3cfcde00d83-host-slash\") pod \"iptables-alerter-g84kv\" (UID: \"3bb551d3-f382-4950-b711-e3cfcde00d83\") " pod="openshift-network-operator/iptables-alerter-g84kv" May 21 03:19:38.200904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197620 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q8mlr\" (UniqueName: \"kubernetes.io/projected/48fa57f3-8bf4-4643-8fda-195ac1776d3c-kube-api-access-q8mlr\") pod \"node-resolver-nm86d\" (UID: \"48fa57f3-8bf4-4643-8fda-195ac1776d3c\") " pod="openshift-dns/node-resolver-nm86d" May 21 03:19:38.200904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197654 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-sys\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.200904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197679 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-os-release\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.200904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197733 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dc4295eb-090f-4bcb-9429-fb127fd63fa8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-svx44\" (UID: \"dc4295eb-090f-4bcb-9429-fb127fd63fa8\") " pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.200904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197738 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-os-release\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.200904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197748 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-sys\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.200904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197764 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-etc-sysctl-d\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.200904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197788 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-run\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.201764 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197817 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc69w\" (UniqueName: \"kubernetes.io/projected/cb7a5cdb-9dde-424b-ac12-d08fbe5e86b6-kube-api-access-bc69w\") pod \"node-ca-4jxvp\" (UID: \"cb7a5cdb-9dde-424b-ac12-d08fbe5e86b6\") " pod="openshift-image-registry/node-ca-4jxvp" May 21 03:19:38.201764 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197836 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5c127909-772f-4e17-8b3f-f221290a6efb-konnectivity-ca\") pod \"konnectivity-agent-7wn9q\" (UID: \"5c127909-772f-4e17-8b3f-f221290a6efb\") " pod="kube-system/konnectivity-agent-7wn9q" May 21 03:19:38.201764 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197858 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-host-cni-bin\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.201764 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197889 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.201764 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197898 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-run\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.201764 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197916 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b16d171-5803-4a52-8faa-b6290af8b5dc-ovn-node-metrics-cert\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.201764 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197953 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-etc-sysctl-conf\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.201764 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197981 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-var-lib-kubelet\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.201764 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.197990 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-etc-sysctl-d\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.201764 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.198006 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-etc-tuned\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.201764 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.198032 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3b16d171-5803-4a52-8faa-b6290af8b5dc-env-overrides\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.201764 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.198083 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-var-lib-kubelet\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.201764 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.198100 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-etc-sysctl-conf\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.201764 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.198170 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dc4295eb-090f-4bcb-9429-fb127fd63fa8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-svx44\" (UID: \"dc4295eb-090f-4bcb-9429-fb127fd63fa8\") " pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.201764 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.198177 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-cnibin\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.201764 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.199989 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-tmp\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.201764 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.200395 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5c127909-772f-4e17-8b3f-f221290a6efb-agent-certs\") pod \"konnectivity-agent-7wn9q\" (UID: \"5c127909-772f-4e17-8b3f-f221290a6efb\") " pod="kube-system/konnectivity-agent-7wn9q" May 21 03:19:38.202559 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.201369 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-etc-tuned\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.202881 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.202864 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx2jm\" (UniqueName: \"kubernetes.io/projected/407f0a95-fdbd-4818-bdcc-95d18dd22e70-kube-api-access-wx2jm\") pod \"aws-ebs-csi-driver-node-rtf96\" (UID: \"407f0a95-fdbd-4818-bdcc-95d18dd22e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" May 21 03:19:38.203658 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.203615 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl8jp\" (UniqueName: \"kubernetes.io/projected/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-kube-api-access-sl8jp\") pod \"network-metrics-daemon-6qc5c\" (UID: \"ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad\") " pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:19:38.205433 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.205409 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mkht\" (UniqueName: \"kubernetes.io/projected/3bb551d3-f382-4950-b711-e3cfcde00d83-kube-api-access-8mkht\") pod \"iptables-alerter-g84kv\" (UID: \"3bb551d3-f382-4950-b711-e3cfcde00d83\") " pod="openshift-network-operator/iptables-alerter-g84kv" May 21 03:19:38.205532 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.205445 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8mlr\" (UniqueName: \"kubernetes.io/projected/48fa57f3-8bf4-4643-8fda-195ac1776d3c-kube-api-access-q8mlr\") pod \"node-resolver-nm86d\" (UID: \"48fa57f3-8bf4-4643-8fda-195ac1776d3c\") " pod="openshift-dns/node-resolver-nm86d" May 21 03:19:38.205806 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.205783 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgktf\" (UniqueName: \"kubernetes.io/projected/21b85f67-5cbb-4544-b7c9-6bfe4a28b54e-kube-api-access-rgktf\") pod \"multus-ds6kj\" (UID: \"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e\") " pod="openshift-multus/multus-ds6kj" May 21 03:19:38.206170 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.206140 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjns6\" (UniqueName: \"kubernetes.io/projected/dbeb6b9f-7275-4585-83d3-9d79ae00c5ff-kube-api-access-cjns6\") pod \"tuned-6xdsh\" (UID: \"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff\") " pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.206326 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.206306 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnvct\" (UniqueName: \"kubernetes.io/projected/dc4295eb-090f-4bcb-9429-fb127fd63fa8-kube-api-access-pnvct\") pod \"multus-additional-cni-plugins-svx44\" (UID: \"dc4295eb-090f-4bcb-9429-fb127fd63fa8\") " pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.214973 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.214949 2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 03:19:38.299085 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299037 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cb7a5cdb-9dde-424b-ac12-d08fbe5e86b6-serviceca\") pod \"node-ca-4jxvp\" (UID: \"cb7a5cdb-9dde-424b-ac12-d08fbe5e86b6\") " pod="openshift-image-registry/node-ca-4jxvp" May 21 03:19:38.299085 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299083 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-node-log\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.299328 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299109 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-host-cni-netd\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.299328 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299138 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ddbq2\" (UniqueName: \"kubernetes.io/projected/6b69a092-73c1-4098-b3af-3d38cce0cdb5-kube-api-access-ddbq2\") pod \"network-check-target-fqzfs\" (UID: \"6b69a092-73c1-4098-b3af-3d38cce0cdb5\") " pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:19:38.299328 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299167 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-host-kubelet\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.299328 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299173 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-node-log\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.299328 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299187 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-host-cni-netd\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.299328 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299190 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-run-systemd\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.299328 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299240 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb7a5cdb-9dde-424b-ac12-d08fbe5e86b6-host\") pod \"node-ca-4jxvp\" (UID: \"cb7a5cdb-9dde-424b-ac12-d08fbe5e86b6\") " pod="openshift-image-registry/node-ca-4jxvp" May 21 03:19:38.299328 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299237 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-host-kubelet\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.299328 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299241 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-run-systemd\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.299328 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299286 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb7a5cdb-9dde-424b-ac12-d08fbe5e86b6-host\") pod \"node-ca-4jxvp\" (UID: \"cb7a5cdb-9dde-424b-ac12-d08fbe5e86b6\") " pod="openshift-image-registry/node-ca-4jxvp" May 21 03:19:38.299328 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299329 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-systemd-units\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.299862 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299371 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-host-run-ovn-kubernetes\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.299862 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299394 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-systemd-units\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.299862 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299397 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3b16d171-5803-4a52-8faa-b6290af8b5dc-ovnkube-script-lib\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.299862 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299453 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-var-lib-openvswitch\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.299862 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299484 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-host-run-netns\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.299862 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299499 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-host-run-ovn-kubernetes\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.299862 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299538 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-run-ovn\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.299862 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299508 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-run-ovn\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.299862 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299572 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-var-lib-openvswitch\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.299862 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299580 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-host-run-netns\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.299862 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299580 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3b16d171-5803-4a52-8faa-b6290af8b5dc-ovnkube-config\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.299862 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299618 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-run-openvswitch\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.299862 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299643 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-log-socket\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.299862 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299668 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lgt4r\" (UniqueName: \"kubernetes.io/projected/3b16d171-5803-4a52-8faa-b6290af8b5dc-kube-api-access-lgt4r\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.299862 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299697 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-etc-openvswitch\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.299862 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299738 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bc69w\" (UniqueName: \"kubernetes.io/projected/cb7a5cdb-9dde-424b-ac12-d08fbe5e86b6-kube-api-access-bc69w\") pod \"node-ca-4jxvp\" (UID: \"cb7a5cdb-9dde-424b-ac12-d08fbe5e86b6\") " pod="openshift-image-registry/node-ca-4jxvp" May 21 03:19:38.299862 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299762 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-host-cni-bin\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.300626 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299790 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.300626 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299819 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b16d171-5803-4a52-8faa-b6290af8b5dc-ovn-node-metrics-cert\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.300626 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299846 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3b16d171-5803-4a52-8faa-b6290af8b5dc-env-overrides\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.300626 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299873 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-host-slash\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.300626 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299940 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-host-slash\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.300626 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299960 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3b16d171-5803-4a52-8faa-b6290af8b5dc-ovnkube-script-lib\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.300626 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.299976 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-run-openvswitch\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.300626 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.300022 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-log-socket\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.300626 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.300060 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-host-cni-bin\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.300626 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.300057 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cb7a5cdb-9dde-424b-ac12-d08fbe5e86b6-serviceca\") pod \"node-ca-4jxvp\" (UID: \"cb7a5cdb-9dde-424b-ac12-d08fbe5e86b6\") " pod="openshift-image-registry/node-ca-4jxvp" May 21 03:19:38.300626 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.300178 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-etc-openvswitch\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.300626 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.300217 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b16d171-5803-4a52-8faa-b6290af8b5dc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.300626 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.300464 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3b16d171-5803-4a52-8faa-b6290af8b5dc-env-overrides\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.300626 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.300537 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3b16d171-5803-4a52-8faa-b6290af8b5dc-ovnkube-config\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.302774 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.302728 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b16d171-5803-4a52-8faa-b6290af8b5dc-ovn-node-metrics-cert\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.304572 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:38.304553 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 03:19:38.304667 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:38.304577 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 03:19:38.304667 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:38.304590 2575 projected.go:194] Error preparing data for projected volume kube-api-access-ddbq2 for pod openshift-network-diagnostics/network-check-target-fqzfs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:19:38.304782 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:38.304713 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b69a092-73c1-4098-b3af-3d38cce0cdb5-kube-api-access-ddbq2 podName:6b69a092-73c1-4098-b3af-3d38cce0cdb5 nodeName:}" failed. No retries permitted until 2026-05-21 03:19:38.804693624 +0000 UTC m=+3.170913994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ddbq2" (UniqueName: "kubernetes.io/projected/6b69a092-73c1-4098-b3af-3d38cce0cdb5-kube-api-access-ddbq2") pod "network-check-target-fqzfs" (UID: "6b69a092-73c1-4098-b3af-3d38cce0cdb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:19:38.307698 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.307671 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgt4r\" (UniqueName: \"kubernetes.io/projected/3b16d171-5803-4a52-8faa-b6290af8b5dc-kube-api-access-lgt4r\") pod \"ovnkube-node-hkgwf\" (UID: \"3b16d171-5803-4a52-8faa-b6290af8b5dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.307800 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.307702 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc69w\" (UniqueName: \"kubernetes.io/projected/cb7a5cdb-9dde-424b-ac12-d08fbe5e86b6-kube-api-access-bc69w\") pod \"node-ca-4jxvp\" (UID: \"cb7a5cdb-9dde-424b-ac12-d08fbe5e86b6\") " pod="openshift-image-registry/node-ca-4jxvp" May 21 03:19:38.387109 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.387037 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" May 21 03:19:38.394331 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.394310 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-svx44" May 21 03:19:38.404104 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.404073 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ds6kj" May 21 03:19:38.409687 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.409665 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g84kv" May 21 03:19:38.417258 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.417239 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7wn9q" May 21 03:19:38.423805 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.423788 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" May 21 03:19:38.430323 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.430305 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nm86d" May 21 03:19:38.435853 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.435830 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4jxvp" May 21 03:19:38.440383 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.440367 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:19:38.550854 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.550825 2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 03:19:38.703245 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.703211 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs\") pod \"network-metrics-daemon-6qc5c\" (UID: \"ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad\") " pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:19:38.703414 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:38.703392 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:19:38.703493 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:38.703481 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs podName:ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad nodeName:}" failed. No retries permitted until 2026-05-21 03:19:39.703454922 +0000 UTC m=+4.069675296 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs") pod "network-metrics-daemon-6qc5c" (UID: "ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:19:38.711252 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:38.711228 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21b85f67_5cbb_4544_b7c9_6bfe4a28b54e.slice/crio-a0890dcc2f57535d34efa72de8cd14ee2de7da9e581bf0201899076b926634a0 WatchSource:0}: Error finding container a0890dcc2f57535d34efa72de8cd14ee2de7da9e581bf0201899076b926634a0: Status 404 returned error can't find the container with id a0890dcc2f57535d34efa72de8cd14ee2de7da9e581bf0201899076b926634a0 May 21 03:19:38.712494 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:38.712467 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48fa57f3_8bf4_4643_8fda_195ac1776d3c.slice/crio-3fce91bcb98e756cc02885363b937caec5c1cbf2444dfcaa6ef775f0b89487fd WatchSource:0}: Error finding container 3fce91bcb98e756cc02885363b937caec5c1cbf2444dfcaa6ef775f0b89487fd: Status 404 returned error can't find the container with id 3fce91bcb98e756cc02885363b937caec5c1cbf2444dfcaa6ef775f0b89487fd May 21 03:19:38.713181 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:38.713154 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod407f0a95_fdbd_4818_bdcc_95d18dd22e70.slice/crio-20da83fe88d175583bba35cc3b755df5be73ef97e4c868d5701b5a93c261ab3c WatchSource:0}: Error finding container 20da83fe88d175583bba35cc3b755df5be73ef97e4c868d5701b5a93c261ab3c: Status 404 returned error can't find the container with id 20da83fe88d175583bba35cc3b755df5be73ef97e4c868d5701b5a93c261ab3c May 21 03:19:38.717490 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:38.717459 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b16d171_5803_4a52_8faa_b6290af8b5dc.slice/crio-230ca8c07fcf7fda4c5823c97800b474edc6438a5ef968ce92eac6cbf6b6fb37 WatchSource:0}: Error finding container 230ca8c07fcf7fda4c5823c97800b474edc6438a5ef968ce92eac6cbf6b6fb37: Status 404 returned error can't find the container with id 230ca8c07fcf7fda4c5823c97800b474edc6438a5ef968ce92eac6cbf6b6fb37 May 21 03:19:38.719319 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:38.719262 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb7a5cdb_9dde_424b_ac12_d08fbe5e86b6.slice/crio-579856a8eb3a6263062cf835c496ced18563efdd6a00fd34250b6827211eac1f WatchSource:0}: Error finding container 579856a8eb3a6263062cf835c496ced18563efdd6a00fd34250b6827211eac1f: Status 404 returned error can't find the container with id 579856a8eb3a6263062cf835c496ced18563efdd6a00fd34250b6827211eac1f May 21 03:19:38.720035 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:38.720000 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc4295eb_090f_4bcb_9429_fb127fd63fa8.slice/crio-6a94fc97766fb29f62facd584999559670c55f129c9825f6a255c5ece6607f01 WatchSource:0}: Error finding container 6a94fc97766fb29f62facd584999559670c55f129c9825f6a255c5ece6607f01: Status 404 returned error can't find the container with id 6a94fc97766fb29f62facd584999559670c55f129c9825f6a255c5ece6607f01 May 21 03:19:38.720913 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:38.720886 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bb551d3_f382_4950_b711_e3cfcde00d83.slice/crio-b326179cb0e49e3fb487a6ce4931c66bb46e2c2884b33fde07af69591d6d87aa WatchSource:0}: Error finding container b326179cb0e49e3fb487a6ce4931c66bb46e2c2884b33fde07af69591d6d87aa: Status 404 returned error can't find the container with id b326179cb0e49e3fb487a6ce4931c66bb46e2c2884b33fde07af69591d6d87aa May 21 03:19:38.722737 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:19:38.722714 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbeb6b9f_7275_4585_83d3_9d79ae00c5ff.slice/crio-90e220c00b1c7d29f2725f6f74d85680f2a12e8becc17e4155358a323adb4cff WatchSource:0}: Error finding container 90e220c00b1c7d29f2725f6f74d85680f2a12e8becc17e4155358a323adb4cff: Status 404 returned error can't find the container with id 90e220c00b1c7d29f2725f6f74d85680f2a12e8becc17e4155358a323adb4cff May 21 03:19:38.904402 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:38.904174 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ddbq2\" (UniqueName: \"kubernetes.io/projected/6b69a092-73c1-4098-b3af-3d38cce0cdb5-kube-api-access-ddbq2\") pod \"network-check-target-fqzfs\" (UID: \"6b69a092-73c1-4098-b3af-3d38cce0cdb5\") " pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:19:38.904562 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:38.904295 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 03:19:38.904562 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:38.904471 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 03:19:38.904562 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:38.904482 2575 projected.go:194] Error preparing data for projected volume kube-api-access-ddbq2 for pod openshift-network-diagnostics/network-check-target-fqzfs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:19:38.904562 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:38.904532 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b69a092-73c1-4098-b3af-3d38cce0cdb5-kube-api-access-ddbq2 podName:6b69a092-73c1-4098-b3af-3d38cce0cdb5 nodeName:}" failed. No retries permitted until 2026-05-21 03:19:39.904517365 +0000 UTC m=+4.270737736 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ddbq2" (UniqueName: "kubernetes.io/projected/6b69a092-73c1-4098-b3af-3d38cce0cdb5-kube-api-access-ddbq2") pod "network-check-target-fqzfs" (UID: "6b69a092-73c1-4098-b3af-3d38cce0cdb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:19:39.117579 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:39.117533 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 03:14:37 +0000 UTC" deadline="2028-01-02 07:53:52.053881742 +0000 UTC" May 21 03:19:39.117579 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:39.117574 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14188h34m12.936311006s" May 21 03:19:39.209549 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:39.209437 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g84kv" event={"ID":"3bb551d3-f382-4950-b711-e3cfcde00d83","Type":"ContainerStarted","Data":"b326179cb0e49e3fb487a6ce4931c66bb46e2c2884b33fde07af69591d6d87aa"} May 21 03:19:39.211227 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:39.211173 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svx44" event={"ID":"dc4295eb-090f-4bcb-9429-fb127fd63fa8","Type":"ContainerStarted","Data":"6a94fc97766fb29f62facd584999559670c55f129c9825f6a255c5ece6607f01"} May 21 03:19:39.215149 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:39.215084 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" event={"ID":"3b16d171-5803-4a52-8faa-b6290af8b5dc","Type":"ContainerStarted","Data":"230ca8c07fcf7fda4c5823c97800b474edc6438a5ef968ce92eac6cbf6b6fb37"} May 21 03:19:39.218517 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:39.218448 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" event={"ID":"407f0a95-fdbd-4818-bdcc-95d18dd22e70","Type":"ContainerStarted","Data":"20da83fe88d175583bba35cc3b755df5be73ef97e4c868d5701b5a93c261ab3c"} May 21 03:19:39.220651 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:39.220585 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ds6kj" event={"ID":"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e","Type":"ContainerStarted","Data":"a0890dcc2f57535d34efa72de8cd14ee2de7da9e581bf0201899076b926634a0"} May 21 03:19:39.224762 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:39.224136 2575 generic.go:358] "Generic (PLEG): container finished" podID="0752d5a0a46de664f26314b021480f9d" containerID="7c47933a48b1ad3028239c95203a927dcc03427cc969c19be26b7958e4817c92" exitCode=0 May 21 03:19:39.224762 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:39.224427 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-251.ec2.internal" event={"ID":"0752d5a0a46de664f26314b021480f9d","Type":"ContainerDied","Data":"7c47933a48b1ad3028239c95203a927dcc03427cc969c19be26b7958e4817c92"} May 21 03:19:39.228494 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:39.228361 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-251.ec2.internal" event={"ID":"d2d7b9af40cbe531b6adc203c8d4859b","Type":"ContainerStarted","Data":"e0298395adf160e6874de0be5e34c947108eb8d3435d04f7bcfe629ac1f94d60"} May 21 03:19:39.230028 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:39.229963 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7wn9q" event={"ID":"5c127909-772f-4e17-8b3f-f221290a6efb","Type":"ContainerStarted","Data":"a69f108fc28580457df57365a37b5a83ed3ce3546580c6b502a0450d4bdd3f92"} May 21 03:19:39.233507 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:39.233482 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" event={"ID":"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff","Type":"ContainerStarted","Data":"90e220c00b1c7d29f2725f6f74d85680f2a12e8becc17e4155358a323adb4cff"} May 21 03:19:39.237104 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:39.237076 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4jxvp" event={"ID":"cb7a5cdb-9dde-424b-ac12-d08fbe5e86b6","Type":"ContainerStarted","Data":"579856a8eb3a6263062cf835c496ced18563efdd6a00fd34250b6827211eac1f"} May 21 03:19:39.240547 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:39.240508 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nm86d" event={"ID":"48fa57f3-8bf4-4643-8fda-195ac1776d3c","Type":"ContainerStarted","Data":"3fce91bcb98e756cc02885363b937caec5c1cbf2444dfcaa6ef775f0b89487fd"} May 21 03:19:39.712302 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:39.711684 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs\") pod \"network-metrics-daemon-6qc5c\" (UID: \"ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad\") " pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:19:39.712302 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:39.711877 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:19:39.712302 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:39.711944 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs podName:ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad nodeName:}" failed. No retries permitted until 2026-05-21 03:19:41.71192459 +0000 UTC m=+6.078144973 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs") pod "network-metrics-daemon-6qc5c" (UID: "ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:19:39.914099 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:39.914000 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ddbq2\" (UniqueName: \"kubernetes.io/projected/6b69a092-73c1-4098-b3af-3d38cce0cdb5-kube-api-access-ddbq2\") pod \"network-check-target-fqzfs\" (UID: \"6b69a092-73c1-4098-b3af-3d38cce0cdb5\") " pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:19:39.914276 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:39.914198 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 03:19:39.914276 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:39.914218 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 03:19:39.914276 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:39.914231 2575 projected.go:194] Error preparing data for projected volume kube-api-access-ddbq2 for pod openshift-network-diagnostics/network-check-target-fqzfs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:19:39.914466 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:39.914293 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b69a092-73c1-4098-b3af-3d38cce0cdb5-kube-api-access-ddbq2 podName:6b69a092-73c1-4098-b3af-3d38cce0cdb5 nodeName:}" failed. No retries permitted until 2026-05-21 03:19:41.914273124 +0000 UTC m=+6.280493500 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ddbq2" (UniqueName: "kubernetes.io/projected/6b69a092-73c1-4098-b3af-3d38cce0cdb5-kube-api-access-ddbq2") pod "network-check-target-fqzfs" (UID: "6b69a092-73c1-4098-b3af-3d38cce0cdb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:19:40.202694 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:40.202550 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:19:40.203160 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:40.202684 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqzfs" podUID="6b69a092-73c1-4098-b3af-3d38cce0cdb5" May 21 03:19:40.203334 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:40.203314 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:19:40.203564 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:40.203540 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qc5c" podUID="ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad" May 21 03:19:40.254736 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:40.254672 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-251.ec2.internal" event={"ID":"0752d5a0a46de664f26314b021480f9d","Type":"ContainerStarted","Data":"1490a0142ab43d9a9832f02be798e1936e770ae7d15633f31cefa31c70c6d988"} May 21 03:19:40.270189 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:40.270117 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-251.ec2.internal" podStartSLOduration=3.270098112 podStartE2EDuration="3.270098112s" podCreationTimestamp="2026-05-21 03:19:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:19:39.257690115 +0000 UTC m=+3.623910510" watchObservedRunningTime="2026-05-21 03:19:40.270098112 +0000 UTC m=+4.636318507" May 21 03:19:41.731193 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:41.731155 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs\") pod \"network-metrics-daemon-6qc5c\" (UID: \"ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad\") " pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:19:41.731706 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:41.731337 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:19:41.731706 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:41.731418 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs podName:ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad nodeName:}" failed. No retries permitted until 2026-05-21 03:19:45.731397577 +0000 UTC m=+10.097617949 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs") pod "network-metrics-daemon-6qc5c" (UID: "ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:19:41.933309 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:41.933240 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ddbq2\" (UniqueName: \"kubernetes.io/projected/6b69a092-73c1-4098-b3af-3d38cce0cdb5-kube-api-access-ddbq2\") pod \"network-check-target-fqzfs\" (UID: \"6b69a092-73c1-4098-b3af-3d38cce0cdb5\") " pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:19:41.933522 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:41.933469 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 03:19:41.933522 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:41.933495 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 03:19:41.933522 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:41.933509 2575 projected.go:194] Error preparing data for projected volume kube-api-access-ddbq2 for pod openshift-network-diagnostics/network-check-target-fqzfs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:19:41.933691 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:41.933587 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b69a092-73c1-4098-b3af-3d38cce0cdb5-kube-api-access-ddbq2 podName:6b69a092-73c1-4098-b3af-3d38cce0cdb5 nodeName:}" failed. No retries permitted until 2026-05-21 03:19:45.933557084 +0000 UTC m=+10.299777461 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ddbq2" (UniqueName: "kubernetes.io/projected/6b69a092-73c1-4098-b3af-3d38cce0cdb5-kube-api-access-ddbq2") pod "network-check-target-fqzfs" (UID: "6b69a092-73c1-4098-b3af-3d38cce0cdb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:19:42.200733 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:42.200649 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:19:42.200733 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:42.200703 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:19:42.200964 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:42.200802 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqzfs" podUID="6b69a092-73c1-4098-b3af-3d38cce0cdb5" May 21 03:19:42.200964 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:42.200903 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qc5c" podUID="ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad" May 21 03:19:44.200969 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:44.200934 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:19:44.201471 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:44.200932 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:19:44.201471 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:44.201071 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqzfs" podUID="6b69a092-73c1-4098-b3af-3d38cce0cdb5" May 21 03:19:44.201471 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:44.201206 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qc5c" podUID="ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad" May 21 03:19:45.764847 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:45.764803 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs\") pod \"network-metrics-daemon-6qc5c\" (UID: \"ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad\") " pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:19:45.765309 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:45.764972 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:19:45.765309 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:45.765060 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs podName:ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad nodeName:}" failed. No retries permitted until 2026-05-21 03:19:53.765037071 +0000 UTC m=+18.131257445 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs") pod "network-metrics-daemon-6qc5c" (UID: "ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:19:45.966762 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:45.966054 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ddbq2\" (UniqueName: \"kubernetes.io/projected/6b69a092-73c1-4098-b3af-3d38cce0cdb5-kube-api-access-ddbq2\") pod \"network-check-target-fqzfs\" (UID: \"6b69a092-73c1-4098-b3af-3d38cce0cdb5\") " pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:19:45.966762 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:45.966292 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 03:19:45.966762 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:45.966312 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 03:19:45.966762 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:45.966325 2575 projected.go:194] Error preparing data for projected volume kube-api-access-ddbq2 for pod openshift-network-diagnostics/network-check-target-fqzfs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:19:45.966762 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:45.966402 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b69a092-73c1-4098-b3af-3d38cce0cdb5-kube-api-access-ddbq2 podName:6b69a092-73c1-4098-b3af-3d38cce0cdb5 nodeName:}" failed. No retries permitted until 2026-05-21 03:19:53.966383561 +0000 UTC m=+18.332603944 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ddbq2" (UniqueName: "kubernetes.io/projected/6b69a092-73c1-4098-b3af-3d38cce0cdb5-kube-api-access-ddbq2") pod "network-check-target-fqzfs" (UID: "6b69a092-73c1-4098-b3af-3d38cce0cdb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:19:46.201745 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:46.201570 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:19:46.201745 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:46.201571 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:19:46.201745 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:46.201722 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqzfs" podUID="6b69a092-73c1-4098-b3af-3d38cce0cdb5" May 21 03:19:46.202008 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:46.201842 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qc5c" podUID="ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad" May 21 03:19:48.200543 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:48.200505 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:19:48.200927 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:48.200544 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:19:48.200927 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:48.200652 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qc5c" podUID="ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad" May 21 03:19:48.200927 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:48.200757 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqzfs" podUID="6b69a092-73c1-4098-b3af-3d38cce0cdb5" May 21 03:19:50.201007 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:50.200970 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:19:50.201007 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:50.200995 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:19:50.201580 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:50.201118 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qc5c" podUID="ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad" May 21 03:19:50.201580 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:50.201244 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqzfs" podUID="6b69a092-73c1-4098-b3af-3d38cce0cdb5" May 21 03:19:52.200660 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:52.200620 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:19:52.201058 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:52.200706 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:19:52.201058 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:52.200988 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qc5c" podUID="ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad" May 21 03:19:52.201366 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:52.201329 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqzfs" podUID="6b69a092-73c1-4098-b3af-3d38cce0cdb5" May 21 03:19:53.815371 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:53.815316 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs\") pod \"network-metrics-daemon-6qc5c\" (UID: \"ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad\") " pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:19:53.815906 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:53.815482 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:19:53.815906 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:53.815551 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs podName:ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad nodeName:}" failed. No retries permitted until 2026-05-21 03:20:09.815534917 +0000 UTC m=+34.181755292 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs") pod "network-metrics-daemon-6qc5c" (UID: "ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:19:54.016596 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:54.016558 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ddbq2\" (UniqueName: \"kubernetes.io/projected/6b69a092-73c1-4098-b3af-3d38cce0cdb5-kube-api-access-ddbq2\") pod \"network-check-target-fqzfs\" (UID: \"6b69a092-73c1-4098-b3af-3d38cce0cdb5\") " pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:19:54.016773 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:54.016752 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 03:19:54.016831 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:54.016776 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 03:19:54.016831 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:54.016790 2575 projected.go:194] Error preparing data for projected volume kube-api-access-ddbq2 for pod openshift-network-diagnostics/network-check-target-fqzfs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:19:54.016919 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:54.016856 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b69a092-73c1-4098-b3af-3d38cce0cdb5-kube-api-access-ddbq2 podName:6b69a092-73c1-4098-b3af-3d38cce0cdb5 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:10.016837507 +0000 UTC m=+34.383057883 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ddbq2" (UniqueName: "kubernetes.io/projected/6b69a092-73c1-4098-b3af-3d38cce0cdb5-kube-api-access-ddbq2") pod "network-check-target-fqzfs" (UID: "6b69a092-73c1-4098-b3af-3d38cce0cdb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:19:54.200274 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:54.200186 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:19:54.200463 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:54.200309 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqzfs" podUID="6b69a092-73c1-4098-b3af-3d38cce0cdb5" May 21 03:19:54.200463 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:54.200377 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:19:54.200583 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:54.200492 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qc5c" podUID="ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad" May 21 03:19:56.201484 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:56.201450 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:19:56.201833 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:56.201542 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqzfs" podUID="6b69a092-73c1-4098-b3af-3d38cce0cdb5" May 21 03:19:56.201833 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:56.201584 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:19:56.201833 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:56.201646 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qc5c" podUID="ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad" May 21 03:19:57.286718 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:57.286389 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" event={"ID":"3b16d171-5803-4a52-8faa-b6290af8b5dc","Type":"ContainerStarted","Data":"246928cf238ca583a71bb2e577d79bc02759c739c4e215c487444c14b72f54a6"} May 21 03:19:57.287278 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:57.286733 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" event={"ID":"3b16d171-5803-4a52-8faa-b6290af8b5dc","Type":"ContainerStarted","Data":"daeef746ed9c4ed347f1797302043a0e9d947b10733df7389326ddeb0fc18d86"} May 21 03:19:57.287795 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:57.287768 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" event={"ID":"407f0a95-fdbd-4818-bdcc-95d18dd22e70","Type":"ContainerStarted","Data":"e6f3b110f09b37022e6d76ab276f2e372c3ad50f4eac7dbc93839ec83b99789c"} May 21 03:19:57.288956 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:57.288934 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ds6kj" event={"ID":"21b85f67-5cbb-4544-b7c9-6bfe4a28b54e","Type":"ContainerStarted","Data":"8cf6a481247d0f8b32019dd75cab910eb3837733dbc155f36c181ae67dea35f8"} May 21 03:19:57.290275 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:57.290248 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7wn9q" event={"ID":"5c127909-772f-4e17-8b3f-f221290a6efb","Type":"ContainerStarted","Data":"a3ed79a8027247a8d08b1b4457cd4f1847bfe718aa2ffa8f12e5891321c102ab"} May 21 03:19:57.291453 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:57.291433 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" event={"ID":"dbeb6b9f-7275-4585-83d3-9d79ae00c5ff","Type":"ContainerStarted","Data":"e7771c13882f244fc9f004ae29991775dde90b0ce64eb2b8d82bceff6a8e576c"} May 21 03:19:57.292755 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:57.292737 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4jxvp" event={"ID":"cb7a5cdb-9dde-424b-ac12-d08fbe5e86b6","Type":"ContainerStarted","Data":"5beff229a3e3fc9bd91f659e44a1ca8a9dfba21430468805bd6ad84996913da3"} May 21 03:19:57.294146 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:57.294121 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nm86d" event={"ID":"48fa57f3-8bf4-4643-8fda-195ac1776d3c","Type":"ContainerStarted","Data":"d2de9705ecaa804f039d05e0d0fe78a1f35a4d5350d97f83475ff16a792aac33"} May 21 03:19:57.295423 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:57.295401 2575 generic.go:358] "Generic (PLEG): container finished" podID="dc4295eb-090f-4bcb-9429-fb127fd63fa8" containerID="cf17ee4f727c7060e60dcbf386c82cf27eda67a80e9c97ace97054c17ccf5ed1" exitCode=0 May 21 03:19:57.295496 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:57.295430 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svx44" event={"ID":"dc4295eb-090f-4bcb-9429-fb127fd63fa8","Type":"ContainerDied","Data":"cf17ee4f727c7060e60dcbf386c82cf27eda67a80e9c97ace97054c17ccf5ed1"} May 21 03:19:57.305838 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:57.305800 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-251.ec2.internal" podStartSLOduration=20.305788465 podStartE2EDuration="20.305788465s" podCreationTimestamp="2026-05-21 03:19:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:19:40.270526282 +0000 UTC m=+4.636746672" watchObservedRunningTime="2026-05-21 03:19:57.305788465 +0000 UTC m=+21.672008857" May 21 03:19:57.325105 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:57.325064 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-ds6kj" podStartSLOduration=3.031596014 podStartE2EDuration="21.325051286s" podCreationTimestamp="2026-05-21 03:19:36 +0000 UTC" firstStartedPulling="2026-05-21 03:19:38.713695239 +0000 UTC m=+3.079915625" lastFinishedPulling="2026-05-21 03:19:57.007150521 +0000 UTC m=+21.373370897" observedRunningTime="2026-05-21 03:19:57.30543012 +0000 UTC m=+21.671650532" watchObservedRunningTime="2026-05-21 03:19:57.325051286 +0000 UTC m=+21.691271678" May 21 03:19:57.337710 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:57.337659 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7wn9q" podStartSLOduration=7.288389044 podStartE2EDuration="21.337640588s" podCreationTimestamp="2026-05-21 03:19:36 +0000 UTC" firstStartedPulling="2026-05-21 03:19:38.725800109 +0000 UTC m=+3.092020487" lastFinishedPulling="2026-05-21 03:19:52.775051648 +0000 UTC m=+17.141272031" observedRunningTime="2026-05-21 03:19:57.337543592 +0000 UTC m=+21.703763996" watchObservedRunningTime="2026-05-21 03:19:57.337640588 +0000 UTC m=+21.703860982" May 21 03:19:57.356867 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:57.356812 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6xdsh" podStartSLOduration=3.128608246 podStartE2EDuration="21.35679573s" podCreationTimestamp="2026-05-21 03:19:36 +0000 UTC" firstStartedPulling="2026-05-21 03:19:38.72481348 +0000 UTC m=+3.091033851" lastFinishedPulling="2026-05-21 03:19:56.953000951 +0000 UTC m=+21.319221335" observedRunningTime="2026-05-21 03:19:57.356762005 +0000 UTC m=+21.722982398" watchObservedRunningTime="2026-05-21 03:19:57.35679573 +0000 UTC m=+21.723016123" May 21 03:19:57.371079 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:57.371040 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-nm86d" podStartSLOduration=3.134350382 podStartE2EDuration="21.371027017s" podCreationTimestamp="2026-05-21 03:19:36 +0000 UTC" firstStartedPulling="2026-05-21 03:19:38.716313339 +0000 UTC m=+3.082533709" lastFinishedPulling="2026-05-21 03:19:56.952989969 +0000 UTC m=+21.319210344" observedRunningTime="2026-05-21 03:19:57.370787539 +0000 UTC m=+21.737007932" watchObservedRunningTime="2026-05-21 03:19:57.371027017 +0000 UTC m=+21.737247409" May 21 03:19:57.383577 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:57.383524 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4jxvp" podStartSLOduration=3.110726649 podStartE2EDuration="21.383512299s" podCreationTimestamp="2026-05-21 03:19:36 +0000 UTC" firstStartedPulling="2026-05-21 03:19:38.721753956 +0000 UTC m=+3.087974326" lastFinishedPulling="2026-05-21 03:19:56.994539585 +0000 UTC m=+21.360759976" observedRunningTime="2026-05-21 03:19:57.38288408 +0000 UTC m=+21.749104472" watchObservedRunningTime="2026-05-21 03:19:57.383512299 +0000 UTC m=+21.749732691" May 21 03:19:58.169698 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:58.169669 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 03:19:58.200192 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:58.200158 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:19:58.200329 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:58.200309 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqzfs" podUID="6b69a092-73c1-4098-b3af-3d38cce0cdb5" May 21 03:19:58.200417 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:58.200320 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:19:58.200477 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:19:58.200443 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qc5c" podUID="ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad" May 21 03:19:58.300237 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:58.300146 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" event={"ID":"3b16d171-5803-4a52-8faa-b6290af8b5dc","Type":"ContainerStarted","Data":"d13017e74682552a7e274a10d1d82120fcd213f7de92bfabec3c879ad334ff44"} May 21 03:19:58.300237 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:58.300186 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" event={"ID":"3b16d171-5803-4a52-8faa-b6290af8b5dc","Type":"ContainerStarted","Data":"3eea29a74b275bd41876338323a156e0babed8ae380ed2a0d730b6da63c7fd16"} May 21 03:19:58.300237 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:58.300199 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" event={"ID":"3b16d171-5803-4a52-8faa-b6290af8b5dc","Type":"ContainerStarted","Data":"59b70d3eb74615a64f6ad5ef918a94924e3de5e59f4680838c9d1c637bd317c6"} May 21 03:19:58.300237 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:58.300209 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" event={"ID":"3b16d171-5803-4a52-8faa-b6290af8b5dc","Type":"ContainerStarted","Data":"a27de059cca9c5f98e5de904325121b8b600ef3b623a4bd53eb2b0a0206ef688"} May 21 03:19:58.301707 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:58.301684 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" event={"ID":"407f0a95-fdbd-4818-bdcc-95d18dd22e70","Type":"ContainerStarted","Data":"af090547c2fa449cb57ae2d76bff844e0ff57ba229cfece48e118be78d0c2877"} May 21 03:19:59.159074 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:59.158977 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T03:19:58.169703906Z","UUID":"c70b055e-9ea3-4f86-81d6-932d362a2740","Handler":null,"Name":"","Endpoint":""} May 21 03:19:59.161113 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:59.161085 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 03:19:59.161113 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:59.161115 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 03:19:59.308976 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:59.308939 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" event={"ID":"407f0a95-fdbd-4818-bdcc-95d18dd22e70","Type":"ContainerStarted","Data":"b98fcedbf8d17157738d26fba773e73f542f9e312e285eda76a5f9fe8506c393"} May 21 03:19:59.310635 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:59.310600 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g84kv" event={"ID":"3bb551d3-f382-4950-b711-e3cfcde00d83","Type":"ContainerStarted","Data":"49bfe54c605fcb6dab4568e6b0649d56104cefb9f2beb4a18b185d45ba55e1f2"} May 21 03:19:59.326388 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:59.326262 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtf96" podStartSLOduration=2.978959217 podStartE2EDuration="23.326243558s" podCreationTimestamp="2026-05-21 03:19:36 +0000 UTC" firstStartedPulling="2026-05-21 03:19:38.718840044 +0000 UTC m=+3.085060429" lastFinishedPulling="2026-05-21 03:19:59.066124384 +0000 UTC m=+23.432344770" observedRunningTime="2026-05-21 03:19:59.325647859 +0000 UTC m=+23.691868251" watchObservedRunningTime="2026-05-21 03:19:59.326243558 +0000 UTC m=+23.692463950" May 21 03:19:59.337998 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:19:59.337942 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g84kv" podStartSLOduration=5.107658403 podStartE2EDuration="23.337925992s" podCreationTimestamp="2026-05-21 03:19:36 +0000 UTC" firstStartedPulling="2026-05-21 03:19:38.722927288 +0000 UTC m=+3.089147658" lastFinishedPulling="2026-05-21 03:19:56.953194873 +0000 UTC m=+21.319415247" observedRunningTime="2026-05-21 03:19:59.337344252 +0000 UTC m=+23.703564644" watchObservedRunningTime="2026-05-21 03:19:59.337925992 +0000 UTC m=+23.704146385" May 21 03:20:00.200733 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:00.200699 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:20:00.200914 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:00.200813 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqzfs" podUID="6b69a092-73c1-4098-b3af-3d38cce0cdb5" May 21 03:20:00.200914 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:00.200871 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:20:00.201021 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:00.201002 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qc5c" podUID="ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad" May 21 03:20:00.315618 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:00.315579 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" event={"ID":"3b16d171-5803-4a52-8faa-b6290af8b5dc","Type":"ContainerStarted","Data":"aab81186ce36141e2ff8c4df456697fd1658682dd8f207831fe5aac10e87791b"} May 21 03:20:02.182706 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:02.182470 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7wn9q" May 21 03:20:02.183445 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:02.183221 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7wn9q" May 21 03:20:02.201093 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:02.201059 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:20:02.201142 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:02.201105 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:20:02.201226 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:02.201203 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qc5c" podUID="ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad" May 21 03:20:02.201327 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:02.201308 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqzfs" podUID="6b69a092-73c1-4098-b3af-3d38cce0cdb5" May 21 03:20:02.320710 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:02.320670 2575 generic.go:358] "Generic (PLEG): container finished" podID="dc4295eb-090f-4bcb-9429-fb127fd63fa8" containerID="a21aeaad1941bf56901023c944d72f0755bd2d9959ba442530067c547a32e55d" exitCode=0 May 21 03:20:02.320891 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:02.320751 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svx44" event={"ID":"dc4295eb-090f-4bcb-9429-fb127fd63fa8","Type":"ContainerDied","Data":"a21aeaad1941bf56901023c944d72f0755bd2d9959ba442530067c547a32e55d"} May 21 03:20:02.324576 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:02.324533 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" event={"ID":"3b16d171-5803-4a52-8faa-b6290af8b5dc","Type":"ContainerStarted","Data":"40e8065bc2a620ab15b6da7c9635cea3fffb602c99041df9f562ab38629b2641"} May 21 03:20:02.327319 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:02.325020 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7wn9q" May 21 03:20:02.327319 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:02.326169 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7wn9q" May 21 03:20:02.327319 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:02.326428 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:20:02.327319 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:02.326779 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:20:02.343097 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:02.343059 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:20:02.343258 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:02.343141 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:20:02.378783 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:02.378739 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" podStartSLOduration=8.091640803 podStartE2EDuration="26.378725128s" podCreationTimestamp="2026-05-21 03:19:36 +0000 UTC" firstStartedPulling="2026-05-21 03:19:38.719560587 +0000 UTC m=+3.085780972" lastFinishedPulling="2026-05-21 03:19:57.006644915 +0000 UTC m=+21.372865297" observedRunningTime="2026-05-21 03:20:02.378148737 +0000 UTC m=+26.744369129" watchObservedRunningTime="2026-05-21 03:20:02.378725128 +0000 UTC m=+26.744945545" May 21 03:20:02.988864 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:02.988654 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:20:03.328070 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:03.327958 2575 generic.go:358] "Generic (PLEG): container finished" podID="dc4295eb-090f-4bcb-9429-fb127fd63fa8" containerID="2e607c1b3ec8f100ab065c560f54532be7d3346cd3700821a238dd31fd1e4415" exitCode=0 May 21 03:20:03.328070 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:03.328041 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svx44" event={"ID":"dc4295eb-090f-4bcb-9429-fb127fd63fa8","Type":"ContainerDied","Data":"2e607c1b3ec8f100ab065c560f54532be7d3346cd3700821a238dd31fd1e4415"} May 21 03:20:03.706123 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:03.706029 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fqzfs"] May 21 03:20:03.706283 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:03.706210 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:20:03.706365 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:03.706324 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqzfs" podUID="6b69a092-73c1-4098-b3af-3d38cce0cdb5" May 21 03:20:03.708562 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:03.708536 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6qc5c"] May 21 03:20:03.708720 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:03.708707 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:20:03.708858 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:03.708819 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qc5c" podUID="ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad" May 21 03:20:04.332380 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:04.332256 2575 generic.go:358] "Generic (PLEG): container finished" podID="dc4295eb-090f-4bcb-9429-fb127fd63fa8" containerID="21bd7a27c14682e9252beaa139ba03f9c2238f00f8e618effaeb77b623a32d40" exitCode=0 May 21 03:20:04.332380 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:04.332344 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svx44" event={"ID":"dc4295eb-090f-4bcb-9429-fb127fd63fa8","Type":"ContainerDied","Data":"21bd7a27c14682e9252beaa139ba03f9c2238f00f8e618effaeb77b623a32d40"} May 21 03:20:05.201209 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:05.201168 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:20:05.201400 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:05.201168 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:20:05.201400 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:05.201310 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqzfs" podUID="6b69a092-73c1-4098-b3af-3d38cce0cdb5" May 21 03:20:05.201483 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:05.201415 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qc5c" podUID="ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad" May 21 03:20:07.200638 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:07.200439 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:20:07.201142 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:07.200435 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:20:07.201142 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:07.200751 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qc5c" podUID="ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad" May 21 03:20:07.201142 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:07.200800 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqzfs" podUID="6b69a092-73c1-4098-b3af-3d38cce0cdb5" May 21 03:20:09.200490 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:09.200451 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:20:09.200972 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:09.200451 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:20:09.200972 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:09.200613 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qc5c" podUID="ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad" May 21 03:20:09.200972 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:09.200766 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqzfs" podUID="6b69a092-73c1-4098-b3af-3d38cce0cdb5" May 21 03:20:09.830231 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:09.830191 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs\") pod \"network-metrics-daemon-6qc5c\" (UID: \"ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad\") " pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:20:09.830504 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:09.830378 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:20:09.830504 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:09.830458 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs podName:ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad nodeName:}" failed. No retries permitted until 2026-05-21 03:20:41.830436898 +0000 UTC m=+66.196657275 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs") pod "network-metrics-daemon-6qc5c" (UID: "ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 03:20:09.985511 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:09.985477 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-251.ec2.internal" event="NodeReady" May 21 03:20:09.985690 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:09.985630 2575 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 03:20:10.026185 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.026149 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s77fp"] May 21 03:20:10.032200 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.032160 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ddbq2\" (UniqueName: \"kubernetes.io/projected/6b69a092-73c1-4098-b3af-3d38cce0cdb5-kube-api-access-ddbq2\") pod \"network-check-target-fqzfs\" (UID: \"6b69a092-73c1-4098-b3af-3d38cce0cdb5\") " pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:20:10.032372 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:10.032298 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 03:20:10.032372 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:10.032316 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 03:20:10.032372 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:10.032327 2575 projected.go:194] Error preparing data for projected volume kube-api-access-ddbq2 for pod openshift-network-diagnostics/network-check-target-fqzfs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:20:10.032541 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:10.032409 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b69a092-73c1-4098-b3af-3d38cce0cdb5-kube-api-access-ddbq2 podName:6b69a092-73c1-4098-b3af-3d38cce0cdb5 nodeName:}" failed. No retries permitted until 2026-05-21 03:20:42.032391214 +0000 UTC m=+66.398611607 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ddbq2" (UniqueName: "kubernetes.io/projected/6b69a092-73c1-4098-b3af-3d38cce0cdb5-kube-api-access-ddbq2") pod "network-check-target-fqzfs" (UID: "6b69a092-73c1-4098-b3af-3d38cce0cdb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 03:20:10.058797 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.058752 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zgc2v"] May 21 03:20:10.058969 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.058940 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s77fp" May 21 03:20:10.061645 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.061619 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 03:20:10.061645 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.061644 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-znmrr\"" May 21 03:20:10.061837 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.061619 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 03:20:10.072878 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.072854 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s77fp"] May 21 03:20:10.072878 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.072881 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zgc2v"] May 21 03:20:10.073016 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.072978 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zgc2v" May 21 03:20:10.076263 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.076240 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 03:20:10.076424 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.076401 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 03:20:10.076508 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.076401 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pm6r8\"" May 21 03:20:10.076508 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.076467 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 03:20:10.133563 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.133479 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fa912a9-75a7-4abb-9e27-33cb4f27918d-metrics-tls\") pod \"dns-default-s77fp\" (UID: \"9fa912a9-75a7-4abb-9e27-33cb4f27918d\") " pod="openshift-dns/dns-default-s77fp" May 21 03:20:10.133563 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.133518 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9fa912a9-75a7-4abb-9e27-33cb4f27918d-config-volume\") pod \"dns-default-s77fp\" (UID: \"9fa912a9-75a7-4abb-9e27-33cb4f27918d\") " pod="openshift-dns/dns-default-s77fp" May 21 03:20:10.133563 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.133542 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9sg4\" (UniqueName: \"kubernetes.io/projected/7104e42b-14d4-4928-aba1-83a0361e7a5d-kube-api-access-c9sg4\") pod \"ingress-canary-zgc2v\" (UID: \"7104e42b-14d4-4928-aba1-83a0361e7a5d\") " pod="openshift-ingress-canary/ingress-canary-zgc2v" May 21 03:20:10.133777 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.133673 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnwp5\" (UniqueName: \"kubernetes.io/projected/9fa912a9-75a7-4abb-9e27-33cb4f27918d-kube-api-access-vnwp5\") pod \"dns-default-s77fp\" (UID: \"9fa912a9-75a7-4abb-9e27-33cb4f27918d\") " pod="openshift-dns/dns-default-s77fp" May 21 03:20:10.133777 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.133734 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fa912a9-75a7-4abb-9e27-33cb4f27918d-tmp-dir\") pod \"dns-default-s77fp\" (UID: \"9fa912a9-75a7-4abb-9e27-33cb4f27918d\") " pod="openshift-dns/dns-default-s77fp" May 21 03:20:10.133777 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.133768 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7104e42b-14d4-4928-aba1-83a0361e7a5d-cert\") pod \"ingress-canary-zgc2v\" (UID: \"7104e42b-14d4-4928-aba1-83a0361e7a5d\") " pod="openshift-ingress-canary/ingress-canary-zgc2v" May 21 03:20:10.234209 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.234174 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fa912a9-75a7-4abb-9e27-33cb4f27918d-tmp-dir\") pod \"dns-default-s77fp\" (UID: \"9fa912a9-75a7-4abb-9e27-33cb4f27918d\") " pod="openshift-dns/dns-default-s77fp" May 21 03:20:10.234647 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.234219 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7104e42b-14d4-4928-aba1-83a0361e7a5d-cert\") pod \"ingress-canary-zgc2v\" (UID: \"7104e42b-14d4-4928-aba1-83a0361e7a5d\") " pod="openshift-ingress-canary/ingress-canary-zgc2v" May 21 03:20:10.234647 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.234240 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fa912a9-75a7-4abb-9e27-33cb4f27918d-metrics-tls\") pod \"dns-default-s77fp\" (UID: \"9fa912a9-75a7-4abb-9e27-33cb4f27918d\") " pod="openshift-dns/dns-default-s77fp" May 21 03:20:10.234647 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.234343 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9fa912a9-75a7-4abb-9e27-33cb4f27918d-config-volume\") pod \"dns-default-s77fp\" (UID: \"9fa912a9-75a7-4abb-9e27-33cb4f27918d\") " pod="openshift-dns/dns-default-s77fp" May 21 03:20:10.234647 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:10.234378 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 03:20:10.234647 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.234392 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c9sg4\" (UniqueName: \"kubernetes.io/projected/7104e42b-14d4-4928-aba1-83a0361e7a5d-kube-api-access-c9sg4\") pod \"ingress-canary-zgc2v\" (UID: \"7104e42b-14d4-4928-aba1-83a0361e7a5d\") " pod="openshift-ingress-canary/ingress-canary-zgc2v" May 21 03:20:10.234647 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.234432 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vnwp5\" (UniqueName: \"kubernetes.io/projected/9fa912a9-75a7-4abb-9e27-33cb4f27918d-kube-api-access-vnwp5\") pod \"dns-default-s77fp\" (UID: \"9fa912a9-75a7-4abb-9e27-33cb4f27918d\") " pod="openshift-dns/dns-default-s77fp" May 21 03:20:10.234647 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:10.234435 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 03:20:10.234647 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:10.234450 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7104e42b-14d4-4928-aba1-83a0361e7a5d-cert podName:7104e42b-14d4-4928-aba1-83a0361e7a5d nodeName:}" failed. No retries permitted until 2026-05-21 03:20:10.734426997 +0000 UTC m=+35.100647381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7104e42b-14d4-4928-aba1-83a0361e7a5d-cert") pod "ingress-canary-zgc2v" (UID: "7104e42b-14d4-4928-aba1-83a0361e7a5d") : secret "canary-serving-cert" not found May 21 03:20:10.234647 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:10.234490 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa912a9-75a7-4abb-9e27-33cb4f27918d-metrics-tls podName:9fa912a9-75a7-4abb-9e27-33cb4f27918d nodeName:}" failed. No retries permitted until 2026-05-21 03:20:10.73447213 +0000 UTC m=+35.100692500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fa912a9-75a7-4abb-9e27-33cb4f27918d-metrics-tls") pod "dns-default-s77fp" (UID: "9fa912a9-75a7-4abb-9e27-33cb4f27918d") : secret "dns-default-metrics-tls" not found May 21 03:20:10.234647 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.234634 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fa912a9-75a7-4abb-9e27-33cb4f27918d-tmp-dir\") pod \"dns-default-s77fp\" (UID: \"9fa912a9-75a7-4abb-9e27-33cb4f27918d\") " pod="openshift-dns/dns-default-s77fp" May 21 03:20:10.234972 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.234855 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9fa912a9-75a7-4abb-9e27-33cb4f27918d-config-volume\") pod \"dns-default-s77fp\" (UID: \"9fa912a9-75a7-4abb-9e27-33cb4f27918d\") " pod="openshift-dns/dns-default-s77fp" May 21 03:20:10.244762 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.244732 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnwp5\" (UniqueName: \"kubernetes.io/projected/9fa912a9-75a7-4abb-9e27-33cb4f27918d-kube-api-access-vnwp5\") pod \"dns-default-s77fp\" (UID: \"9fa912a9-75a7-4abb-9e27-33cb4f27918d\") " pod="openshift-dns/dns-default-s77fp" May 21 03:20:10.244862 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.244799 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9sg4\" (UniqueName: \"kubernetes.io/projected/7104e42b-14d4-4928-aba1-83a0361e7a5d-kube-api-access-c9sg4\") pod \"ingress-canary-zgc2v\" (UID: \"7104e42b-14d4-4928-aba1-83a0361e7a5d\") " pod="openshift-ingress-canary/ingress-canary-zgc2v" May 21 03:20:10.739657 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.739622 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7104e42b-14d4-4928-aba1-83a0361e7a5d-cert\") pod \"ingress-canary-zgc2v\" (UID: \"7104e42b-14d4-4928-aba1-83a0361e7a5d\") " pod="openshift-ingress-canary/ingress-canary-zgc2v" May 21 03:20:10.739657 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:10.739665 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fa912a9-75a7-4abb-9e27-33cb4f27918d-metrics-tls\") pod \"dns-default-s77fp\" (UID: \"9fa912a9-75a7-4abb-9e27-33cb4f27918d\") " pod="openshift-dns/dns-default-s77fp" May 21 03:20:10.739877 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:10.739761 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 03:20:10.739877 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:10.739766 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 03:20:10.739877 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:10.739850 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7104e42b-14d4-4928-aba1-83a0361e7a5d-cert podName:7104e42b-14d4-4928-aba1-83a0361e7a5d nodeName:}" failed. No retries permitted until 2026-05-21 03:20:11.739831581 +0000 UTC m=+36.106051952 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7104e42b-14d4-4928-aba1-83a0361e7a5d-cert") pod "ingress-canary-zgc2v" (UID: "7104e42b-14d4-4928-aba1-83a0361e7a5d") : secret "canary-serving-cert" not found May 21 03:20:10.739877 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:10.739869 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa912a9-75a7-4abb-9e27-33cb4f27918d-metrics-tls podName:9fa912a9-75a7-4abb-9e27-33cb4f27918d nodeName:}" failed. No retries permitted until 2026-05-21 03:20:11.739857496 +0000 UTC m=+36.106077866 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fa912a9-75a7-4abb-9e27-33cb4f27918d-metrics-tls") pod "dns-default-s77fp" (UID: "9fa912a9-75a7-4abb-9e27-33cb4f27918d") : secret "dns-default-metrics-tls" not found May 21 03:20:11.201002 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:11.200927 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:20:11.201002 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:11.200945 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:20:11.203406 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:11.203382 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 03:20:11.203904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:11.203887 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 03:20:11.203989 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:11.203926 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 03:20:11.204543 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:11.204522 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2nkrm\"" May 21 03:20:11.204631 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:11.204528 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rwbqv\"" May 21 03:20:11.348178 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:11.348144 2575 generic.go:358] "Generic (PLEG): container finished" podID="dc4295eb-090f-4bcb-9429-fb127fd63fa8" containerID="69fb2cbc6999f1544a6762a537cca2c49b71f2a0b778c8320032a927920ebad5" exitCode=0 May 21 03:20:11.348807 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:11.348207 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svx44" event={"ID":"dc4295eb-090f-4bcb-9429-fb127fd63fa8","Type":"ContainerDied","Data":"69fb2cbc6999f1544a6762a537cca2c49b71f2a0b778c8320032a927920ebad5"} May 21 03:20:11.741046 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:11.740953 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-kszz4"] May 21 03:20:11.747531 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:11.747496 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7104e42b-14d4-4928-aba1-83a0361e7a5d-cert\") pod \"ingress-canary-zgc2v\" (UID: \"7104e42b-14d4-4928-aba1-83a0361e7a5d\") " pod="openshift-ingress-canary/ingress-canary-zgc2v" May 21 03:20:11.747687 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:11.747535 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fa912a9-75a7-4abb-9e27-33cb4f27918d-metrics-tls\") pod \"dns-default-s77fp\" (UID: \"9fa912a9-75a7-4abb-9e27-33cb4f27918d\") " pod="openshift-dns/dns-default-s77fp" May 21 03:20:11.747687 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:11.747653 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 03:20:11.747766 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:11.747722 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7104e42b-14d4-4928-aba1-83a0361e7a5d-cert podName:7104e42b-14d4-4928-aba1-83a0361e7a5d nodeName:}" failed. No retries permitted until 2026-05-21 03:20:13.747707362 +0000 UTC m=+38.113927748 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7104e42b-14d4-4928-aba1-83a0361e7a5d-cert") pod "ingress-canary-zgc2v" (UID: "7104e42b-14d4-4928-aba1-83a0361e7a5d") : secret "canary-serving-cert" not found May 21 03:20:11.747766 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:11.747657 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 03:20:11.747847 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:11.747788 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa912a9-75a7-4abb-9e27-33cb4f27918d-metrics-tls podName:9fa912a9-75a7-4abb-9e27-33cb4f27918d nodeName:}" failed. No retries permitted until 2026-05-21 03:20:13.747777402 +0000 UTC m=+38.113997778 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fa912a9-75a7-4abb-9e27-33cb4f27918d-metrics-tls") pod "dns-default-s77fp" (UID: "9fa912a9-75a7-4abb-9e27-33cb4f27918d") : secret "dns-default-metrics-tls" not found May 21 03:20:11.754090 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:11.754065 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kszz4"] May 21 03:20:11.754228 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:11.754166 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kszz4" May 21 03:20:11.756558 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:11.756537 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 03:20:11.848160 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:11.848117 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1b21c5a4-9321-44f7-b455-ffadcfea53bc-kubelet-config\") pod \"global-pull-secret-syncer-kszz4\" (UID: \"1b21c5a4-9321-44f7-b455-ffadcfea53bc\") " pod="kube-system/global-pull-secret-syncer-kszz4" May 21 03:20:11.848337 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:11.848244 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1b21c5a4-9321-44f7-b455-ffadcfea53bc-dbus\") pod \"global-pull-secret-syncer-kszz4\" (UID: \"1b21c5a4-9321-44f7-b455-ffadcfea53bc\") " pod="kube-system/global-pull-secret-syncer-kszz4" May 21 03:20:11.848337 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:11.848280 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b21c5a4-9321-44f7-b455-ffadcfea53bc-original-pull-secret\") pod \"global-pull-secret-syncer-kszz4\" (UID: \"1b21c5a4-9321-44f7-b455-ffadcfea53bc\") " pod="kube-system/global-pull-secret-syncer-kszz4" May 21 03:20:11.948765 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:11.948725 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1b21c5a4-9321-44f7-b455-ffadcfea53bc-dbus\") pod \"global-pull-secret-syncer-kszz4\" (UID: \"1b21c5a4-9321-44f7-b455-ffadcfea53bc\") " pod="kube-system/global-pull-secret-syncer-kszz4" May 21 03:20:11.948765 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:11.948762 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b21c5a4-9321-44f7-b455-ffadcfea53bc-original-pull-secret\") pod \"global-pull-secret-syncer-kszz4\" (UID: \"1b21c5a4-9321-44f7-b455-ffadcfea53bc\") " pod="kube-system/global-pull-secret-syncer-kszz4" May 21 03:20:11.948975 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:11.948806 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1b21c5a4-9321-44f7-b455-ffadcfea53bc-kubelet-config\") pod \"global-pull-secret-syncer-kszz4\" (UID: \"1b21c5a4-9321-44f7-b455-ffadcfea53bc\") " pod="kube-system/global-pull-secret-syncer-kszz4" May 21 03:20:11.948975 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:11.948890 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1b21c5a4-9321-44f7-b455-ffadcfea53bc-kubelet-config\") pod \"global-pull-secret-syncer-kszz4\" (UID: \"1b21c5a4-9321-44f7-b455-ffadcfea53bc\") " pod="kube-system/global-pull-secret-syncer-kszz4" May 21 03:20:11.949038 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:11.949001 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1b21c5a4-9321-44f7-b455-ffadcfea53bc-dbus\") pod \"global-pull-secret-syncer-kszz4\" (UID: \"1b21c5a4-9321-44f7-b455-ffadcfea53bc\") " pod="kube-system/global-pull-secret-syncer-kszz4" May 21 03:20:11.951185 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:11.951166 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b21c5a4-9321-44f7-b455-ffadcfea53bc-original-pull-secret\") pod \"global-pull-secret-syncer-kszz4\" (UID: \"1b21c5a4-9321-44f7-b455-ffadcfea53bc\") " pod="kube-system/global-pull-secret-syncer-kszz4" May 21 03:20:12.063275 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:12.063246 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kszz4" May 21 03:20:12.257207 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:12.257029 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kszz4"] May 21 03:20:12.261000 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:20:12.260964 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b21c5a4_9321_44f7_b455_ffadcfea53bc.slice/crio-3a010675e9829f2afc650c5cddfca287dba6d158cc36b71d4d1c9a67ba04cb2e WatchSource:0}: Error finding container 3a010675e9829f2afc650c5cddfca287dba6d158cc36b71d4d1c9a67ba04cb2e: Status 404 returned error can't find the container with id 3a010675e9829f2afc650c5cddfca287dba6d158cc36b71d4d1c9a67ba04cb2e May 21 03:20:12.351340 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:12.351233 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kszz4" event={"ID":"1b21c5a4-9321-44f7-b455-ffadcfea53bc","Type":"ContainerStarted","Data":"3a010675e9829f2afc650c5cddfca287dba6d158cc36b71d4d1c9a67ba04cb2e"} May 21 03:20:12.354009 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:12.353984 2575 generic.go:358] "Generic (PLEG): container finished" podID="dc4295eb-090f-4bcb-9429-fb127fd63fa8" containerID="0a10420cdc922fd1b51a3bec148fd377b4f4e969221351030fe86ab35e669c60" exitCode=0 May 21 03:20:12.354136 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:12.354027 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svx44" event={"ID":"dc4295eb-090f-4bcb-9429-fb127fd63fa8","Type":"ContainerDied","Data":"0a10420cdc922fd1b51a3bec148fd377b4f4e969221351030fe86ab35e669c60"} May 21 03:20:13.361441 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:13.361407 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svx44" event={"ID":"dc4295eb-090f-4bcb-9429-fb127fd63fa8","Type":"ContainerStarted","Data":"ad2ce0947283868dcca7ce91fcf76437b810344909b0370afd56dd3ed3116956"} May 21 03:20:13.383865 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:13.383805 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-svx44" podStartSLOduration=5.5737254069999995 podStartE2EDuration="37.383786231s" podCreationTimestamp="2026-05-21 03:19:36 +0000 UTC" firstStartedPulling="2026-05-21 03:19:38.721933456 +0000 UTC m=+3.088153826" lastFinishedPulling="2026-05-21 03:20:10.531994281 +0000 UTC m=+34.898214650" observedRunningTime="2026-05-21 03:20:13.383623169 +0000 UTC m=+37.749843574" watchObservedRunningTime="2026-05-21 03:20:13.383786231 +0000 UTC m=+37.750006623" May 21 03:20:13.761148 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:13.761113 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7104e42b-14d4-4928-aba1-83a0361e7a5d-cert\") pod \"ingress-canary-zgc2v\" (UID: \"7104e42b-14d4-4928-aba1-83a0361e7a5d\") " pod="openshift-ingress-canary/ingress-canary-zgc2v" May 21 03:20:13.761335 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:13.761157 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fa912a9-75a7-4abb-9e27-33cb4f27918d-metrics-tls\") pod \"dns-default-s77fp\" (UID: \"9fa912a9-75a7-4abb-9e27-33cb4f27918d\") " pod="openshift-dns/dns-default-s77fp" May 21 03:20:13.761335 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:13.761264 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 03:20:13.761335 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:13.761331 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa912a9-75a7-4abb-9e27-33cb4f27918d-metrics-tls podName:9fa912a9-75a7-4abb-9e27-33cb4f27918d nodeName:}" failed. No retries permitted until 2026-05-21 03:20:17.76131648 +0000 UTC m=+42.127536853 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fa912a9-75a7-4abb-9e27-33cb4f27918d-metrics-tls") pod "dns-default-s77fp" (UID: "9fa912a9-75a7-4abb-9e27-33cb4f27918d") : secret "dns-default-metrics-tls" not found May 21 03:20:13.761492 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:13.761264 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 03:20:13.761492 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:13.761401 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7104e42b-14d4-4928-aba1-83a0361e7a5d-cert podName:7104e42b-14d4-4928-aba1-83a0361e7a5d nodeName:}" failed. No retries permitted until 2026-05-21 03:20:17.761388308 +0000 UTC m=+42.127608683 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7104e42b-14d4-4928-aba1-83a0361e7a5d-cert") pod "ingress-canary-zgc2v" (UID: "7104e42b-14d4-4928-aba1-83a0361e7a5d") : secret "canary-serving-cert" not found May 21 03:20:17.371449 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:17.371408 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kszz4" event={"ID":"1b21c5a4-9321-44f7-b455-ffadcfea53bc","Type":"ContainerStarted","Data":"752231db716a616cbcf44ccb7b6033d867090850d56400fb9cc469932ea342c0"} May 21 03:20:17.385123 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:17.385076 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kszz4" podStartSLOduration=1.643999486 podStartE2EDuration="6.385061532s" podCreationTimestamp="2026-05-21 03:20:11 +0000 UTC" firstStartedPulling="2026-05-21 03:20:12.262670041 +0000 UTC m=+36.628890411" lastFinishedPulling="2026-05-21 03:20:17.003732087 +0000 UTC m=+41.369952457" observedRunningTime="2026-05-21 03:20:17.384543494 +0000 UTC m=+41.750763892" watchObservedRunningTime="2026-05-21 03:20:17.385061532 +0000 UTC m=+41.751281923" May 21 03:20:17.790840 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:17.790803 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7104e42b-14d4-4928-aba1-83a0361e7a5d-cert\") pod \"ingress-canary-zgc2v\" (UID: \"7104e42b-14d4-4928-aba1-83a0361e7a5d\") " pod="openshift-ingress-canary/ingress-canary-zgc2v" May 21 03:20:17.791005 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:17.790852 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fa912a9-75a7-4abb-9e27-33cb4f27918d-metrics-tls\") pod \"dns-default-s77fp\" (UID: \"9fa912a9-75a7-4abb-9e27-33cb4f27918d\") " pod="openshift-dns/dns-default-s77fp" May 21 03:20:17.791005 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:17.790963 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 03:20:17.791005 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:17.790967 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 03:20:17.791105 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:17.791023 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa912a9-75a7-4abb-9e27-33cb4f27918d-metrics-tls podName:9fa912a9-75a7-4abb-9e27-33cb4f27918d nodeName:}" failed. No retries permitted until 2026-05-21 03:20:25.791009627 +0000 UTC m=+50.157229997 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fa912a9-75a7-4abb-9e27-33cb4f27918d-metrics-tls") pod "dns-default-s77fp" (UID: "9fa912a9-75a7-4abb-9e27-33cb4f27918d") : secret "dns-default-metrics-tls" not found May 21 03:20:17.791105 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:17.791038 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7104e42b-14d4-4928-aba1-83a0361e7a5d-cert podName:7104e42b-14d4-4928-aba1-83a0361e7a5d nodeName:}" failed. No retries permitted until 2026-05-21 03:20:25.791030698 +0000 UTC m=+50.157251067 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7104e42b-14d4-4928-aba1-83a0361e7a5d-cert") pod "ingress-canary-zgc2v" (UID: "7104e42b-14d4-4928-aba1-83a0361e7a5d") : secret "canary-serving-cert" not found May 21 03:20:25.844991 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:25.844948 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7104e42b-14d4-4928-aba1-83a0361e7a5d-cert\") pod \"ingress-canary-zgc2v\" (UID: \"7104e42b-14d4-4928-aba1-83a0361e7a5d\") " pod="openshift-ingress-canary/ingress-canary-zgc2v" May 21 03:20:25.844991 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:25.844999 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fa912a9-75a7-4abb-9e27-33cb4f27918d-metrics-tls\") pod \"dns-default-s77fp\" (UID: \"9fa912a9-75a7-4abb-9e27-33cb4f27918d\") " pod="openshift-dns/dns-default-s77fp" May 21 03:20:25.845554 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:25.845098 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 03:20:25.845554 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:25.845100 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 03:20:25.845554 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:25.845155 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa912a9-75a7-4abb-9e27-33cb4f27918d-metrics-tls podName:9fa912a9-75a7-4abb-9e27-33cb4f27918d nodeName:}" failed. No retries permitted until 2026-05-21 03:20:41.845139692 +0000 UTC m=+66.211360062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fa912a9-75a7-4abb-9e27-33cb4f27918d-metrics-tls") pod "dns-default-s77fp" (UID: "9fa912a9-75a7-4abb-9e27-33cb4f27918d") : secret "dns-default-metrics-tls" not found May 21 03:20:25.845554 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:25.845168 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7104e42b-14d4-4928-aba1-83a0361e7a5d-cert podName:7104e42b-14d4-4928-aba1-83a0361e7a5d nodeName:}" failed. No retries permitted until 2026-05-21 03:20:41.845161336 +0000 UTC m=+66.211381706 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7104e42b-14d4-4928-aba1-83a0361e7a5d-cert") pod "ingress-canary-zgc2v" (UID: "7104e42b-14d4-4928-aba1-83a0361e7a5d") : secret "canary-serving-cert" not found May 21 03:20:27.674109 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.674074 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c68dc9f86-k78vj"] May 21 03:20:27.675896 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.675879 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c68dc9f86-k78vj" May 21 03:20:27.678797 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.678771 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 21 03:20:27.678797 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.678778 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 21 03:20:27.679017 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.678999 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-jgcg7\"" May 21 03:20:27.679120 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.679098 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 21 03:20:27.679615 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.679598 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 21 03:20:27.680070 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.680053 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx"] May 21 03:20:27.682162 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.682144 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" May 21 03:20:27.683429 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.683400 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c68dc9f86-k78vj"] May 21 03:20:27.684212 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.684192 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 21 03:20:27.684316 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.684219 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 21 03:20:27.684316 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.684256 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 21 03:20:27.684526 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.684508 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 21 03:20:27.692597 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.692577 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx"] May 21 03:20:27.760002 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.759969 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a6749ad-169f-4375-837b-2f862c01bf7a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-fcccb8ddd-m82dx\" (UID: \"1a6749ad-169f-4375-837b-2f862c01bf7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" May 21 03:20:27.760002 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.760008 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/1a6749ad-169f-4375-837b-2f862c01bf7a-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-fcccb8ddd-m82dx\" (UID: \"1a6749ad-169f-4375-837b-2f862c01bf7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" May 21 03:20:27.760225 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.760035 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1a6749ad-169f-4375-837b-2f862c01bf7a-hub\") pod \"cluster-proxy-proxy-agent-fcccb8ddd-m82dx\" (UID: \"1a6749ad-169f-4375-837b-2f862c01bf7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" May 21 03:20:27.760225 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.760093 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/83e7ac60-fb04-487a-9d49-4c689e110555-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c68dc9f86-k78vj\" (UID: \"83e7ac60-fb04-487a-9d49-4c689e110555\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c68dc9f86-k78vj" May 21 03:20:27.760225 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.760129 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1a6749ad-169f-4375-837b-2f862c01bf7a-ca\") pod \"cluster-proxy-proxy-agent-fcccb8ddd-m82dx\" (UID: \"1a6749ad-169f-4375-837b-2f862c01bf7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" May 21 03:20:27.760225 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.760158 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjsmj\" (UniqueName: \"kubernetes.io/projected/1a6749ad-169f-4375-837b-2f862c01bf7a-kube-api-access-bjsmj\") pod \"cluster-proxy-proxy-agent-fcccb8ddd-m82dx\" (UID: \"1a6749ad-169f-4375-837b-2f862c01bf7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" May 21 03:20:27.760225 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.760188 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1a6749ad-169f-4375-837b-2f862c01bf7a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-fcccb8ddd-m82dx\" (UID: \"1a6749ad-169f-4375-837b-2f862c01bf7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" May 21 03:20:27.760225 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.760208 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgvm2\" (UniqueName: \"kubernetes.io/projected/83e7ac60-fb04-487a-9d49-4c689e110555-kube-api-access-lgvm2\") pod \"managed-serviceaccount-addon-agent-5c68dc9f86-k78vj\" (UID: \"83e7ac60-fb04-487a-9d49-4c689e110555\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c68dc9f86-k78vj" May 21 03:20:27.861512 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.861477 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1a6749ad-169f-4375-837b-2f862c01bf7a-hub\") pod \"cluster-proxy-proxy-agent-fcccb8ddd-m82dx\" (UID: \"1a6749ad-169f-4375-837b-2f862c01bf7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" May 21 03:20:27.861645 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.861524 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/83e7ac60-fb04-487a-9d49-4c689e110555-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c68dc9f86-k78vj\" (UID: \"83e7ac60-fb04-487a-9d49-4c689e110555\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c68dc9f86-k78vj" May 21 03:20:27.861645 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.861551 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1a6749ad-169f-4375-837b-2f862c01bf7a-ca\") pod \"cluster-proxy-proxy-agent-fcccb8ddd-m82dx\" (UID: \"1a6749ad-169f-4375-837b-2f862c01bf7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" May 21 03:20:27.861645 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.861580 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bjsmj\" (UniqueName: \"kubernetes.io/projected/1a6749ad-169f-4375-837b-2f862c01bf7a-kube-api-access-bjsmj\") pod \"cluster-proxy-proxy-agent-fcccb8ddd-m82dx\" (UID: \"1a6749ad-169f-4375-837b-2f862c01bf7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" May 21 03:20:27.861645 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.861612 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1a6749ad-169f-4375-837b-2f862c01bf7a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-fcccb8ddd-m82dx\" (UID: \"1a6749ad-169f-4375-837b-2f862c01bf7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" May 21 03:20:27.861645 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.861639 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lgvm2\" (UniqueName: \"kubernetes.io/projected/83e7ac60-fb04-487a-9d49-4c689e110555-kube-api-access-lgvm2\") pod \"managed-serviceaccount-addon-agent-5c68dc9f86-k78vj\" (UID: \"83e7ac60-fb04-487a-9d49-4c689e110555\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c68dc9f86-k78vj" May 21 03:20:27.861883 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.861838 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a6749ad-169f-4375-837b-2f862c01bf7a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-fcccb8ddd-m82dx\" (UID: \"1a6749ad-169f-4375-837b-2f862c01bf7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" May 21 03:20:27.861946 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.861880 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/1a6749ad-169f-4375-837b-2f862c01bf7a-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-fcccb8ddd-m82dx\" (UID: \"1a6749ad-169f-4375-837b-2f862c01bf7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" May 21 03:20:27.862623 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.862579 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/1a6749ad-169f-4375-837b-2f862c01bf7a-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-fcccb8ddd-m82dx\" (UID: \"1a6749ad-169f-4375-837b-2f862c01bf7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" May 21 03:20:27.865453 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.865418 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1a6749ad-169f-4375-837b-2f862c01bf7a-ca\") pod \"cluster-proxy-proxy-agent-fcccb8ddd-m82dx\" (UID: \"1a6749ad-169f-4375-837b-2f862c01bf7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" May 21 03:20:27.865577 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.865565 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1a6749ad-169f-4375-837b-2f862c01bf7a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-fcccb8ddd-m82dx\" (UID: \"1a6749ad-169f-4375-837b-2f862c01bf7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" May 21 03:20:27.865646 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.865626 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a6749ad-169f-4375-837b-2f862c01bf7a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-fcccb8ddd-m82dx\" (UID: \"1a6749ad-169f-4375-837b-2f862c01bf7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" May 21 03:20:27.865707 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.865678 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/83e7ac60-fb04-487a-9d49-4c689e110555-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c68dc9f86-k78vj\" (UID: \"83e7ac60-fb04-487a-9d49-4c689e110555\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c68dc9f86-k78vj" May 21 03:20:27.865756 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.865707 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1a6749ad-169f-4375-837b-2f862c01bf7a-hub\") pod \"cluster-proxy-proxy-agent-fcccb8ddd-m82dx\" (UID: \"1a6749ad-169f-4375-837b-2f862c01bf7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" May 21 03:20:27.869564 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.869539 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjsmj\" (UniqueName: \"kubernetes.io/projected/1a6749ad-169f-4375-837b-2f862c01bf7a-kube-api-access-bjsmj\") pod \"cluster-proxy-proxy-agent-fcccb8ddd-m82dx\" (UID: \"1a6749ad-169f-4375-837b-2f862c01bf7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" May 21 03:20:27.869672 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.869543 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgvm2\" (UniqueName: \"kubernetes.io/projected/83e7ac60-fb04-487a-9d49-4c689e110555-kube-api-access-lgvm2\") pod \"managed-serviceaccount-addon-agent-5c68dc9f86-k78vj\" (UID: \"83e7ac60-fb04-487a-9d49-4c689e110555\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c68dc9f86-k78vj" May 21 03:20:27.996808 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:27.996716 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c68dc9f86-k78vj" May 21 03:20:28.002492 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:28.002467 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" May 21 03:20:28.137223 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:28.137191 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c68dc9f86-k78vj"] May 21 03:20:28.141048 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:20:28.141016 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83e7ac60_fb04_487a_9d49_4c689e110555.slice/crio-228e1c39db899597b87a92a075332d2800ba06035eb816716dc88a5cab3c4eec WatchSource:0}: Error finding container 228e1c39db899597b87a92a075332d2800ba06035eb816716dc88a5cab3c4eec: Status 404 returned error can't find the container with id 228e1c39db899597b87a92a075332d2800ba06035eb816716dc88a5cab3c4eec May 21 03:20:28.156713 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:28.156688 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx"] May 21 03:20:28.159616 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:20:28.159590 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a6749ad_169f_4375_837b_2f862c01bf7a.slice/crio-0f401a131ebf74941a454b6b1090df8a4e8bfe5bcdbabb6bdf50664330f994e5 WatchSource:0}: Error finding container 0f401a131ebf74941a454b6b1090df8a4e8bfe5bcdbabb6bdf50664330f994e5: Status 404 returned error can't find the container with id 0f401a131ebf74941a454b6b1090df8a4e8bfe5bcdbabb6bdf50664330f994e5 May 21 03:20:28.392466 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:28.392423 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" event={"ID":"1a6749ad-169f-4375-837b-2f862c01bf7a","Type":"ContainerStarted","Data":"0f401a131ebf74941a454b6b1090df8a4e8bfe5bcdbabb6bdf50664330f994e5"} May 21 03:20:28.393304 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:28.393284 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c68dc9f86-k78vj" event={"ID":"83e7ac60-fb04-487a-9d49-4c689e110555","Type":"ContainerStarted","Data":"228e1c39db899597b87a92a075332d2800ba06035eb816716dc88a5cab3c4eec"} May 21 03:20:31.401244 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:31.401196 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" event={"ID":"1a6749ad-169f-4375-837b-2f862c01bf7a","Type":"ContainerStarted","Data":"bf983a966f62e436c2eaf59da9376f7927818db94acf5d54276eb791785eaf89"} May 21 03:20:34.344529 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:34.344492 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hkgwf" May 21 03:20:35.411634 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:35.411596 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" event={"ID":"1a6749ad-169f-4375-837b-2f862c01bf7a","Type":"ContainerStarted","Data":"c4368fec7b029816a38d33614f6dabe8ca4f9d9475c688c2d982b0a604874d12"} May 21 03:20:35.411634 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:35.411635 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" event={"ID":"1a6749ad-169f-4375-837b-2f862c01bf7a","Type":"ContainerStarted","Data":"d71d9ae5894eaf0f015d617d3d582ce3b675eb74d9c17be0de78b9f9a4bfc7b5"} May 21 03:20:35.412916 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:35.412892 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c68dc9f86-k78vj" event={"ID":"83e7ac60-fb04-487a-9d49-4c689e110555","Type":"ContainerStarted","Data":"ae5d5ac8491ed817e9722832cb5376c296a175ec52631087f9d21a6d49670cc8"} May 21 03:20:35.431780 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:35.431732 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" podStartSLOduration=1.7981539720000002 podStartE2EDuration="8.431719994s" podCreationTimestamp="2026-05-21 03:20:27 +0000 UTC" firstStartedPulling="2026-05-21 03:20:28.161199826 +0000 UTC m=+52.527420197" lastFinishedPulling="2026-05-21 03:20:34.794765836 +0000 UTC m=+59.160986219" observedRunningTime="2026-05-21 03:20:35.430113215 +0000 UTC m=+59.796333619" watchObservedRunningTime="2026-05-21 03:20:35.431719994 +0000 UTC m=+59.797940435" May 21 03:20:35.443749 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:35.443702 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c68dc9f86-k78vj" podStartSLOduration=1.80135835 podStartE2EDuration="8.443689595s" podCreationTimestamp="2026-05-21 03:20:27 +0000 UTC" firstStartedPulling="2026-05-21 03:20:28.142796555 +0000 UTC m=+52.509016925" lastFinishedPulling="2026-05-21 03:20:34.785127797 +0000 UTC m=+59.151348170" observedRunningTime="2026-05-21 03:20:35.443055496 +0000 UTC m=+59.809275891" watchObservedRunningTime="2026-05-21 03:20:35.443689595 +0000 UTC m=+59.809909987" May 21 03:20:41.878728 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:41.878674 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7104e42b-14d4-4928-aba1-83a0361e7a5d-cert\") pod \"ingress-canary-zgc2v\" (UID: \"7104e42b-14d4-4928-aba1-83a0361e7a5d\") " pod="openshift-ingress-canary/ingress-canary-zgc2v" May 21 03:20:41.878728 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:41.878731 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fa912a9-75a7-4abb-9e27-33cb4f27918d-metrics-tls\") pod \"dns-default-s77fp\" (UID: \"9fa912a9-75a7-4abb-9e27-33cb4f27918d\") " pod="openshift-dns/dns-default-s77fp" May 21 03:20:41.879220 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:41.878772 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs\") pod \"network-metrics-daemon-6qc5c\" (UID: \"ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad\") " pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:20:41.879220 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:41.878829 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 03:20:41.879220 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:41.878879 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 03:20:41.879220 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:41.878896 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7104e42b-14d4-4928-aba1-83a0361e7a5d-cert podName:7104e42b-14d4-4928-aba1-83a0361e7a5d nodeName:}" failed. No retries permitted until 2026-05-21 03:21:13.87887603 +0000 UTC m=+98.245096409 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7104e42b-14d4-4928-aba1-83a0361e7a5d-cert") pod "ingress-canary-zgc2v" (UID: "7104e42b-14d4-4928-aba1-83a0361e7a5d") : secret "canary-serving-cert" not found May 21 03:20:41.879220 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:41.878940 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa912a9-75a7-4abb-9e27-33cb4f27918d-metrics-tls podName:9fa912a9-75a7-4abb-9e27-33cb4f27918d nodeName:}" failed. No retries permitted until 2026-05-21 03:21:13.878926366 +0000 UTC m=+98.245146736 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fa912a9-75a7-4abb-9e27-33cb4f27918d-metrics-tls") pod "dns-default-s77fp" (UID: "9fa912a9-75a7-4abb-9e27-33cb4f27918d") : secret "dns-default-metrics-tls" not found May 21 03:20:41.881656 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:41.881641 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 03:20:41.888918 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:41.888902 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 03:20:41.888972 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:41.888943 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs podName:ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad nodeName:}" failed. No retries permitted until 2026-05-21 03:21:45.888930742 +0000 UTC m=+130.255151111 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs") pod "network-metrics-daemon-6qc5c" (UID: "ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad") : secret "metrics-daemon-secret" not found May 21 03:20:42.080105 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:42.080064 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ddbq2\" (UniqueName: \"kubernetes.io/projected/6b69a092-73c1-4098-b3af-3d38cce0cdb5-kube-api-access-ddbq2\") pod \"network-check-target-fqzfs\" (UID: \"6b69a092-73c1-4098-b3af-3d38cce0cdb5\") " pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:20:42.082657 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:42.082638 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 03:20:42.092537 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:42.092517 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 03:20:42.103561 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:42.103535 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddbq2\" (UniqueName: \"kubernetes.io/projected/6b69a092-73c1-4098-b3af-3d38cce0cdb5-kube-api-access-ddbq2\") pod \"network-check-target-fqzfs\" (UID: \"6b69a092-73c1-4098-b3af-3d38cce0cdb5\") " pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:20:42.112274 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:42.112258 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2nkrm\"" May 21 03:20:42.120991 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:42.120969 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:20:42.238782 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:42.238753 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fqzfs"] May 21 03:20:42.242140 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:20:42.242112 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b69a092_73c1_4098_b3af_3d38cce0cdb5.slice/crio-79a4910d8aa1919d337874840bca06b9c0ad515fe47ccd62751800098c2d4c76 WatchSource:0}: Error finding container 79a4910d8aa1919d337874840bca06b9c0ad515fe47ccd62751800098c2d4c76: Status 404 returned error can't find the container with id 79a4910d8aa1919d337874840bca06b9c0ad515fe47ccd62751800098c2d4c76 May 21 03:20:42.427397 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:42.427298 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fqzfs" event={"ID":"6b69a092-73c1-4098-b3af-3d38cce0cdb5","Type":"ContainerStarted","Data":"79a4910d8aa1919d337874840bca06b9c0ad515fe47ccd62751800098c2d4c76"} May 21 03:20:43.540904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.540867 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55f4779596-ddj98"] May 21 03:20:43.542762 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.542738 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:43.545233 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.545214 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 03:20:43.545498 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.545474 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 03:20:43.545782 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.545760 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 03:20:43.546477 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.546433 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7gx7m\"" May 21 03:20:43.556036 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.556013 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 03:20:43.557581 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.557557 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55f4779596-ddj98"] May 21 03:20:43.591705 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.591663 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/76d9e19b-981f-421c-b780-133ab7290c4d-ca-trust-extracted\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:43.591705 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.591708 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/76d9e19b-981f-421c-b780-133ab7290c4d-trusted-ca\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:43.591955 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.591729 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-registry-tls\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:43.591955 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.591820 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/76d9e19b-981f-421c-b780-133ab7290c4d-installation-pull-secrets\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:43.591955 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.591863 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/76d9e19b-981f-421c-b780-133ab7290c4d-registry-certificates\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:43.591955 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.591891 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-bound-sa-token\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:43.591955 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.591932 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lnz5\" (UniqueName: \"kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-kube-api-access-7lnz5\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:43.592153 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.591979 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/76d9e19b-981f-421c-b780-133ab7290c4d-image-registry-private-configuration\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:43.692421 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.692378 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/76d9e19b-981f-421c-b780-133ab7290c4d-ca-trust-extracted\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:43.692421 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.692426 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/76d9e19b-981f-421c-b780-133ab7290c4d-trusted-ca\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:43.692734 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.692454 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-registry-tls\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:43.692734 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.692483 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/76d9e19b-981f-421c-b780-133ab7290c4d-installation-pull-secrets\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:43.692734 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.692510 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/76d9e19b-981f-421c-b780-133ab7290c4d-registry-certificates\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:43.692734 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.692540 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-bound-sa-token\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:43.692734 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.692584 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7lnz5\" (UniqueName: \"kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-kube-api-access-7lnz5\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:43.692734 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:43.692615 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 03:20:43.692734 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:43.692641 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55f4779596-ddj98: secret "image-registry-tls" not found May 21 03:20:43.692734 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:43.692707 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-registry-tls podName:76d9e19b-981f-421c-b780-133ab7290c4d nodeName:}" failed. No retries permitted until 2026-05-21 03:20:44.19268548 +0000 UTC m=+68.558905864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-registry-tls") pod "image-registry-55f4779596-ddj98" (UID: "76d9e19b-981f-421c-b780-133ab7290c4d") : secret "image-registry-tls" not found May 21 03:20:43.693171 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.692860 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/76d9e19b-981f-421c-b780-133ab7290c4d-ca-trust-extracted\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:43.693171 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.692619 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/76d9e19b-981f-421c-b780-133ab7290c4d-image-registry-private-configuration\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:43.693538 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.693512 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/76d9e19b-981f-421c-b780-133ab7290c4d-registry-certificates\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:43.693538 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.693530 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/76d9e19b-981f-421c-b780-133ab7290c4d-trusted-ca\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:43.695400 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.695372 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/76d9e19b-981f-421c-b780-133ab7290c4d-image-registry-private-configuration\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:43.695508 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.695418 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/76d9e19b-981f-421c-b780-133ab7290c4d-installation-pull-secrets\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:43.703914 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.703879 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-bound-sa-token\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:43.704161 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:43.704141 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lnz5\" (UniqueName: \"kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-kube-api-access-7lnz5\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:44.196820 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:44.196780 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-registry-tls\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:44.197007 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:44.196912 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 03:20:44.197007 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:44.196938 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55f4779596-ddj98: secret "image-registry-tls" not found May 21 03:20:44.197096 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:44.197023 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-registry-tls podName:76d9e19b-981f-421c-b780-133ab7290c4d nodeName:}" failed. No retries permitted until 2026-05-21 03:20:45.197000929 +0000 UTC m=+69.563221301 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-registry-tls") pod "image-registry-55f4779596-ddj98" (UID: "76d9e19b-981f-421c-b780-133ab7290c4d") : secret "image-registry-tls" not found May 21 03:20:45.204740 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:45.204645 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-registry-tls\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:45.205102 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:45.204793 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 03:20:45.205102 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:45.204816 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55f4779596-ddj98: secret "image-registry-tls" not found May 21 03:20:45.205102 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:45.204873 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-registry-tls podName:76d9e19b-981f-421c-b780-133ab7290c4d nodeName:}" failed. No retries permitted until 2026-05-21 03:20:47.204857293 +0000 UTC m=+71.571077667 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-registry-tls") pod "image-registry-55f4779596-ddj98" (UID: "76d9e19b-981f-421c-b780-133ab7290c4d") : secret "image-registry-tls" not found May 21 03:20:45.435701 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:45.435662 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fqzfs" event={"ID":"6b69a092-73c1-4098-b3af-3d38cce0cdb5","Type":"ContainerStarted","Data":"428323592b65b23027bf36fb5f72bdd2c910b6f3481008e2242ebfa055a6d628"} May 21 03:20:45.435866 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:45.435775 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:20:45.449647 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:45.449529 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fqzfs" podStartSLOduration=66.840679617 podStartE2EDuration="1m9.449513495s" podCreationTimestamp="2026-05-21 03:19:36 +0000 UTC" firstStartedPulling="2026-05-21 03:20:42.243978074 +0000 UTC m=+66.610198455" lastFinishedPulling="2026-05-21 03:20:44.852811953 +0000 UTC m=+69.219032333" observedRunningTime="2026-05-21 03:20:45.449013269 +0000 UTC m=+69.815233671" watchObservedRunningTime="2026-05-21 03:20:45.449513495 +0000 UTC m=+69.815733888" May 21 03:20:47.221976 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:47.221936 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-registry-tls\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:47.222398 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:47.222057 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 03:20:47.222398 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:47.222069 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55f4779596-ddj98: secret "image-registry-tls" not found May 21 03:20:47.222398 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:47.222121 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-registry-tls podName:76d9e19b-981f-421c-b780-133ab7290c4d nodeName:}" failed. No retries permitted until 2026-05-21 03:20:51.222106721 +0000 UTC m=+75.588327097 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-registry-tls") pod "image-registry-55f4779596-ddj98" (UID: "76d9e19b-981f-421c-b780-133ab7290c4d") : secret "image-registry-tls" not found May 21 03:20:51.252396 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:51.252330 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-registry-tls\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:51.252858 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:51.252484 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 03:20:51.252858 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:51.252499 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55f4779596-ddj98: secret "image-registry-tls" not found May 21 03:20:51.252858 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:51.252553 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-registry-tls podName:76d9e19b-981f-421c-b780-133ab7290c4d nodeName:}" failed. No retries permitted until 2026-05-21 03:20:59.252536165 +0000 UTC m=+83.618756545 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-registry-tls") pod "image-registry-55f4779596-ddj98" (UID: "76d9e19b-981f-421c-b780-133ab7290c4d") : secret "image-registry-tls" not found May 21 03:20:51.687616 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:51.687588 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nm86d_48fa57f3-8bf4-4643-8fda-195ac1776d3c/dns-node-resolver/0.log" May 21 03:20:52.490109 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:52.490080 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4jxvp_cb7a5cdb-9dde-424b-ac12-d08fbe5e86b6/node-ca/0.log" May 21 03:20:59.310903 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:20:59.310777 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-registry-tls\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:20:59.311341 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:59.310927 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 03:20:59.311341 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:59.310946 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55f4779596-ddj98: secret "image-registry-tls" not found May 21 03:20:59.311341 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:20:59.311006 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-registry-tls podName:76d9e19b-981f-421c-b780-133ab7290c4d nodeName:}" failed. No retries permitted until 2026-05-21 03:21:15.310989506 +0000 UTC m=+99.677209881 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-registry-tls") pod "image-registry-55f4779596-ddj98" (UID: "76d9e19b-981f-421c-b780-133ab7290c4d") : secret "image-registry-tls" not found May 21 03:21:13.925511 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:13.925473 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7104e42b-14d4-4928-aba1-83a0361e7a5d-cert\") pod \"ingress-canary-zgc2v\" (UID: \"7104e42b-14d4-4928-aba1-83a0361e7a5d\") " pod="openshift-ingress-canary/ingress-canary-zgc2v" May 21 03:21:13.925511 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:13.925513 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fa912a9-75a7-4abb-9e27-33cb4f27918d-metrics-tls\") pod \"dns-default-s77fp\" (UID: \"9fa912a9-75a7-4abb-9e27-33cb4f27918d\") " pod="openshift-dns/dns-default-s77fp" May 21 03:21:13.927839 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:13.927817 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fa912a9-75a7-4abb-9e27-33cb4f27918d-metrics-tls\") pod \"dns-default-s77fp\" (UID: \"9fa912a9-75a7-4abb-9e27-33cb4f27918d\") " pod="openshift-dns/dns-default-s77fp" May 21 03:21:13.927954 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:13.927870 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7104e42b-14d4-4928-aba1-83a0361e7a5d-cert\") pod \"ingress-canary-zgc2v\" (UID: \"7104e42b-14d4-4928-aba1-83a0361e7a5d\") " pod="openshift-ingress-canary/ingress-canary-zgc2v" May 21 03:21:13.972989 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:13.972956 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-znmrr\"" May 21 03:21:13.981923 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:13.981899 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s77fp" May 21 03:21:13.983815 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:13.983797 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pm6r8\"" May 21 03:21:13.992703 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:13.992681 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zgc2v" May 21 03:21:14.114384 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.114334 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s77fp"] May 21 03:21:14.117561 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:21:14.117531 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fa912a9_75a7_4abb_9e27_33cb4f27918d.slice/crio-53593e685c9c9196be5b586d3db61bea5443eacfb97240761c431056bfe99798 WatchSource:0}: Error finding container 53593e685c9c9196be5b586d3db61bea5443eacfb97240761c431056bfe99798: Status 404 returned error can't find the container with id 53593e685c9c9196be5b586d3db61bea5443eacfb97240761c431056bfe99798 May 21 03:21:14.128178 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.128144 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zgc2v"] May 21 03:21:14.132252 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:21:14.132224 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7104e42b_14d4_4928_aba1_83a0361e7a5d.slice/crio-8e2d779c4116de66e7b81251e310ed7151e2d0207a1a8ccef5abcc1de661e94c WatchSource:0}: Error finding container 8e2d779c4116de66e7b81251e310ed7151e2d0207a1a8ccef5abcc1de661e94c: Status 404 returned error can't find the container with id 8e2d779c4116de66e7b81251e310ed7151e2d0207a1a8ccef5abcc1de661e94c May 21 03:21:14.157727 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.157700 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l92vd"] May 21 03:21:14.167209 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.167186 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l92vd" May 21 03:21:14.170138 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.170110 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d2pfl\"" May 21 03:21:14.170238 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.170200 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 03:21:14.170338 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.170241 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 03:21:14.171126 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.171108 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 03:21:14.171220 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.171171 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 03:21:14.172119 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.172098 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l92vd"] May 21 03:21:14.181152 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.181106 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55f4779596-ddj98"] May 21 03:21:14.181293 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:21:14.181275 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-55f4779596-ddj98" podUID="76d9e19b-981f-421c-b780-133ab7290c4d" May 21 03:21:14.228079 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.228046 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e-crio-socket\") pod \"insights-runtime-extractor-l92vd\" (UID: \"4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e\") " pod="openshift-insights/insights-runtime-extractor-l92vd" May 21 03:21:14.228079 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.228082 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l92vd\" (UID: \"4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e\") " pod="openshift-insights/insights-runtime-extractor-l92vd" May 21 03:21:14.228286 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.228104 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l92vd\" (UID: \"4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e\") " pod="openshift-insights/insights-runtime-extractor-l92vd" May 21 03:21:14.228286 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.228174 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e-data-volume\") pod \"insights-runtime-extractor-l92vd\" (UID: \"4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e\") " pod="openshift-insights/insights-runtime-extractor-l92vd" May 21 03:21:14.228286 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.228211 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v85m\" (UniqueName: \"kubernetes.io/projected/4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e-kube-api-access-7v85m\") pod \"insights-runtime-extractor-l92vd\" (UID: \"4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e\") " pod="openshift-insights/insights-runtime-extractor-l92vd" May 21 03:21:14.328574 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.328536 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e-data-volume\") pod \"insights-runtime-extractor-l92vd\" (UID: \"4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e\") " pod="openshift-insights/insights-runtime-extractor-l92vd" May 21 03:21:14.328790 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.328590 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7v85m\" (UniqueName: \"kubernetes.io/projected/4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e-kube-api-access-7v85m\") pod \"insights-runtime-extractor-l92vd\" (UID: \"4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e\") " pod="openshift-insights/insights-runtime-extractor-l92vd" May 21 03:21:14.328790 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.328641 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e-crio-socket\") pod \"insights-runtime-extractor-l92vd\" (UID: \"4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e\") " pod="openshift-insights/insights-runtime-extractor-l92vd" May 21 03:21:14.328790 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.328671 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l92vd\" (UID: \"4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e\") " pod="openshift-insights/insights-runtime-extractor-l92vd" May 21 03:21:14.328790 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.328697 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l92vd\" (UID: \"4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e\") " pod="openshift-insights/insights-runtime-extractor-l92vd" May 21 03:21:14.328790 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.328775 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e-crio-socket\") pod \"insights-runtime-extractor-l92vd\" (UID: \"4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e\") " pod="openshift-insights/insights-runtime-extractor-l92vd" May 21 03:21:14.329012 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.328981 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e-data-volume\") pod \"insights-runtime-extractor-l92vd\" (UID: \"4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e\") " pod="openshift-insights/insights-runtime-extractor-l92vd" May 21 03:21:14.329203 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.329183 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l92vd\" (UID: \"4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e\") " pod="openshift-insights/insights-runtime-extractor-l92vd" May 21 03:21:14.330948 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.330933 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l92vd\" (UID: \"4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e\") " pod="openshift-insights/insights-runtime-extractor-l92vd" May 21 03:21:14.351055 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.351025 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v85m\" (UniqueName: \"kubernetes.io/projected/4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e-kube-api-access-7v85m\") pod \"insights-runtime-extractor-l92vd\" (UID: \"4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e\") " pod="openshift-insights/insights-runtime-extractor-l92vd" May 21 03:21:14.477275 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.477193 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l92vd" May 21 03:21:14.510313 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.510257 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zgc2v" event={"ID":"7104e42b-14d4-4928-aba1-83a0361e7a5d","Type":"ContainerStarted","Data":"8e2d779c4116de66e7b81251e310ed7151e2d0207a1a8ccef5abcc1de661e94c"} May 21 03:21:14.512269 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.511995 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s77fp" event={"ID":"9fa912a9-75a7-4abb-9e27-33cb4f27918d","Type":"ContainerStarted","Data":"53593e685c9c9196be5b586d3db61bea5443eacfb97240761c431056bfe99798"} May 21 03:21:14.512269 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.512184 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:21:14.517861 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.517804 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:21:14.631160 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.631126 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/76d9e19b-981f-421c-b780-133ab7290c4d-installation-pull-secrets\") pod \"76d9e19b-981f-421c-b780-133ab7290c4d\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " May 21 03:21:14.631333 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.631212 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/76d9e19b-981f-421c-b780-133ab7290c4d-image-registry-private-configuration\") pod \"76d9e19b-981f-421c-b780-133ab7290c4d\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " May 21 03:21:14.631333 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.631263 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/76d9e19b-981f-421c-b780-133ab7290c4d-registry-certificates\") pod \"76d9e19b-981f-421c-b780-133ab7290c4d\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " May 21 03:21:14.631333 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.631295 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-bound-sa-token\") pod \"76d9e19b-981f-421c-b780-133ab7290c4d\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " May 21 03:21:14.631333 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.631327 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/76d9e19b-981f-421c-b780-133ab7290c4d-trusted-ca\") pod \"76d9e19b-981f-421c-b780-133ab7290c4d\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " May 21 03:21:14.631563 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.631367 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lnz5\" (UniqueName: \"kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-kube-api-access-7lnz5\") pod \"76d9e19b-981f-421c-b780-133ab7290c4d\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " May 21 03:21:14.631563 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.631402 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/76d9e19b-981f-421c-b780-133ab7290c4d-ca-trust-extracted\") pod \"76d9e19b-981f-421c-b780-133ab7290c4d\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " May 21 03:21:14.631923 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.631871 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76d9e19b-981f-421c-b780-133ab7290c4d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "76d9e19b-981f-421c-b780-133ab7290c4d" (UID: "76d9e19b-981f-421c-b780-133ab7290c4d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 03:21:14.631923 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.631890 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76d9e19b-981f-421c-b780-133ab7290c4d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "76d9e19b-981f-421c-b780-133ab7290c4d" (UID: "76d9e19b-981f-421c-b780-133ab7290c4d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 03:21:14.632151 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.632106 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76d9e19b-981f-421c-b780-133ab7290c4d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "76d9e19b-981f-421c-b780-133ab7290c4d" (UID: "76d9e19b-981f-421c-b780-133ab7290c4d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:21:14.634466 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.634416 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l92vd"] May 21 03:21:14.634872 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.634843 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "76d9e19b-981f-421c-b780-133ab7290c4d" (UID: "76d9e19b-981f-421c-b780-133ab7290c4d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:21:14.634989 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.634955 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76d9e19b-981f-421c-b780-133ab7290c4d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "76d9e19b-981f-421c-b780-133ab7290c4d" (UID: "76d9e19b-981f-421c-b780-133ab7290c4d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 03:21:14.635137 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.635115 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76d9e19b-981f-421c-b780-133ab7290c4d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "76d9e19b-981f-421c-b780-133ab7290c4d" (UID: "76d9e19b-981f-421c-b780-133ab7290c4d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 03:21:14.635845 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.635807 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-kube-api-access-7lnz5" (OuterVolumeSpecName: "kube-api-access-7lnz5") pod "76d9e19b-981f-421c-b780-133ab7290c4d" (UID: "76d9e19b-981f-421c-b780-133ab7290c4d"). InnerVolumeSpecName "kube-api-access-7lnz5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:21:14.640448 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:21:14.640423 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aa1617e_7d0b_4603_a0c1_9f96bbd3bd2e.slice/crio-296a0713d87c3a7fbf84fcd94b69bf089c705e6726752a069f26a4f6606039f3 WatchSource:0}: Error finding container 296a0713d87c3a7fbf84fcd94b69bf089c705e6726752a069f26a4f6606039f3: Status 404 returned error can't find the container with id 296a0713d87c3a7fbf84fcd94b69bf089c705e6726752a069f26a4f6606039f3 May 21 03:21:14.732149 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.732121 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/76d9e19b-981f-421c-b780-133ab7290c4d-ca-trust-extracted\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:21:14.732277 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.732152 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/76d9e19b-981f-421c-b780-133ab7290c4d-installation-pull-secrets\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:21:14.732277 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.732169 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/76d9e19b-981f-421c-b780-133ab7290c4d-image-registry-private-configuration\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:21:14.732277 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.732184 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/76d9e19b-981f-421c-b780-133ab7290c4d-registry-certificates\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:21:14.732277 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.732199 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-bound-sa-token\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:21:14.732277 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.732214 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/76d9e19b-981f-421c-b780-133ab7290c4d-trusted-ca\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:21:14.732277 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:14.732227 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lnz5\" (UniqueName: \"kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-kube-api-access-7lnz5\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:21:15.337489 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:15.337442 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-registry-tls\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:21:15.339948 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:15.339917 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-registry-tls\") pod \"image-registry-55f4779596-ddj98\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:21:15.438182 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:15.438150 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-registry-tls\") pod \"76d9e19b-981f-421c-b780-133ab7290c4d\" (UID: \"76d9e19b-981f-421c-b780-133ab7290c4d\") " May 21 03:21:15.440029 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:15.439996 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "76d9e19b-981f-421c-b780-133ab7290c4d" (UID: "76d9e19b-981f-421c-b780-133ab7290c4d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:21:15.516397 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:15.516338 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l92vd" event={"ID":"4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e","Type":"ContainerStarted","Data":"d0fcf8a04c54970dd1e47871054934c2b16cbe4d0a15a3a2c3e28fe3df2f0800"} May 21 03:21:15.516582 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:15.516407 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l92vd" event={"ID":"4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e","Type":"ContainerStarted","Data":"296a0713d87c3a7fbf84fcd94b69bf089c705e6726752a069f26a4f6606039f3"} May 21 03:21:15.516582 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:15.516480 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55f4779596-ddj98" May 21 03:21:15.539216 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:15.539180 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76d9e19b-981f-421c-b780-133ab7290c4d-registry-tls\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:21:15.548056 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:15.548027 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55f4779596-ddj98"] May 21 03:21:15.553768 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:15.553106 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-55f4779596-ddj98"] May 21 03:21:16.204620 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:16.204591 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76d9e19b-981f-421c-b780-133ab7290c4d" path="/var/lib/kubelet/pods/76d9e19b-981f-421c-b780-133ab7290c4d/volumes" May 21 03:21:16.443745 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:16.443716 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fqzfs" May 21 03:21:16.521585 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:16.521541 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zgc2v" event={"ID":"7104e42b-14d4-4928-aba1-83a0361e7a5d","Type":"ContainerStarted","Data":"363cf54734aabaae226356cdfc8305f112133d8ba65a6307756daffa1aac7f9e"} May 21 03:21:16.523456 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:16.523424 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s77fp" event={"ID":"9fa912a9-75a7-4abb-9e27-33cb4f27918d","Type":"ContainerStarted","Data":"bc1376909a0d5648219efcceea28bf7ca4be2b7fa6a0de341c3a19a32b6ad3e6"} May 21 03:21:16.523599 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:16.523462 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s77fp" event={"ID":"9fa912a9-75a7-4abb-9e27-33cb4f27918d","Type":"ContainerStarted","Data":"6702a8a3a1f7d627f2453c6b2a4be16123227f68873e74cebb26c0f8c0b4ae30"} May 21 03:21:16.523599 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:16.523549 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s77fp" May 21 03:21:16.525122 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:16.525086 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l92vd" event={"ID":"4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e","Type":"ContainerStarted","Data":"ec13d2a188078e4c66a7805ced16228065297c9df04bb213fa96feee4714eea0"} May 21 03:21:16.536020 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:16.535948 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zgc2v" podStartSLOduration=64.638165096 podStartE2EDuration="1m6.535934281s" podCreationTimestamp="2026-05-21 03:20:10 +0000 UTC" firstStartedPulling="2026-05-21 03:21:14.134091412 +0000 UTC m=+98.500311783" lastFinishedPulling="2026-05-21 03:21:16.03186059 +0000 UTC m=+100.398080968" observedRunningTime="2026-05-21 03:21:16.535441833 +0000 UTC m=+100.901662228" watchObservedRunningTime="2026-05-21 03:21:16.535934281 +0000 UTC m=+100.902154673" May 21 03:21:16.549970 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:16.549923 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-s77fp" podStartSLOduration=64.643534729 podStartE2EDuration="1m6.549910502s" podCreationTimestamp="2026-05-21 03:20:10 +0000 UTC" firstStartedPulling="2026-05-21 03:21:14.119197241 +0000 UTC m=+98.485417611" lastFinishedPulling="2026-05-21 03:21:16.025572999 +0000 UTC m=+100.391793384" observedRunningTime="2026-05-21 03:21:16.549689982 +0000 UTC m=+100.915910377" watchObservedRunningTime="2026-05-21 03:21:16.549910502 +0000 UTC m=+100.916130893" May 21 03:21:17.529198 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:17.529152 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l92vd" event={"ID":"4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e","Type":"ContainerStarted","Data":"0fd24fb5d9116b130f56b4b953a2518a8ffaa97f1ec31f49959c479968770a33"} May 21 03:21:17.545318 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:17.545274 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l92vd" podStartSLOduration=1.012733648 podStartE2EDuration="3.54526054s" podCreationTimestamp="2026-05-21 03:21:14 +0000 UTC" firstStartedPulling="2026-05-21 03:21:14.750138716 +0000 UTC m=+99.116359085" lastFinishedPulling="2026-05-21 03:21:17.282665607 +0000 UTC m=+101.648885977" observedRunningTime="2026-05-21 03:21:17.544720558 +0000 UTC m=+101.910940952" watchObservedRunningTime="2026-05-21 03:21:17.54526054 +0000 UTC m=+101.911480929" May 21 03:21:26.218152 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.218122 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-x46t7"] May 21 03:21:26.220894 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.220878 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-x46t7" May 21 03:21:26.223304 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.223275 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 03:21:26.223453 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.223340 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 21 03:21:26.223453 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.223436 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 03:21:26.224184 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.224164 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 21 03:21:26.224282 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.224215 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 03:21:26.224282 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.224249 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4frgx\"" May 21 03:21:26.230667 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.230645 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-x46t7"] May 21 03:21:26.264851 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.264820 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-krjvk"] May 21 03:21:26.267943 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.267927 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.270233 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.270212 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 03:21:26.270338 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.270268 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 03:21:26.270522 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.270508 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 03:21:26.270580 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.270510 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xgvrr\"" May 21 03:21:26.309670 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.309637 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0895b22b-98f7-4ff6-9959-3d798c15c051-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-x46t7\" (UID: \"0895b22b-98f7-4ff6-9959-3d798c15c051\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x46t7" May 21 03:21:26.309670 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.309670 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4q4x\" (UniqueName: \"kubernetes.io/projected/0895b22b-98f7-4ff6-9959-3d798c15c051-kube-api-access-z4q4x\") pod \"openshift-state-metrics-9c959559f-x46t7\" (UID: \"0895b22b-98f7-4ff6-9959-3d798c15c051\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x46t7" May 21 03:21:26.309876 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.309699 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0895b22b-98f7-4ff6-9959-3d798c15c051-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-x46t7\" (UID: \"0895b22b-98f7-4ff6-9959-3d798c15c051\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x46t7" May 21 03:21:26.309876 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.309774 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0895b22b-98f7-4ff6-9959-3d798c15c051-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-x46t7\" (UID: \"0895b22b-98f7-4ff6-9959-3d798c15c051\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x46t7" May 21 03:21:26.411152 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.411109 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/de94910b-8774-4863-a570-d77fbaec7663-node-exporter-wtmp\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.411152 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.411159 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0895b22b-98f7-4ff6-9959-3d798c15c051-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-x46t7\" (UID: \"0895b22b-98f7-4ff6-9959-3d798c15c051\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x46t7" May 21 03:21:26.411439 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.411176 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/de94910b-8774-4863-a570-d77fbaec7663-root\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.411439 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:21:26.411274 2575 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 21 03:21:26.411439 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.411296 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z4q4x\" (UniqueName: \"kubernetes.io/projected/0895b22b-98f7-4ff6-9959-3d798c15c051-kube-api-access-z4q4x\") pod \"openshift-state-metrics-9c959559f-x46t7\" (UID: \"0895b22b-98f7-4ff6-9959-3d798c15c051\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x46t7" May 21 03:21:26.411439 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:21:26.411340 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0895b22b-98f7-4ff6-9959-3d798c15c051-openshift-state-metrics-tls podName:0895b22b-98f7-4ff6-9959-3d798c15c051 nodeName:}" failed. No retries permitted until 2026-05-21 03:21:26.911320127 +0000 UTC m=+111.277540497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0895b22b-98f7-4ff6-9959-3d798c15c051-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-x46t7" (UID: "0895b22b-98f7-4ff6-9959-3d798c15c051") : secret "openshift-state-metrics-tls" not found May 21 03:21:26.411439 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.411381 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de94910b-8774-4863-a570-d77fbaec7663-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.411439 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.411420 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/de94910b-8774-4863-a570-d77fbaec7663-node-exporter-accelerators-collector-config\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.411439 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.411441 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0895b22b-98f7-4ff6-9959-3d798c15c051-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-x46t7\" (UID: \"0895b22b-98f7-4ff6-9959-3d798c15c051\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x46t7" May 21 03:21:26.411737 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.411458 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de94910b-8774-4863-a570-d77fbaec7663-sys\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.411737 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.411626 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0895b22b-98f7-4ff6-9959-3d798c15c051-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-x46t7\" (UID: \"0895b22b-98f7-4ff6-9959-3d798c15c051\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x46t7" May 21 03:21:26.411737 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.411664 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/de94910b-8774-4863-a570-d77fbaec7663-node-exporter-textfile\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.411737 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.411685 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rqzf\" (UniqueName: \"kubernetes.io/projected/de94910b-8774-4863-a570-d77fbaec7663-kube-api-access-9rqzf\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.411860 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.411741 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de94910b-8774-4863-a570-d77fbaec7663-node-exporter-tls\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.411860 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.411767 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de94910b-8774-4863-a570-d77fbaec7663-metrics-client-ca\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.412047 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.412029 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0895b22b-98f7-4ff6-9959-3d798c15c051-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-x46t7\" (UID: \"0895b22b-98f7-4ff6-9959-3d798c15c051\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x46t7" May 21 03:21:26.414019 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.413998 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0895b22b-98f7-4ff6-9959-3d798c15c051-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-x46t7\" (UID: \"0895b22b-98f7-4ff6-9959-3d798c15c051\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x46t7" May 21 03:21:26.421831 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.421806 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4q4x\" (UniqueName: \"kubernetes.io/projected/0895b22b-98f7-4ff6-9959-3d798c15c051-kube-api-access-z4q4x\") pod \"openshift-state-metrics-9c959559f-x46t7\" (UID: \"0895b22b-98f7-4ff6-9959-3d798c15c051\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x46t7" May 21 03:21:26.512532 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.512441 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/de94910b-8774-4863-a570-d77fbaec7663-node-exporter-accelerators-collector-config\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.512532 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.512480 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de94910b-8774-4863-a570-d77fbaec7663-sys\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.512726 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.512559 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de94910b-8774-4863-a570-d77fbaec7663-sys\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.512726 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.512610 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/de94910b-8774-4863-a570-d77fbaec7663-node-exporter-textfile\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.512726 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.512644 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9rqzf\" (UniqueName: \"kubernetes.io/projected/de94910b-8774-4863-a570-d77fbaec7663-kube-api-access-9rqzf\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.512726 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.512690 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de94910b-8774-4863-a570-d77fbaec7663-node-exporter-tls\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.512726 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.512716 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de94910b-8774-4863-a570-d77fbaec7663-metrics-client-ca\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.512933 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.512746 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/de94910b-8774-4863-a570-d77fbaec7663-node-exporter-wtmp\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.512933 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.512888 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/de94910b-8774-4863-a570-d77fbaec7663-node-exporter-textfile\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.512933 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.512896 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/de94910b-8774-4863-a570-d77fbaec7663-root\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.512933 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.512891 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/de94910b-8774-4863-a570-d77fbaec7663-node-exporter-wtmp\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.513122 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.512942 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de94910b-8774-4863-a570-d77fbaec7663-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.513122 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.513004 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/de94910b-8774-4863-a570-d77fbaec7663-root\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.513122 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.513100 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/de94910b-8774-4863-a570-d77fbaec7663-node-exporter-accelerators-collector-config\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.513268 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.513223 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de94910b-8774-4863-a570-d77fbaec7663-metrics-client-ca\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.515046 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.515021 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de94910b-8774-4863-a570-d77fbaec7663-node-exporter-tls\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.515137 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.515115 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de94910b-8774-4863-a570-d77fbaec7663-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.520404 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.520384 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rqzf\" (UniqueName: \"kubernetes.io/projected/de94910b-8774-4863-a570-d77fbaec7663-kube-api-access-9rqzf\") pod \"node-exporter-krjvk\" (UID: \"de94910b-8774-4863-a570-d77fbaec7663\") " pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.531475 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.531452 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s77fp" May 21 03:21:26.576985 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.576956 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-krjvk" May 21 03:21:26.585116 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:21:26.585087 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde94910b_8774_4863_a570_d77fbaec7663.slice/crio-13fb97eda8be392cbe4b05900a593fb57075042beef4a7084d1b30a1f1dab257 WatchSource:0}: Error finding container 13fb97eda8be392cbe4b05900a593fb57075042beef4a7084d1b30a1f1dab257: Status 404 returned error can't find the container with id 13fb97eda8be392cbe4b05900a593fb57075042beef4a7084d1b30a1f1dab257 May 21 03:21:26.916428 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.916391 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0895b22b-98f7-4ff6-9959-3d798c15c051-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-x46t7\" (UID: \"0895b22b-98f7-4ff6-9959-3d798c15c051\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x46t7" May 21 03:21:26.918741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:26.918721 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0895b22b-98f7-4ff6-9959-3d798c15c051-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-x46t7\" (UID: \"0895b22b-98f7-4ff6-9959-3d798c15c051\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x46t7" May 21 03:21:27.129832 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:27.129799 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-x46t7" May 21 03:21:27.264338 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:27.264308 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-x46t7"] May 21 03:21:27.269661 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:21:27.269633 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0895b22b_98f7_4ff6_9959_3d798c15c051.slice/crio-a340ba0186de244d326be842a04f0164bdc2038898c85db49430435eddfac570 WatchSource:0}: Error finding container a340ba0186de244d326be842a04f0164bdc2038898c85db49430435eddfac570: Status 404 returned error can't find the container with id a340ba0186de244d326be842a04f0164bdc2038898c85db49430435eddfac570 May 21 03:21:27.558288 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:27.558250 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-x46t7" event={"ID":"0895b22b-98f7-4ff6-9959-3d798c15c051","Type":"ContainerStarted","Data":"2598b66312c20493b82972fe3b1dca188a27c28c2180afd19ed51ec45e62fb5a"} May 21 03:21:27.558407 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:27.558300 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-x46t7" event={"ID":"0895b22b-98f7-4ff6-9959-3d798c15c051","Type":"ContainerStarted","Data":"a340ba0186de244d326be842a04f0164bdc2038898c85db49430435eddfac570"} May 21 03:21:27.559296 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:27.559270 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krjvk" event={"ID":"de94910b-8774-4863-a570-d77fbaec7663","Type":"ContainerStarted","Data":"13fb97eda8be392cbe4b05900a593fb57075042beef4a7084d1b30a1f1dab257"} May 21 03:21:28.563837 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:28.563801 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-x46t7" event={"ID":"0895b22b-98f7-4ff6-9959-3d798c15c051","Type":"ContainerStarted","Data":"0cfe7cbfa723551c49c8d946d19b2dbaeb4a5c22830f54549645fc1d348780d9"} May 21 03:21:28.565711 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:28.565680 2575 generic.go:358] "Generic (PLEG): container finished" podID="de94910b-8774-4863-a570-d77fbaec7663" containerID="66e597ef0e9ccc126d8e771040c9f3c4f409830b8e009b68bb2743cc888efce9" exitCode=0 May 21 03:21:28.565835 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:28.565723 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krjvk" event={"ID":"de94910b-8774-4863-a570-d77fbaec7663","Type":"ContainerDied","Data":"66e597ef0e9ccc126d8e771040c9f3c4f409830b8e009b68bb2743cc888efce9"} May 21 03:21:29.569720 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:29.569679 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-x46t7" event={"ID":"0895b22b-98f7-4ff6-9959-3d798c15c051","Type":"ContainerStarted","Data":"0444523057d745c296deb15fa30a50baa48a1ad4937b5e67458a6f774290499d"} May 21 03:21:29.571474 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:29.571452 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krjvk" event={"ID":"de94910b-8774-4863-a570-d77fbaec7663","Type":"ContainerStarted","Data":"f233c830dd1c8c619c280e647d8d06a62569a39c9a0cbead8561ff7c8bb3b0b4"} May 21 03:21:29.571553 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:29.571479 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krjvk" event={"ID":"de94910b-8774-4863-a570-d77fbaec7663","Type":"ContainerStarted","Data":"34b13ae6460f4e7d9b3e2da94250c3d4852199b77b826a6d03712f73bb00ec54"} May 21 03:21:29.586423 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:29.586381 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-x46t7" podStartSLOduration=2.196498632 podStartE2EDuration="3.586346666s" podCreationTimestamp="2026-05-21 03:21:26 +0000 UTC" firstStartedPulling="2026-05-21 03:21:27.592414692 +0000 UTC m=+111.958635062" lastFinishedPulling="2026-05-21 03:21:28.982262721 +0000 UTC m=+113.348483096" observedRunningTime="2026-05-21 03:21:29.585200196 +0000 UTC m=+113.951420587" watchObservedRunningTime="2026-05-21 03:21:29.586346666 +0000 UTC m=+113.952567108" May 21 03:21:29.602505 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:29.602459 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-krjvk" podStartSLOduration=2.65918948 podStartE2EDuration="3.60244586s" podCreationTimestamp="2026-05-21 03:21:26 +0000 UTC" firstStartedPulling="2026-05-21 03:21:26.586642143 +0000 UTC m=+110.952862513" lastFinishedPulling="2026-05-21 03:21:27.52989852 +0000 UTC m=+111.896118893" observedRunningTime="2026-05-21 03:21:29.601831825 +0000 UTC m=+113.968052218" watchObservedRunningTime="2026-05-21 03:21:29.60244586 +0000 UTC m=+113.968666243" May 21 03:21:30.660279 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.660235 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6dc697b889-pvnqw"] May 21 03:21:30.664327 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.664302 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:30.667680 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.667656 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 21 03:21:30.667857 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.667658 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 21 03:21:30.668129 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.667659 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 21 03:21:30.668129 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.667670 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-cz2gk\"" May 21 03:21:30.668129 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.667724 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-50mf00ajq9rsr\"" May 21 03:21:30.668319 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.667747 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 21 03:21:30.669062 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.669042 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6dc697b889-pvnqw"] May 21 03:21:30.749159 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.749124 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/381d1c4a-a099-44e1-95a4-b8a984f53cef-metrics-server-audit-profiles\") pod \"metrics-server-6dc697b889-pvnqw\" (UID: \"381d1c4a-a099-44e1-95a4-b8a984f53cef\") " pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:30.749347 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.749170 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/381d1c4a-a099-44e1-95a4-b8a984f53cef-client-ca-bundle\") pod \"metrics-server-6dc697b889-pvnqw\" (UID: \"381d1c4a-a099-44e1-95a4-b8a984f53cef\") " pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:30.749347 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.749189 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/381d1c4a-a099-44e1-95a4-b8a984f53cef-secret-metrics-server-client-certs\") pod \"metrics-server-6dc697b889-pvnqw\" (UID: \"381d1c4a-a099-44e1-95a4-b8a984f53cef\") " pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:30.749347 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.749214 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcvz5\" (UniqueName: \"kubernetes.io/projected/381d1c4a-a099-44e1-95a4-b8a984f53cef-kube-api-access-xcvz5\") pod \"metrics-server-6dc697b889-pvnqw\" (UID: \"381d1c4a-a099-44e1-95a4-b8a984f53cef\") " pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:30.749347 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.749241 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/381d1c4a-a099-44e1-95a4-b8a984f53cef-audit-log\") pod \"metrics-server-6dc697b889-pvnqw\" (UID: \"381d1c4a-a099-44e1-95a4-b8a984f53cef\") " pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:30.749347 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.749301 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/381d1c4a-a099-44e1-95a4-b8a984f53cef-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6dc697b889-pvnqw\" (UID: \"381d1c4a-a099-44e1-95a4-b8a984f53cef\") " pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:30.749583 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.749373 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/381d1c4a-a099-44e1-95a4-b8a984f53cef-secret-metrics-server-tls\") pod \"metrics-server-6dc697b889-pvnqw\" (UID: \"381d1c4a-a099-44e1-95a4-b8a984f53cef\") " pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:30.849950 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.849918 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/381d1c4a-a099-44e1-95a4-b8a984f53cef-secret-metrics-server-tls\") pod \"metrics-server-6dc697b889-pvnqw\" (UID: \"381d1c4a-a099-44e1-95a4-b8a984f53cef\") " pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:30.850121 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.849966 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/381d1c4a-a099-44e1-95a4-b8a984f53cef-metrics-server-audit-profiles\") pod \"metrics-server-6dc697b889-pvnqw\" (UID: \"381d1c4a-a099-44e1-95a4-b8a984f53cef\") " pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:30.850121 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.849993 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/381d1c4a-a099-44e1-95a4-b8a984f53cef-client-ca-bundle\") pod \"metrics-server-6dc697b889-pvnqw\" (UID: \"381d1c4a-a099-44e1-95a4-b8a984f53cef\") " pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:30.850121 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.850010 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/381d1c4a-a099-44e1-95a4-b8a984f53cef-secret-metrics-server-client-certs\") pod \"metrics-server-6dc697b889-pvnqw\" (UID: \"381d1c4a-a099-44e1-95a4-b8a984f53cef\") " pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:30.850121 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.850027 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xcvz5\" (UniqueName: \"kubernetes.io/projected/381d1c4a-a099-44e1-95a4-b8a984f53cef-kube-api-access-xcvz5\") pod \"metrics-server-6dc697b889-pvnqw\" (UID: \"381d1c4a-a099-44e1-95a4-b8a984f53cef\") " pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:30.850121 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.850057 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/381d1c4a-a099-44e1-95a4-b8a984f53cef-audit-log\") pod \"metrics-server-6dc697b889-pvnqw\" (UID: \"381d1c4a-a099-44e1-95a4-b8a984f53cef\") " pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:30.850121 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.850085 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/381d1c4a-a099-44e1-95a4-b8a984f53cef-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6dc697b889-pvnqw\" (UID: \"381d1c4a-a099-44e1-95a4-b8a984f53cef\") " pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:30.850937 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.850885 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/381d1c4a-a099-44e1-95a4-b8a984f53cef-audit-log\") pod \"metrics-server-6dc697b889-pvnqw\" (UID: \"381d1c4a-a099-44e1-95a4-b8a984f53cef\") " pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:30.851204 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.851180 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/381d1c4a-a099-44e1-95a4-b8a984f53cef-metrics-server-audit-profiles\") pod \"metrics-server-6dc697b889-pvnqw\" (UID: \"381d1c4a-a099-44e1-95a4-b8a984f53cef\") " pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:30.851425 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.851399 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/381d1c4a-a099-44e1-95a4-b8a984f53cef-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6dc697b889-pvnqw\" (UID: \"381d1c4a-a099-44e1-95a4-b8a984f53cef\") " pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:30.853030 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.853009 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/381d1c4a-a099-44e1-95a4-b8a984f53cef-secret-metrics-server-tls\") pod \"metrics-server-6dc697b889-pvnqw\" (UID: \"381d1c4a-a099-44e1-95a4-b8a984f53cef\") " pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:30.853134 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.853045 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/381d1c4a-a099-44e1-95a4-b8a984f53cef-client-ca-bundle\") pod \"metrics-server-6dc697b889-pvnqw\" (UID: \"381d1c4a-a099-44e1-95a4-b8a984f53cef\") " pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:30.853311 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.853287 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/381d1c4a-a099-44e1-95a4-b8a984f53cef-secret-metrics-server-client-certs\") pod \"metrics-server-6dc697b889-pvnqw\" (UID: \"381d1c4a-a099-44e1-95a4-b8a984f53cef\") " pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:30.862161 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.862132 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcvz5\" (UniqueName: \"kubernetes.io/projected/381d1c4a-a099-44e1-95a4-b8a984f53cef-kube-api-access-xcvz5\") pod \"metrics-server-6dc697b889-pvnqw\" (UID: \"381d1c4a-a099-44e1-95a4-b8a984f53cef\") " pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:30.974508 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:30.974417 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:31.015750 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:31.015717 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-kkg5w"] May 21 03:21:31.020533 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:31.020508 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-kkg5w" May 21 03:21:31.022684 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:31.022653 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 21 03:21:31.023147 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:31.022961 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-blcfb\"" May 21 03:21:31.031014 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:31.030993 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-kkg5w"] May 21 03:21:31.103028 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:31.102996 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6dc697b889-pvnqw"] May 21 03:21:31.105616 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:21:31.105586 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod381d1c4a_a099_44e1_95a4_b8a984f53cef.slice/crio-d287acf544ee2eda6e0244365458ca7ccecc968dbfb37195f7830647a1df2b44 WatchSource:0}: Error finding container d287acf544ee2eda6e0244365458ca7ccecc968dbfb37195f7830647a1df2b44: Status 404 returned error can't find the container with id d287acf544ee2eda6e0244365458ca7ccecc968dbfb37195f7830647a1df2b44 May 21 03:21:31.152602 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:31.152561 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2eb98867-cbfc-4f5a-8bdd-5e0e54b89441-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-kkg5w\" (UID: \"2eb98867-cbfc-4f5a-8bdd-5e0e54b89441\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-kkg5w" May 21 03:21:31.253338 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:31.253246 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2eb98867-cbfc-4f5a-8bdd-5e0e54b89441-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-kkg5w\" (UID: \"2eb98867-cbfc-4f5a-8bdd-5e0e54b89441\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-kkg5w" May 21 03:21:31.253501 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:21:31.253434 2575 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 21 03:21:31.253544 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:21:31.253514 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb98867-cbfc-4f5a-8bdd-5e0e54b89441-monitoring-plugin-cert podName:2eb98867-cbfc-4f5a-8bdd-5e0e54b89441 nodeName:}" failed. No retries permitted until 2026-05-21 03:21:31.753498511 +0000 UTC m=+116.119718881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/2eb98867-cbfc-4f5a-8bdd-5e0e54b89441-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-kkg5w" (UID: "2eb98867-cbfc-4f5a-8bdd-5e0e54b89441") : secret "monitoring-plugin-cert" not found May 21 03:21:31.578156 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:31.578111 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" event={"ID":"381d1c4a-a099-44e1-95a4-b8a984f53cef","Type":"ContainerStarted","Data":"d287acf544ee2eda6e0244365458ca7ccecc968dbfb37195f7830647a1df2b44"} May 21 03:21:31.757342 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:31.757300 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2eb98867-cbfc-4f5a-8bdd-5e0e54b89441-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-kkg5w\" (UID: \"2eb98867-cbfc-4f5a-8bdd-5e0e54b89441\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-kkg5w" May 21 03:21:31.760329 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:31.760301 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2eb98867-cbfc-4f5a-8bdd-5e0e54b89441-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-kkg5w\" (UID: \"2eb98867-cbfc-4f5a-8bdd-5e0e54b89441\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-kkg5w" May 21 03:21:31.932835 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:31.932744 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-kkg5w" May 21 03:21:32.068437 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:32.068404 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-kkg5w"] May 21 03:21:32.381720 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:21:32.381688 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eb98867_cbfc_4f5a_8bdd_5e0e54b89441.slice/crio-b70e9261081842b4b67de1613a7a067a754eed733cb6a967973b53562c1e2473 WatchSource:0}: Error finding container b70e9261081842b4b67de1613a7a067a754eed733cb6a967973b53562c1e2473: Status 404 returned error can't find the container with id b70e9261081842b4b67de1613a7a067a754eed733cb6a967973b53562c1e2473 May 21 03:21:32.582092 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:32.582049 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" event={"ID":"381d1c4a-a099-44e1-95a4-b8a984f53cef","Type":"ContainerStarted","Data":"d215e01047bd3af4e526f6ea130a8b4a258c70e6087fdef30cbdabe6f1d70b4a"} May 21 03:21:32.583138 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:32.583096 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-kkg5w" event={"ID":"2eb98867-cbfc-4f5a-8bdd-5e0e54b89441","Type":"ContainerStarted","Data":"b70e9261081842b4b67de1613a7a067a754eed733cb6a967973b53562c1e2473"} May 21 03:21:32.600584 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:32.600542 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" podStartSLOduration=1.2768611939999999 podStartE2EDuration="2.600529505s" podCreationTimestamp="2026-05-21 03:21:30 +0000 UTC" firstStartedPulling="2026-05-21 03:21:31.107485633 +0000 UTC m=+115.473706006" lastFinishedPulling="2026-05-21 03:21:32.431153944 +0000 UTC m=+116.797374317" observedRunningTime="2026-05-21 03:21:32.599038396 +0000 UTC m=+116.965258813" watchObservedRunningTime="2026-05-21 03:21:32.600529505 +0000 UTC m=+116.966749897" May 21 03:21:34.590564 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:34.590522 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-kkg5w" event={"ID":"2eb98867-cbfc-4f5a-8bdd-5e0e54b89441","Type":"ContainerStarted","Data":"af704c248e9cc95efebdf63586a8bdfff2c7b6f71b31f17d1000c6435ef4514f"} May 21 03:21:34.590931 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:34.590754 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-kkg5w" May 21 03:21:34.595809 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:34.595788 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-kkg5w" May 21 03:21:34.607396 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:34.607328 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-kkg5w" podStartSLOduration=2.295249469 podStartE2EDuration="3.607316779s" podCreationTimestamp="2026-05-21 03:21:31 +0000 UTC" firstStartedPulling="2026-05-21 03:21:32.383585165 +0000 UTC m=+116.749805535" lastFinishedPulling="2026-05-21 03:21:33.695652465 +0000 UTC m=+118.061872845" observedRunningTime="2026-05-21 03:21:34.606983127 +0000 UTC m=+118.973203518" watchObservedRunningTime="2026-05-21 03:21:34.607316779 +0000 UTC m=+118.973537168" May 21 03:21:39.297711 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.297668 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f5d679c85-wkqj6"] May 21 03:21:39.302076 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.302053 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:21:39.304707 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.304682 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 21 03:21:39.304848 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.304736 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 21 03:21:39.305602 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.305570 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2gmfm\"" May 21 03:21:39.305694 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.305675 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 21 03:21:39.305812 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.305797 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 21 03:21:39.305869 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.305814 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 21 03:21:39.305869 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.305844 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 21 03:21:39.306109 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.306094 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 21 03:21:39.310519 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.310491 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5d679c85-wkqj6"] May 21 03:21:39.330452 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.330422 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-service-ca\") pod \"console-7f5d679c85-wkqj6\" (UID: \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\") " pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:21:39.330603 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.330463 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-oauth-serving-cert\") pod \"console-7f5d679c85-wkqj6\" (UID: \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\") " pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:21:39.330603 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.330531 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-console-config\") pod \"console-7f5d679c85-wkqj6\" (UID: \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\") " pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:21:39.330603 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.330578 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-console-serving-cert\") pod \"console-7f5d679c85-wkqj6\" (UID: \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\") " pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:21:39.330714 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.330612 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd75f\" (UniqueName: \"kubernetes.io/projected/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-kube-api-access-cd75f\") pod \"console-7f5d679c85-wkqj6\" (UID: \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\") " pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:21:39.330714 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.330646 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-console-oauth-config\") pod \"console-7f5d679c85-wkqj6\" (UID: \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\") " pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:21:39.431155 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.431106 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-console-oauth-config\") pod \"console-7f5d679c85-wkqj6\" (UID: \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\") " pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:21:39.431318 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.431175 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-service-ca\") pod \"console-7f5d679c85-wkqj6\" (UID: \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\") " pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:21:39.431318 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.431205 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-oauth-serving-cert\") pod \"console-7f5d679c85-wkqj6\" (UID: \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\") " pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:21:39.431318 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.431231 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-console-config\") pod \"console-7f5d679c85-wkqj6\" (UID: \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\") " pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:21:39.431318 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.431259 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-console-serving-cert\") pod \"console-7f5d679c85-wkqj6\" (UID: \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\") " pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:21:39.431318 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.431292 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cd75f\" (UniqueName: \"kubernetes.io/projected/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-kube-api-access-cd75f\") pod \"console-7f5d679c85-wkqj6\" (UID: \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\") " pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:21:39.431992 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.431966 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-service-ca\") pod \"console-7f5d679c85-wkqj6\" (UID: \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\") " pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:21:39.431992 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.431979 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-console-config\") pod \"console-7f5d679c85-wkqj6\" (UID: \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\") " pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:21:39.432172 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.432083 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-oauth-serving-cert\") pod \"console-7f5d679c85-wkqj6\" (UID: \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\") " pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:21:39.433657 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.433632 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-console-oauth-config\") pod \"console-7f5d679c85-wkqj6\" (UID: \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\") " pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:21:39.433731 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.433692 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-console-serving-cert\") pod \"console-7f5d679c85-wkqj6\" (UID: \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\") " pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:21:39.438310 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.438278 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd75f\" (UniqueName: \"kubernetes.io/projected/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-kube-api-access-cd75f\") pod \"console-7f5d679c85-wkqj6\" (UID: \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\") " pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:21:39.612109 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.611980 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:21:39.733756 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:39.733723 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5d679c85-wkqj6"] May 21 03:21:39.736841 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:21:39.736811 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9137cba_5271_4a7b_a4f5_be1c325d9b1d.slice/crio-65fb64b11270a81406ed5e2218ccaa20541e0957506112d407520e0d5b2e76fa WatchSource:0}: Error finding container 65fb64b11270a81406ed5e2218ccaa20541e0957506112d407520e0d5b2e76fa: Status 404 returned error can't find the container with id 65fb64b11270a81406ed5e2218ccaa20541e0957506112d407520e0d5b2e76fa May 21 03:21:40.608877 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:40.608823 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5d679c85-wkqj6" event={"ID":"b9137cba-5271-4a7b-a4f5-be1c325d9b1d","Type":"ContainerStarted","Data":"65fb64b11270a81406ed5e2218ccaa20541e0957506112d407520e0d5b2e76fa"} May 21 03:21:43.621887 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:43.621852 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5d679c85-wkqj6" event={"ID":"b9137cba-5271-4a7b-a4f5-be1c325d9b1d","Type":"ContainerStarted","Data":"85387bc05bdb3528699cfca3983f296138874d5a777afb96cc8cbebfa1607dba"} May 21 03:21:43.638933 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:43.638888 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7f5d679c85-wkqj6" podStartSLOduration=1.7698625319999999 podStartE2EDuration="4.638873685s" podCreationTimestamp="2026-05-21 03:21:39 +0000 UTC" firstStartedPulling="2026-05-21 03:21:39.738743349 +0000 UTC m=+124.104963720" lastFinishedPulling="2026-05-21 03:21:42.607754498 +0000 UTC m=+126.973974873" observedRunningTime="2026-05-21 03:21:43.638192395 +0000 UTC m=+128.004412788" watchObservedRunningTime="2026-05-21 03:21:43.638873685 +0000 UTC m=+128.005094078" May 21 03:21:45.981378 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:45.981309 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs\") pod \"network-metrics-daemon-6qc5c\" (UID: \"ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad\") " pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:21:45.983652 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:45.983631 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad-metrics-certs\") pod \"network-metrics-daemon-6qc5c\" (UID: \"ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad\") " pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:21:46.017616 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:46.017581 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rwbqv\"" May 21 03:21:46.026376 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:46.026337 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qc5c" May 21 03:21:46.146741 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:46.146707 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6qc5c"] May 21 03:21:46.149947 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:21:46.149921 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee4cf14f_1a8d_4e34_9530_8d8e5654f0ad.slice/crio-0821f368172eac7e4079b7356e5e5b554253e8217b085872460a6ab6a3392530 WatchSource:0}: Error finding container 0821f368172eac7e4079b7356e5e5b554253e8217b085872460a6ab6a3392530: Status 404 returned error can't find the container with id 0821f368172eac7e4079b7356e5e5b554253e8217b085872460a6ab6a3392530 May 21 03:21:46.631753 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:46.631707 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6qc5c" event={"ID":"ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad","Type":"ContainerStarted","Data":"0821f368172eac7e4079b7356e5e5b554253e8217b085872460a6ab6a3392530"} May 21 03:21:47.636431 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:47.636393 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6qc5c" event={"ID":"ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad","Type":"ContainerStarted","Data":"7d493cb5451fa5e3d83bef030eb5181938386edf6a93a2c5c248218c14d9ea5e"} May 21 03:21:47.636431 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:47.636430 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6qc5c" event={"ID":"ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad","Type":"ContainerStarted","Data":"a721605d8ebf9e7d9750010844837be6eb04e3de9f741eb33e8aa0045ea2af48"} May 21 03:21:47.650990 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:47.650938 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6qc5c" podStartSLOduration=130.677620838 podStartE2EDuration="2m11.650923691s" podCreationTimestamp="2026-05-21 03:19:36 +0000 UTC" firstStartedPulling="2026-05-21 03:21:46.152343685 +0000 UTC m=+130.518564055" lastFinishedPulling="2026-05-21 03:21:47.125646535 +0000 UTC m=+131.491866908" observedRunningTime="2026-05-21 03:21:47.649653015 +0000 UTC m=+132.015873401" watchObservedRunningTime="2026-05-21 03:21:47.650923691 +0000 UTC m=+132.017144095" May 21 03:21:48.003843 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:48.003747 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" podUID="1a6749ad-169f-4375-837b-2f862c01bf7a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 03:21:49.612759 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:49.612717 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:21:49.612759 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:49.612764 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:21:49.617554 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:49.617530 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:21:49.646277 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:49.646253 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:21:50.975376 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:50.975307 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:50.975376 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:50.975388 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:21:54.688757 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:54.688722 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zgc2v_7104e42b-14d4-4928-aba1-83a0361e7a5d/serve-healthcheck-canary/0.log" May 21 03:21:57.255416 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:57.255380 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f5d679c85-wkqj6"] May 21 03:21:58.003407 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:21:58.003368 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" podUID="1a6749ad-169f-4375-837b-2f862c01bf7a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 03:22:08.003873 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:08.003828 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" podUID="1a6749ad-169f-4375-837b-2f862c01bf7a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 03:22:08.004281 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:08.003915 2575 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" May 21 03:22:08.004451 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:08.004419 2575 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"c4368fec7b029816a38d33614f6dabe8ca4f9d9475c688c2d982b0a604874d12"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" containerMessage="Container service-proxy failed liveness probe, will be restarted" May 21 03:22:08.004516 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:08.004471 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" podUID="1a6749ad-169f-4375-837b-2f862c01bf7a" containerName="service-proxy" containerID="cri-o://c4368fec7b029816a38d33614f6dabe8ca4f9d9475c688c2d982b0a604874d12" gracePeriod=30 May 21 03:22:08.694809 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:08.694773 2575 generic.go:358] "Generic (PLEG): container finished" podID="1a6749ad-169f-4375-837b-2f862c01bf7a" containerID="c4368fec7b029816a38d33614f6dabe8ca4f9d9475c688c2d982b0a604874d12" exitCode=2 May 21 03:22:08.694989 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:08.694847 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" event={"ID":"1a6749ad-169f-4375-837b-2f862c01bf7a","Type":"ContainerDied","Data":"c4368fec7b029816a38d33614f6dabe8ca4f9d9475c688c2d982b0a604874d12"} May 21 03:22:08.694989 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:08.694886 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fcccb8ddd-m82dx" event={"ID":"1a6749ad-169f-4375-837b-2f862c01bf7a","Type":"ContainerStarted","Data":"a5edf6c1172289884e9ca4636edfdbf036fe97a9a5fd0486b9166c5b3ad57af1"} May 21 03:22:10.979972 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:10.979938 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:22:10.983996 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:10.983969 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6dc697b889-pvnqw" May 21 03:22:22.275616 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.275573 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7f5d679c85-wkqj6" podUID="b9137cba-5271-4a7b-a4f5-be1c325d9b1d" containerName="console" containerID="cri-o://85387bc05bdb3528699cfca3983f296138874d5a777afb96cc8cbebfa1607dba" gracePeriod=15 May 21 03:22:22.518798 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.518774 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f5d679c85-wkqj6_b9137cba-5271-4a7b-a4f5-be1c325d9b1d/console/0.log" May 21 03:22:22.518930 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.518835 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:22:22.663495 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.663441 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-console-oauth-config\") pod \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\" (UID: \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\") " May 21 03:22:22.663495 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.663503 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-console-config\") pod \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\" (UID: \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\") " May 21 03:22:22.663722 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.663573 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cd75f\" (UniqueName: \"kubernetes.io/projected/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-kube-api-access-cd75f\") pod \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\" (UID: \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\") " May 21 03:22:22.663722 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.663596 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-oauth-serving-cert\") pod \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\" (UID: \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\") " May 21 03:22:22.663722 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.663615 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-service-ca\") pod \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\" (UID: \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\") " May 21 03:22:22.663722 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.663652 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-console-serving-cert\") pod \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\" (UID: \"b9137cba-5271-4a7b-a4f5-be1c325d9b1d\") " May 21 03:22:22.664000 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.663974 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-console-config" (OuterVolumeSpecName: "console-config") pod "b9137cba-5271-4a7b-a4f5-be1c325d9b1d" (UID: "b9137cba-5271-4a7b-a4f5-be1c325d9b1d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 03:22:22.664121 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.664016 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-service-ca" (OuterVolumeSpecName: "service-ca") pod "b9137cba-5271-4a7b-a4f5-be1c325d9b1d" (UID: "b9137cba-5271-4a7b-a4f5-be1c325d9b1d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 03:22:22.664121 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.664023 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b9137cba-5271-4a7b-a4f5-be1c325d9b1d" (UID: "b9137cba-5271-4a7b-a4f5-be1c325d9b1d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 03:22:22.665879 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.665848 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b9137cba-5271-4a7b-a4f5-be1c325d9b1d" (UID: "b9137cba-5271-4a7b-a4f5-be1c325d9b1d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 03:22:22.665879 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.665850 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-kube-api-access-cd75f" (OuterVolumeSpecName: "kube-api-access-cd75f") pod "b9137cba-5271-4a7b-a4f5-be1c325d9b1d" (UID: "b9137cba-5271-4a7b-a4f5-be1c325d9b1d"). InnerVolumeSpecName "kube-api-access-cd75f". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:22:22.666014 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.665931 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b9137cba-5271-4a7b-a4f5-be1c325d9b1d" (UID: "b9137cba-5271-4a7b-a4f5-be1c325d9b1d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 03:22:22.735446 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.735416 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f5d679c85-wkqj6_b9137cba-5271-4a7b-a4f5-be1c325d9b1d/console/0.log" May 21 03:22:22.735642 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.735457 2575 generic.go:358] "Generic (PLEG): container finished" podID="b9137cba-5271-4a7b-a4f5-be1c325d9b1d" containerID="85387bc05bdb3528699cfca3983f296138874d5a777afb96cc8cbebfa1607dba" exitCode=2 May 21 03:22:22.735642 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.735490 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5d679c85-wkqj6" event={"ID":"b9137cba-5271-4a7b-a4f5-be1c325d9b1d","Type":"ContainerDied","Data":"85387bc05bdb3528699cfca3983f296138874d5a777afb96cc8cbebfa1607dba"} May 21 03:22:22.735642 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.735530 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5d679c85-wkqj6" event={"ID":"b9137cba-5271-4a7b-a4f5-be1c325d9b1d","Type":"ContainerDied","Data":"65fb64b11270a81406ed5e2218ccaa20541e0957506112d407520e0d5b2e76fa"} May 21 03:22:22.735642 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.735538 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5d679c85-wkqj6" May 21 03:22:22.735845 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.735545 2575 scope.go:117] "RemoveContainer" containerID="85387bc05bdb3528699cfca3983f296138874d5a777afb96cc8cbebfa1607dba" May 21 03:22:22.744149 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.744130 2575 scope.go:117] "RemoveContainer" containerID="85387bc05bdb3528699cfca3983f296138874d5a777afb96cc8cbebfa1607dba" May 21 03:22:22.744667 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:22:22.744639 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85387bc05bdb3528699cfca3983f296138874d5a777afb96cc8cbebfa1607dba\": container with ID starting with 85387bc05bdb3528699cfca3983f296138874d5a777afb96cc8cbebfa1607dba not found: ID does not exist" containerID="85387bc05bdb3528699cfca3983f296138874d5a777afb96cc8cbebfa1607dba" May 21 03:22:22.744740 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.744680 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85387bc05bdb3528699cfca3983f296138874d5a777afb96cc8cbebfa1607dba"} err="failed to get container status \"85387bc05bdb3528699cfca3983f296138874d5a777afb96cc8cbebfa1607dba\": rpc error: code = NotFound desc = could not find container \"85387bc05bdb3528699cfca3983f296138874d5a777afb96cc8cbebfa1607dba\": container with ID starting with 85387bc05bdb3528699cfca3983f296138874d5a777afb96cc8cbebfa1607dba not found: ID does not exist" May 21 03:22:22.756648 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.756616 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f5d679c85-wkqj6"] May 21 03:22:22.760425 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.759927 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f5d679c85-wkqj6"] May 21 03:22:22.765018 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.764996 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cd75f\" (UniqueName: \"kubernetes.io/projected/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-kube-api-access-cd75f\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:22:22.765018 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.765018 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-oauth-serving-cert\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:22:22.765150 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.765031 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-service-ca\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:22:22.765150 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.765040 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-console-serving-cert\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:22:22.765150 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.765049 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-console-oauth-config\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:22:22.765150 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:22.765057 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9137cba-5271-4a7b-a4f5-be1c325d9b1d-console-config\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:22:24.204596 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:22:24.204561 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9137cba-5271-4a7b-a4f5-be1c325d9b1d" path="/var/lib/kubelet/pods/b9137cba-5271-4a7b-a4f5-be1c325d9b1d/volumes" May 21 03:23:05.791907 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.791868 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-56cbc6997d-9d5kd"] May 21 03:23:05.792414 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.792132 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9137cba-5271-4a7b-a4f5-be1c325d9b1d" containerName="console" May 21 03:23:05.792414 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.792147 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9137cba-5271-4a7b-a4f5-be1c325d9b1d" containerName="console" May 21 03:23:05.792414 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.792188 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="b9137cba-5271-4a7b-a4f5-be1c325d9b1d" containerName="console" May 21 03:23:05.794962 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.794946 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:05.798226 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.798199 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 21 03:23:05.798384 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.798198 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 21 03:23:05.798384 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.798316 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 21 03:23:05.798495 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.798380 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2gmfm\"" May 21 03:23:05.798557 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.798543 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 21 03:23:05.798683 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.798662 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 21 03:23:05.798683 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.798680 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 21 03:23:05.798841 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.798663 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 21 03:23:05.807163 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.807139 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 21 03:23:05.807339 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.807320 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56cbc6997d-9d5kd"] May 21 03:23:05.872679 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.872644 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/319656d7-e054-4e29-aa1a-b0c6b595d671-oauth-serving-cert\") pod \"console-56cbc6997d-9d5kd\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:05.872679 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.872679 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/319656d7-e054-4e29-aa1a-b0c6b595d671-console-serving-cert\") pod \"console-56cbc6997d-9d5kd\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:05.872909 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.872700 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/319656d7-e054-4e29-aa1a-b0c6b595d671-service-ca\") pod \"console-56cbc6997d-9d5kd\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:05.872909 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.872722 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt4sx\" (UniqueName: \"kubernetes.io/projected/319656d7-e054-4e29-aa1a-b0c6b595d671-kube-api-access-pt4sx\") pod \"console-56cbc6997d-9d5kd\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:05.872909 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.872795 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/319656d7-e054-4e29-aa1a-b0c6b595d671-console-oauth-config\") pod \"console-56cbc6997d-9d5kd\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:05.872909 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.872825 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/319656d7-e054-4e29-aa1a-b0c6b595d671-console-config\") pod \"console-56cbc6997d-9d5kd\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:05.872909 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.872845 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/319656d7-e054-4e29-aa1a-b0c6b595d671-trusted-ca-bundle\") pod \"console-56cbc6997d-9d5kd\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:05.974206 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.974166 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pt4sx\" (UniqueName: \"kubernetes.io/projected/319656d7-e054-4e29-aa1a-b0c6b595d671-kube-api-access-pt4sx\") pod \"console-56cbc6997d-9d5kd\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:05.974434 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.974218 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/319656d7-e054-4e29-aa1a-b0c6b595d671-console-oauth-config\") pod \"console-56cbc6997d-9d5kd\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:05.974434 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.974237 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/319656d7-e054-4e29-aa1a-b0c6b595d671-console-config\") pod \"console-56cbc6997d-9d5kd\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:05.974434 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.974254 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/319656d7-e054-4e29-aa1a-b0c6b595d671-trusted-ca-bundle\") pod \"console-56cbc6997d-9d5kd\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:05.974434 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.974292 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/319656d7-e054-4e29-aa1a-b0c6b595d671-oauth-serving-cert\") pod \"console-56cbc6997d-9d5kd\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:05.974434 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.974310 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/319656d7-e054-4e29-aa1a-b0c6b595d671-console-serving-cert\") pod \"console-56cbc6997d-9d5kd\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:05.974706 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.974573 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/319656d7-e054-4e29-aa1a-b0c6b595d671-service-ca\") pod \"console-56cbc6997d-9d5kd\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:05.975052 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.975028 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/319656d7-e054-4e29-aa1a-b0c6b595d671-oauth-serving-cert\") pod \"console-56cbc6997d-9d5kd\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:05.975191 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.975157 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/319656d7-e054-4e29-aa1a-b0c6b595d671-console-config\") pod \"console-56cbc6997d-9d5kd\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:05.975291 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.975271 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/319656d7-e054-4e29-aa1a-b0c6b595d671-trusted-ca-bundle\") pod \"console-56cbc6997d-9d5kd\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:05.975343 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.975308 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/319656d7-e054-4e29-aa1a-b0c6b595d671-service-ca\") pod \"console-56cbc6997d-9d5kd\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:05.976817 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.976792 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/319656d7-e054-4e29-aa1a-b0c6b595d671-console-serving-cert\") pod \"console-56cbc6997d-9d5kd\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:05.976904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.976830 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/319656d7-e054-4e29-aa1a-b0c6b595d671-console-oauth-config\") pod \"console-56cbc6997d-9d5kd\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:05.982569 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:05.982547 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt4sx\" (UniqueName: \"kubernetes.io/projected/319656d7-e054-4e29-aa1a-b0c6b595d671-kube-api-access-pt4sx\") pod \"console-56cbc6997d-9d5kd\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:06.108885 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:06.108793 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:06.238729 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:06.238708 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56cbc6997d-9d5kd"] May 21 03:23:06.241275 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:23:06.241243 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod319656d7_e054_4e29_aa1a_b0c6b595d671.slice/crio-238378336c92cade1e06ac1081ef888de662b4ef7e9c3d08c6d177815b4cf45e WatchSource:0}: Error finding container 238378336c92cade1e06ac1081ef888de662b4ef7e9c3d08c6d177815b4cf45e: Status 404 returned error can't find the container with id 238378336c92cade1e06ac1081ef888de662b4ef7e9c3d08c6d177815b4cf45e May 21 03:23:06.856250 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:06.856212 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56cbc6997d-9d5kd" event={"ID":"319656d7-e054-4e29-aa1a-b0c6b595d671","Type":"ContainerStarted","Data":"2c5f6a5fbc160634101659e97cbc20f5ad996acfdb33b5638125f243f7dd394c"} May 21 03:23:06.856250 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:06.856248 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56cbc6997d-9d5kd" event={"ID":"319656d7-e054-4e29-aa1a-b0c6b595d671","Type":"ContainerStarted","Data":"238378336c92cade1e06ac1081ef888de662b4ef7e9c3d08c6d177815b4cf45e"} May 21 03:23:06.872840 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:06.872788 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-56cbc6997d-9d5kd" podStartSLOduration=1.872772315 podStartE2EDuration="1.872772315s" podCreationTimestamp="2026-05-21 03:23:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:23:06.87112093 +0000 UTC m=+211.237341313" watchObservedRunningTime="2026-05-21 03:23:06.872772315 +0000 UTC m=+211.238992707" May 21 03:23:16.109554 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:16.109508 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:16.109990 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:16.109571 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:16.114395 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:16.114371 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:16.887861 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:16.887832 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:23:18.470408 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:18.470365 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx"] May 21 03:23:18.474636 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:18.474616 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx" May 21 03:23:18.476803 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:18.476782 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 03:23:18.476803 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:18.476794 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4jmgw\"" May 21 03:23:18.477609 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:18.477570 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 03:23:18.481252 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:18.481228 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx"] May 21 03:23:18.573779 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:18.573737 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e21337bb-5f3d-4050-b989-e28d4b1df820-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx\" (UID: \"e21337bb-5f3d-4050-b989-e28d4b1df820\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx" May 21 03:23:18.573968 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:18.573806 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e21337bb-5f3d-4050-b989-e28d4b1df820-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx\" (UID: \"e21337bb-5f3d-4050-b989-e28d4b1df820\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx" May 21 03:23:18.573968 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:18.573840 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6r7g\" (UniqueName: \"kubernetes.io/projected/e21337bb-5f3d-4050-b989-e28d4b1df820-kube-api-access-g6r7g\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx\" (UID: \"e21337bb-5f3d-4050-b989-e28d4b1df820\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx" May 21 03:23:18.675134 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:18.675076 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e21337bb-5f3d-4050-b989-e28d4b1df820-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx\" (UID: \"e21337bb-5f3d-4050-b989-e28d4b1df820\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx" May 21 03:23:18.675134 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:18.675141 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g6r7g\" (UniqueName: \"kubernetes.io/projected/e21337bb-5f3d-4050-b989-e28d4b1df820-kube-api-access-g6r7g\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx\" (UID: \"e21337bb-5f3d-4050-b989-e28d4b1df820\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx" May 21 03:23:18.675405 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:18.675201 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e21337bb-5f3d-4050-b989-e28d4b1df820-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx\" (UID: \"e21337bb-5f3d-4050-b989-e28d4b1df820\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx" May 21 03:23:18.675598 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:18.675574 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e21337bb-5f3d-4050-b989-e28d4b1df820-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx\" (UID: \"e21337bb-5f3d-4050-b989-e28d4b1df820\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx" May 21 03:23:18.675668 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:18.675611 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e21337bb-5f3d-4050-b989-e28d4b1df820-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx\" (UID: \"e21337bb-5f3d-4050-b989-e28d4b1df820\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx" May 21 03:23:18.683911 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:18.683888 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6r7g\" (UniqueName: \"kubernetes.io/projected/e21337bb-5f3d-4050-b989-e28d4b1df820-kube-api-access-g6r7g\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx\" (UID: \"e21337bb-5f3d-4050-b989-e28d4b1df820\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx" May 21 03:23:18.784883 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:18.784850 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx" May 21 03:23:18.920048 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:18.920014 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx"] May 21 03:23:18.923108 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:23:18.923080 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode21337bb_5f3d_4050_b989_e28d4b1df820.slice/crio-e31a9acbca97ae314ef30651619ed89746a110a642a57e4a1daf26dae495615e WatchSource:0}: Error finding container e31a9acbca97ae314ef30651619ed89746a110a642a57e4a1daf26dae495615e: Status 404 returned error can't find the container with id e31a9acbca97ae314ef30651619ed89746a110a642a57e4a1daf26dae495615e May 21 03:23:19.893968 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:19.893928 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx" event={"ID":"e21337bb-5f3d-4050-b989-e28d4b1df820","Type":"ContainerStarted","Data":"e31a9acbca97ae314ef30651619ed89746a110a642a57e4a1daf26dae495615e"} May 21 03:23:24.909690 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:24.909654 2575 generic.go:358] "Generic (PLEG): container finished" podID="e21337bb-5f3d-4050-b989-e28d4b1df820" containerID="a8437b5455da4b4b7f0235ff8149054a59ef66ba9f2303f8733ae092234b33c4" exitCode=0 May 21 03:23:24.910085 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:24.909712 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx" event={"ID":"e21337bb-5f3d-4050-b989-e28d4b1df820","Type":"ContainerDied","Data":"a8437b5455da4b4b7f0235ff8149054a59ef66ba9f2303f8733ae092234b33c4"} May 21 03:23:25.913919 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:25.913821 2575 generic.go:358] "Generic (PLEG): container finished" podID="e21337bb-5f3d-4050-b989-e28d4b1df820" containerID="b3bc5a8f14d910e2caa08a2a79cb65c0462d97db2bff39f1ca3ed2885f7a1a0b" exitCode=0 May 21 03:23:25.913919 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:25.913905 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx" event={"ID":"e21337bb-5f3d-4050-b989-e28d4b1df820","Type":"ContainerDied","Data":"b3bc5a8f14d910e2caa08a2a79cb65c0462d97db2bff39f1ca3ed2885f7a1a0b"} May 21 03:23:32.936922 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:32.936886 2575 generic.go:358] "Generic (PLEG): container finished" podID="e21337bb-5f3d-4050-b989-e28d4b1df820" containerID="f2b55588dcd2d82f94b87014c489c48a4ff29f50dda7e8a54b65659803257f11" exitCode=0 May 21 03:23:32.937425 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:32.936952 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx" event={"ID":"e21337bb-5f3d-4050-b989-e28d4b1df820","Type":"ContainerDied","Data":"f2b55588dcd2d82f94b87014c489c48a4ff29f50dda7e8a54b65659803257f11"} May 21 03:23:34.058930 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:34.058906 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx" May 21 03:23:34.200415 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:34.200293 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e21337bb-5f3d-4050-b989-e28d4b1df820-util\") pod \"e21337bb-5f3d-4050-b989-e28d4b1df820\" (UID: \"e21337bb-5f3d-4050-b989-e28d4b1df820\") " May 21 03:23:34.200415 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:34.200374 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6r7g\" (UniqueName: \"kubernetes.io/projected/e21337bb-5f3d-4050-b989-e28d4b1df820-kube-api-access-g6r7g\") pod \"e21337bb-5f3d-4050-b989-e28d4b1df820\" (UID: \"e21337bb-5f3d-4050-b989-e28d4b1df820\") " May 21 03:23:34.200415 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:34.200418 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e21337bb-5f3d-4050-b989-e28d4b1df820-bundle\") pod \"e21337bb-5f3d-4050-b989-e28d4b1df820\" (UID: \"e21337bb-5f3d-4050-b989-e28d4b1df820\") " May 21 03:23:34.201334 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:34.201301 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e21337bb-5f3d-4050-b989-e28d4b1df820-bundle" (OuterVolumeSpecName: "bundle") pod "e21337bb-5f3d-4050-b989-e28d4b1df820" (UID: "e21337bb-5f3d-4050-b989-e28d4b1df820"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:23:34.202652 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:34.202625 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e21337bb-5f3d-4050-b989-e28d4b1df820-kube-api-access-g6r7g" (OuterVolumeSpecName: "kube-api-access-g6r7g") pod "e21337bb-5f3d-4050-b989-e28d4b1df820" (UID: "e21337bb-5f3d-4050-b989-e28d4b1df820"). InnerVolumeSpecName "kube-api-access-g6r7g". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:23:34.205255 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:34.205225 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e21337bb-5f3d-4050-b989-e28d4b1df820-util" (OuterVolumeSpecName: "util") pod "e21337bb-5f3d-4050-b989-e28d4b1df820" (UID: "e21337bb-5f3d-4050-b989-e28d4b1df820"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:23:34.301320 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:34.301275 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6r7g\" (UniqueName: \"kubernetes.io/projected/e21337bb-5f3d-4050-b989-e28d4b1df820-kube-api-access-g6r7g\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:23:34.301320 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:34.301316 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e21337bb-5f3d-4050-b989-e28d4b1df820-bundle\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:23:34.301320 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:34.301330 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e21337bb-5f3d-4050-b989-e28d4b1df820-util\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:23:34.943229 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:34.943201 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx" May 21 03:23:34.943427 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:34.943191 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19djl8tx" event={"ID":"e21337bb-5f3d-4050-b989-e28d4b1df820","Type":"ContainerDied","Data":"e31a9acbca97ae314ef30651619ed89746a110a642a57e4a1daf26dae495615e"} May 21 03:23:34.943427 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:34.943314 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e31a9acbca97ae314ef30651619ed89746a110a642a57e4a1daf26dae495615e" May 21 03:23:41.333281 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:41.333247 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-bjx5l"] May 21 03:23:41.333704 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:41.333527 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e21337bb-5f3d-4050-b989-e28d4b1df820" containerName="util" May 21 03:23:41.333704 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:41.333541 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e21337bb-5f3d-4050-b989-e28d4b1df820" containerName="util" May 21 03:23:41.333704 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:41.333553 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e21337bb-5f3d-4050-b989-e28d4b1df820" containerName="pull" May 21 03:23:41.333704 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:41.333559 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e21337bb-5f3d-4050-b989-e28d4b1df820" containerName="pull" May 21 03:23:41.333704 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:41.333567 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e21337bb-5f3d-4050-b989-e28d4b1df820" containerName="extract" May 21 03:23:41.333704 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:41.333573 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e21337bb-5f3d-4050-b989-e28d4b1df820" containerName="extract" May 21 03:23:41.333704 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:41.333618 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="e21337bb-5f3d-4050-b989-e28d4b1df820" containerName="extract" May 21 03:23:41.336270 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:41.336252 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-bjx5l" May 21 03:23:41.338362 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:41.338333 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 21 03:23:41.338517 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:41.338380 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-xvvqt\"" May 21 03:23:41.338517 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:41.338405 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 21 03:23:41.347288 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:41.347265 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-bjx5l"] May 21 03:23:41.454621 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:41.454580 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq6ps\" (UniqueName: \"kubernetes.io/projected/5dd97810-316a-457e-813a-4c4934a88241-kube-api-access-qq6ps\") pod \"cert-manager-operator-controller-manager-54b9655956-bjx5l\" (UID: \"5dd97810-316a-457e-813a-4c4934a88241\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-bjx5l" May 21 03:23:41.454805 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:41.454637 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5dd97810-316a-457e-813a-4c4934a88241-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-bjx5l\" (UID: \"5dd97810-316a-457e-813a-4c4934a88241\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-bjx5l" May 21 03:23:41.555980 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:41.555942 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qq6ps\" (UniqueName: \"kubernetes.io/projected/5dd97810-316a-457e-813a-4c4934a88241-kube-api-access-qq6ps\") pod \"cert-manager-operator-controller-manager-54b9655956-bjx5l\" (UID: \"5dd97810-316a-457e-813a-4c4934a88241\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-bjx5l" May 21 03:23:41.556139 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:41.555991 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5dd97810-316a-457e-813a-4c4934a88241-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-bjx5l\" (UID: \"5dd97810-316a-457e-813a-4c4934a88241\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-bjx5l" May 21 03:23:41.556316 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:41.556299 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5dd97810-316a-457e-813a-4c4934a88241-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-bjx5l\" (UID: \"5dd97810-316a-457e-813a-4c4934a88241\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-bjx5l" May 21 03:23:41.567300 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:41.567264 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq6ps\" (UniqueName: \"kubernetes.io/projected/5dd97810-316a-457e-813a-4c4934a88241-kube-api-access-qq6ps\") pod \"cert-manager-operator-controller-manager-54b9655956-bjx5l\" (UID: \"5dd97810-316a-457e-813a-4c4934a88241\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-bjx5l" May 21 03:23:41.645425 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:41.645294 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-bjx5l" May 21 03:23:41.773547 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:41.773516 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-bjx5l"] May 21 03:23:41.776921 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:23:41.776892 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dd97810_316a_457e_813a_4c4934a88241.slice/crio-ddf0369448774c99a9da93347ce78465e129818799defa189727b45f05016ad7 WatchSource:0}: Error finding container ddf0369448774c99a9da93347ce78465e129818799defa189727b45f05016ad7: Status 404 returned error can't find the container with id ddf0369448774c99a9da93347ce78465e129818799defa189727b45f05016ad7 May 21 03:23:41.965462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:41.965376 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-bjx5l" event={"ID":"5dd97810-316a-457e-813a-4c4934a88241","Type":"ContainerStarted","Data":"ddf0369448774c99a9da93347ce78465e129818799defa189727b45f05016ad7"} May 21 03:23:43.974275 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:43.974227 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-bjx5l" event={"ID":"5dd97810-316a-457e-813a-4c4934a88241","Type":"ContainerStarted","Data":"a8160e29d3c0d659666f25e41de0eaa7391112fd5bc7bf5da7979c12074c7dbd"} May 21 03:23:43.994640 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:43.994581 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-bjx5l" podStartSLOduration=1.299560163 podStartE2EDuration="2.994563116s" podCreationTimestamp="2026-05-21 03:23:41 +0000 UTC" firstStartedPulling="2026-05-21 03:23:41.779231727 +0000 UTC m=+246.145452096" lastFinishedPulling="2026-05-21 03:23:43.474234675 +0000 UTC m=+247.840455049" observedRunningTime="2026-05-21 03:23:43.993075581 +0000 UTC m=+248.359295974" watchObservedRunningTime="2026-05-21 03:23:43.994563116 +0000 UTC m=+248.360783509" May 21 03:23:45.480253 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:45.480216 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw"] May 21 03:23:45.482514 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:45.482494 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw" May 21 03:23:45.484798 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:45.484776 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 03:23:45.484798 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:45.484777 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4jmgw\"" May 21 03:23:45.485535 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:45.485516 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 03:23:45.489722 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:45.489701 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw"] May 21 03:23:45.589063 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:45.589019 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4930f835-c3b3-4481-b200-4a65964e81a6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw\" (UID: \"4930f835-c3b3-4481-b200-4a65964e81a6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw" May 21 03:23:45.589247 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:45.589080 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4930f835-c3b3-4481-b200-4a65964e81a6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw\" (UID: \"4930f835-c3b3-4481-b200-4a65964e81a6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw" May 21 03:23:45.589247 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:45.589099 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxssg\" (UniqueName: \"kubernetes.io/projected/4930f835-c3b3-4481-b200-4a65964e81a6-kube-api-access-hxssg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw\" (UID: \"4930f835-c3b3-4481-b200-4a65964e81a6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw" May 21 03:23:45.689725 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:45.689681 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4930f835-c3b3-4481-b200-4a65964e81a6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw\" (UID: \"4930f835-c3b3-4481-b200-4a65964e81a6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw" May 21 03:23:45.689725 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:45.689723 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hxssg\" (UniqueName: \"kubernetes.io/projected/4930f835-c3b3-4481-b200-4a65964e81a6-kube-api-access-hxssg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw\" (UID: \"4930f835-c3b3-4481-b200-4a65964e81a6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw" May 21 03:23:45.689978 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:45.689772 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4930f835-c3b3-4481-b200-4a65964e81a6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw\" (UID: \"4930f835-c3b3-4481-b200-4a65964e81a6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw" May 21 03:23:45.690118 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:45.690095 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4930f835-c3b3-4481-b200-4a65964e81a6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw\" (UID: \"4930f835-c3b3-4481-b200-4a65964e81a6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw" May 21 03:23:45.690202 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:45.690102 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4930f835-c3b3-4481-b200-4a65964e81a6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw\" (UID: \"4930f835-c3b3-4481-b200-4a65964e81a6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw" May 21 03:23:45.697651 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:45.697617 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxssg\" (UniqueName: \"kubernetes.io/projected/4930f835-c3b3-4481-b200-4a65964e81a6-kube-api-access-hxssg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw\" (UID: \"4930f835-c3b3-4481-b200-4a65964e81a6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw" May 21 03:23:45.792011 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:45.791983 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw" May 21 03:23:45.918031 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:45.917972 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw"] May 21 03:23:45.920859 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:23:45.920832 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4930f835_c3b3_4481_b200_4a65964e81a6.slice/crio-6b632b504ae9a1b43d18573b7e88c257ec05cd9c3b6b837331a821ca023d024b WatchSource:0}: Error finding container 6b632b504ae9a1b43d18573b7e88c257ec05cd9c3b6b837331a821ca023d024b: Status 404 returned error can't find the container with id 6b632b504ae9a1b43d18573b7e88c257ec05cd9c3b6b837331a821ca023d024b May 21 03:23:45.981729 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:45.981701 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw" event={"ID":"4930f835-c3b3-4481-b200-4a65964e81a6","Type":"ContainerStarted","Data":"b5097f2ed7de948140fbfe2e840fa472689c6f53471e0163fff73dadbe9f150f"} May 21 03:23:45.981845 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:45.981735 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw" event={"ID":"4930f835-c3b3-4481-b200-4a65964e81a6","Type":"ContainerStarted","Data":"6b632b504ae9a1b43d18573b7e88c257ec05cd9c3b6b837331a821ca023d024b"} May 21 03:23:46.985856 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:46.985765 2575 generic.go:358] "Generic (PLEG): container finished" podID="4930f835-c3b3-4481-b200-4a65964e81a6" containerID="b5097f2ed7de948140fbfe2e840fa472689c6f53471e0163fff73dadbe9f150f" exitCode=0 May 21 03:23:46.985856 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:46.985837 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw" event={"ID":"4930f835-c3b3-4481-b200-4a65964e81a6","Type":"ContainerDied","Data":"b5097f2ed7de948140fbfe2e840fa472689c6f53471e0163fff73dadbe9f150f"} May 21 03:23:49.997281 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:49.997242 2575 generic.go:358] "Generic (PLEG): container finished" podID="4930f835-c3b3-4481-b200-4a65964e81a6" containerID="f6f1043e7b3ff39cdb7a40aa0fdd152e4fc6158f9c6f258d1a9c0d5b3339cad3" exitCode=0 May 21 03:23:49.997685 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:49.997299 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw" event={"ID":"4930f835-c3b3-4481-b200-4a65964e81a6","Type":"ContainerDied","Data":"f6f1043e7b3ff39cdb7a40aa0fdd152e4fc6158f9c6f258d1a9c0d5b3339cad3"} May 21 03:23:51.002056 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:51.002015 2575 generic.go:358] "Generic (PLEG): container finished" podID="4930f835-c3b3-4481-b200-4a65964e81a6" containerID="f969c2d3c0895390da30f606524f87c584bb041c507bacaa9c9e49bb2728b3aa" exitCode=0 May 21 03:23:51.002455 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:51.002082 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw" event={"ID":"4930f835-c3b3-4481-b200-4a65964e81a6","Type":"ContainerDied","Data":"f969c2d3c0895390da30f606524f87c584bb041c507bacaa9c9e49bb2728b3aa"} May 21 03:23:52.127148 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:52.127124 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw" May 21 03:23:52.240484 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:52.240450 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxssg\" (UniqueName: \"kubernetes.io/projected/4930f835-c3b3-4481-b200-4a65964e81a6-kube-api-access-hxssg\") pod \"4930f835-c3b3-4481-b200-4a65964e81a6\" (UID: \"4930f835-c3b3-4481-b200-4a65964e81a6\") " May 21 03:23:52.240653 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:52.240524 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4930f835-c3b3-4481-b200-4a65964e81a6-bundle\") pod \"4930f835-c3b3-4481-b200-4a65964e81a6\" (UID: \"4930f835-c3b3-4481-b200-4a65964e81a6\") " May 21 03:23:52.240653 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:52.240551 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4930f835-c3b3-4481-b200-4a65964e81a6-util\") pod \"4930f835-c3b3-4481-b200-4a65964e81a6\" (UID: \"4930f835-c3b3-4481-b200-4a65964e81a6\") " May 21 03:23:52.240981 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:52.240948 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4930f835-c3b3-4481-b200-4a65964e81a6-bundle" (OuterVolumeSpecName: "bundle") pod "4930f835-c3b3-4481-b200-4a65964e81a6" (UID: "4930f835-c3b3-4481-b200-4a65964e81a6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:23:52.242508 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:52.242485 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4930f835-c3b3-4481-b200-4a65964e81a6-kube-api-access-hxssg" (OuterVolumeSpecName: "kube-api-access-hxssg") pod "4930f835-c3b3-4481-b200-4a65964e81a6" (UID: "4930f835-c3b3-4481-b200-4a65964e81a6"). InnerVolumeSpecName "kube-api-access-hxssg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:23:52.245325 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:52.245304 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4930f835-c3b3-4481-b200-4a65964e81a6-util" (OuterVolumeSpecName: "util") pod "4930f835-c3b3-4481-b200-4a65964e81a6" (UID: "4930f835-c3b3-4481-b200-4a65964e81a6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:23:52.341845 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:52.341812 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4930f835-c3b3-4481-b200-4a65964e81a6-bundle\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:23:52.341845 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:52.341843 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4930f835-c3b3-4481-b200-4a65964e81a6-util\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:23:52.342052 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:52.341858 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxssg\" (UniqueName: \"kubernetes.io/projected/4930f835-c3b3-4481-b200-4a65964e81a6-kube-api-access-hxssg\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:23:53.009692 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:53.009655 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw" event={"ID":"4930f835-c3b3-4481-b200-4a65964e81a6","Type":"ContainerDied","Data":"6b632b504ae9a1b43d18573b7e88c257ec05cd9c3b6b837331a821ca023d024b"} May 21 03:23:53.009692 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:53.009690 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b632b504ae9a1b43d18573b7e88c257ec05cd9c3b6b837331a821ca023d024b" May 21 03:23:53.009919 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:53.009698 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f89mfw" May 21 03:23:58.775394 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:58.775286 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-lccwd"] May 21 03:23:58.775752 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:58.775576 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4930f835-c3b3-4481-b200-4a65964e81a6" containerName="pull" May 21 03:23:58.775752 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:58.775589 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4930f835-c3b3-4481-b200-4a65964e81a6" containerName="pull" May 21 03:23:58.775752 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:58.775607 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4930f835-c3b3-4481-b200-4a65964e81a6" containerName="util" May 21 03:23:58.775752 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:58.775613 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4930f835-c3b3-4481-b200-4a65964e81a6" containerName="util" May 21 03:23:58.775752 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:58.775619 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4930f835-c3b3-4481-b200-4a65964e81a6" containerName="extract" May 21 03:23:58.775752 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:58.775625 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4930f835-c3b3-4481-b200-4a65964e81a6" containerName="extract" May 21 03:23:58.775752 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:58.775670 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="4930f835-c3b3-4481-b200-4a65964e81a6" containerName="extract" May 21 03:23:58.780747 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:58.780722 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lccwd" May 21 03:23:58.783493 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:58.783470 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 03:23:58.784942 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:58.784712 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-5l8jm\"" May 21 03:23:58.784942 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:58.784788 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 03:23:58.787386 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:58.787364 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-lccwd"] May 21 03:23:58.795592 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:58.795566 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a61d4912-daec-41b3-8b8d-480fe152f096-tmp\") pod \"openshift-lws-operator-bfc7f696d-lccwd\" (UID: \"a61d4912-daec-41b3-8b8d-480fe152f096\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lccwd" May 21 03:23:58.795762 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:58.795734 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f5j5\" (UniqueName: \"kubernetes.io/projected/a61d4912-daec-41b3-8b8d-480fe152f096-kube-api-access-4f5j5\") pod \"openshift-lws-operator-bfc7f696d-lccwd\" (UID: \"a61d4912-daec-41b3-8b8d-480fe152f096\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lccwd" May 21 03:23:58.896891 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:58.896843 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4f5j5\" (UniqueName: \"kubernetes.io/projected/a61d4912-daec-41b3-8b8d-480fe152f096-kube-api-access-4f5j5\") pod \"openshift-lws-operator-bfc7f696d-lccwd\" (UID: \"a61d4912-daec-41b3-8b8d-480fe152f096\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lccwd" May 21 03:23:58.897063 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:58.896904 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a61d4912-daec-41b3-8b8d-480fe152f096-tmp\") pod \"openshift-lws-operator-bfc7f696d-lccwd\" (UID: \"a61d4912-daec-41b3-8b8d-480fe152f096\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lccwd" May 21 03:23:58.897308 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:58.897286 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a61d4912-daec-41b3-8b8d-480fe152f096-tmp\") pod \"openshift-lws-operator-bfc7f696d-lccwd\" (UID: \"a61d4912-daec-41b3-8b8d-480fe152f096\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lccwd" May 21 03:23:58.904634 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:58.904613 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f5j5\" (UniqueName: \"kubernetes.io/projected/a61d4912-daec-41b3-8b8d-480fe152f096-kube-api-access-4f5j5\") pod \"openshift-lws-operator-bfc7f696d-lccwd\" (UID: \"a61d4912-daec-41b3-8b8d-480fe152f096\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lccwd" May 21 03:23:59.090656 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:59.090621 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lccwd" May 21 03:23:59.217505 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:23:59.217477 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-lccwd"] May 21 03:23:59.220275 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:23:59.220245 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda61d4912_daec_41b3_8b8d_480fe152f096.slice/crio-00962a1e20a44483a1b27d719761569e04b1dc6f77fbbacb1c02d6665b85d8bf WatchSource:0}: Error finding container 00962a1e20a44483a1b27d719761569e04b1dc6f77fbbacb1c02d6665b85d8bf: Status 404 returned error can't find the container with id 00962a1e20a44483a1b27d719761569e04b1dc6f77fbbacb1c02d6665b85d8bf May 21 03:24:00.033845 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:00.033810 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lccwd" event={"ID":"a61d4912-daec-41b3-8b8d-480fe152f096","Type":"ContainerStarted","Data":"00962a1e20a44483a1b27d719761569e04b1dc6f77fbbacb1c02d6665b85d8bf"} May 21 03:24:03.046651 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:03.046615 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lccwd" event={"ID":"a61d4912-daec-41b3-8b8d-480fe152f096","Type":"ContainerStarted","Data":"1844770f59d84ce9a3205a02cdcdb03b28dd455bcbbe7598612a21d94936dd2b"} May 21 03:24:05.278972 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:05.278917 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lccwd" podStartSLOduration=4.106491544 podStartE2EDuration="7.278896704s" podCreationTimestamp="2026-05-21 03:23:58 +0000 UTC" firstStartedPulling="2026-05-21 03:23:59.2217026 +0000 UTC m=+263.587922970" lastFinishedPulling="2026-05-21 03:24:02.394107759 +0000 UTC m=+266.760328130" observedRunningTime="2026-05-21 03:24:03.060136013 +0000 UTC m=+267.426356406" watchObservedRunningTime="2026-05-21 03:24:05.278896704 +0000 UTC m=+269.645117096" May 21 03:24:05.280331 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:05.280293 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j"] May 21 03:24:05.282678 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:05.282663 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j" May 21 03:24:05.284724 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:05.284704 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 03:24:05.285524 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:05.285504 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4jmgw\"" May 21 03:24:05.285620 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:05.285521 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 03:24:05.290032 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:05.290008 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j"] May 21 03:24:05.342469 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:05.342426 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/041d0141-7703-43b0-886b-69e3db202935-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j\" (UID: \"041d0141-7703-43b0-886b-69e3db202935\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j" May 21 03:24:05.342659 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:05.342480 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwqt4\" (UniqueName: \"kubernetes.io/projected/041d0141-7703-43b0-886b-69e3db202935-kube-api-access-fwqt4\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j\" (UID: \"041d0141-7703-43b0-886b-69e3db202935\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j" May 21 03:24:05.342659 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:05.342513 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/041d0141-7703-43b0-886b-69e3db202935-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j\" (UID: \"041d0141-7703-43b0-886b-69e3db202935\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j" May 21 03:24:05.443679 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:05.443641 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/041d0141-7703-43b0-886b-69e3db202935-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j\" (UID: \"041d0141-7703-43b0-886b-69e3db202935\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j" May 21 03:24:05.443856 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:05.443695 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fwqt4\" (UniqueName: \"kubernetes.io/projected/041d0141-7703-43b0-886b-69e3db202935-kube-api-access-fwqt4\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j\" (UID: \"041d0141-7703-43b0-886b-69e3db202935\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j" May 21 03:24:05.443856 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:05.443721 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/041d0141-7703-43b0-886b-69e3db202935-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j\" (UID: \"041d0141-7703-43b0-886b-69e3db202935\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j" May 21 03:24:05.444114 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:05.444095 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/041d0141-7703-43b0-886b-69e3db202935-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j\" (UID: \"041d0141-7703-43b0-886b-69e3db202935\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j" May 21 03:24:05.444153 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:05.444105 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/041d0141-7703-43b0-886b-69e3db202935-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j\" (UID: \"041d0141-7703-43b0-886b-69e3db202935\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j" May 21 03:24:05.451419 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:05.451390 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwqt4\" (UniqueName: \"kubernetes.io/projected/041d0141-7703-43b0-886b-69e3db202935-kube-api-access-fwqt4\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j\" (UID: \"041d0141-7703-43b0-886b-69e3db202935\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j" May 21 03:24:05.592222 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:05.592178 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j" May 21 03:24:05.721834 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:05.721668 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j"] May 21 03:24:05.724536 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:24:05.724501 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod041d0141_7703_43b0_886b_69e3db202935.slice/crio-be1a1c0008f095c7860b762e52bab11b67540fec7b9b4d76e9d25b011cf1add2 WatchSource:0}: Error finding container be1a1c0008f095c7860b762e52bab11b67540fec7b9b4d76e9d25b011cf1add2: Status 404 returned error can't find the container with id be1a1c0008f095c7860b762e52bab11b67540fec7b9b4d76e9d25b011cf1add2 May 21 03:24:06.057079 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:06.057041 2575 generic.go:358] "Generic (PLEG): container finished" podID="041d0141-7703-43b0-886b-69e3db202935" containerID="3b4d1e3ce71be415bf1812f8e78e0bc6a37afc4c2776c5b6f12429e13ef4378e" exitCode=0 May 21 03:24:06.057300 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:06.057131 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j" event={"ID":"041d0141-7703-43b0-886b-69e3db202935","Type":"ContainerDied","Data":"3b4d1e3ce71be415bf1812f8e78e0bc6a37afc4c2776c5b6f12429e13ef4378e"} May 21 03:24:06.057300 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:06.057167 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j" event={"ID":"041d0141-7703-43b0-886b-69e3db202935","Type":"ContainerStarted","Data":"be1a1c0008f095c7860b762e52bab11b67540fec7b9b4d76e9d25b011cf1add2"} May 21 03:24:07.061785 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:07.061746 2575 generic.go:358] "Generic (PLEG): container finished" podID="041d0141-7703-43b0-886b-69e3db202935" containerID="9ee10565557df791f6460f3f46db8d530b0b3467976f62bb8b853e7a309d780a" exitCode=0 May 21 03:24:07.062185 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:07.061806 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j" event={"ID":"041d0141-7703-43b0-886b-69e3db202935","Type":"ContainerDied","Data":"9ee10565557df791f6460f3f46db8d530b0b3467976f62bb8b853e7a309d780a"} May 21 03:24:08.066433 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:08.066395 2575 generic.go:358] "Generic (PLEG): container finished" podID="041d0141-7703-43b0-886b-69e3db202935" containerID="ea81191799dff5c0c8c3ea3a460ac38024ec643a170c6aa795c1e42a6d63f831" exitCode=0 May 21 03:24:08.066810 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:08.066457 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j" event={"ID":"041d0141-7703-43b0-886b-69e3db202935","Type":"ContainerDied","Data":"ea81191799dff5c0c8c3ea3a460ac38024ec643a170c6aa795c1e42a6d63f831"} May 21 03:24:09.203173 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:09.203144 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j" May 21 03:24:09.267278 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:09.267239 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/041d0141-7703-43b0-886b-69e3db202935-util\") pod \"041d0141-7703-43b0-886b-69e3db202935\" (UID: \"041d0141-7703-43b0-886b-69e3db202935\") " May 21 03:24:09.267471 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:09.267294 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwqt4\" (UniqueName: \"kubernetes.io/projected/041d0141-7703-43b0-886b-69e3db202935-kube-api-access-fwqt4\") pod \"041d0141-7703-43b0-886b-69e3db202935\" (UID: \"041d0141-7703-43b0-886b-69e3db202935\") " May 21 03:24:09.267471 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:09.267323 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/041d0141-7703-43b0-886b-69e3db202935-bundle\") pod \"041d0141-7703-43b0-886b-69e3db202935\" (UID: \"041d0141-7703-43b0-886b-69e3db202935\") " May 21 03:24:09.268122 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:09.268092 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/041d0141-7703-43b0-886b-69e3db202935-bundle" (OuterVolumeSpecName: "bundle") pod "041d0141-7703-43b0-886b-69e3db202935" (UID: "041d0141-7703-43b0-886b-69e3db202935"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:24:09.269515 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:09.269491 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/041d0141-7703-43b0-886b-69e3db202935-kube-api-access-fwqt4" (OuterVolumeSpecName: "kube-api-access-fwqt4") pod "041d0141-7703-43b0-886b-69e3db202935" (UID: "041d0141-7703-43b0-886b-69e3db202935"). InnerVolumeSpecName "kube-api-access-fwqt4". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:24:09.272874 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:09.272837 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/041d0141-7703-43b0-886b-69e3db202935-util" (OuterVolumeSpecName: "util") pod "041d0141-7703-43b0-886b-69e3db202935" (UID: "041d0141-7703-43b0-886b-69e3db202935"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:24:09.368248 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:09.368169 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/041d0141-7703-43b0-886b-69e3db202935-util\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:24:09.368248 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:09.368196 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwqt4\" (UniqueName: \"kubernetes.io/projected/041d0141-7703-43b0-886b-69e3db202935-kube-api-access-fwqt4\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:24:09.368248 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:09.368207 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/041d0141-7703-43b0-886b-69e3db202935-bundle\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:24:10.074338 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:10.074306 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j" May 21 03:24:10.074534 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:10.074304 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5vc26j" event={"ID":"041d0141-7703-43b0-886b-69e3db202935","Type":"ContainerDied","Data":"be1a1c0008f095c7860b762e52bab11b67540fec7b9b4d76e9d25b011cf1add2"} May 21 03:24:10.074534 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:10.074388 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be1a1c0008f095c7860b762e52bab11b67540fec7b9b4d76e9d25b011cf1add2" May 21 03:24:11.689946 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.689910 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-79478bfc9c-bjvjk"] May 21 03:24:11.690386 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.690194 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="041d0141-7703-43b0-886b-69e3db202935" containerName="util" May 21 03:24:11.690386 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.690204 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="041d0141-7703-43b0-886b-69e3db202935" containerName="util" May 21 03:24:11.690386 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.690218 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="041d0141-7703-43b0-886b-69e3db202935" containerName="pull" May 21 03:24:11.690386 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.690224 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="041d0141-7703-43b0-886b-69e3db202935" containerName="pull" May 21 03:24:11.690386 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.690237 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="041d0141-7703-43b0-886b-69e3db202935" containerName="extract" May 21 03:24:11.690386 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.690244 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="041d0141-7703-43b0-886b-69e3db202935" containerName="extract" May 21 03:24:11.690386 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.690290 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="041d0141-7703-43b0-886b-69e3db202935" containerName="extract" May 21 03:24:11.692761 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.692740 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-bjvjk" May 21 03:24:11.697937 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.697912 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 03:24:11.698752 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.698733 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 03:24:11.698851 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.698794 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 03:24:11.698902 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.698885 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qlxqj\"" May 21 03:24:11.704941 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.704912 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79478bfc9c-bjvjk"] May 21 03:24:11.782374 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.782320 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b3fa544c-91c1-4f17-9b65-31230cb12b26-manager-config\") pod \"lws-controller-manager-79478bfc9c-bjvjk\" (UID: \"b3fa544c-91c1-4f17-9b65-31230cb12b26\") " pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-bjvjk" May 21 03:24:11.782558 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.782428 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3fa544c-91c1-4f17-9b65-31230cb12b26-cert\") pod \"lws-controller-manager-79478bfc9c-bjvjk\" (UID: \"b3fa544c-91c1-4f17-9b65-31230cb12b26\") " pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-bjvjk" May 21 03:24:11.782558 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.782468 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42q9p\" (UniqueName: \"kubernetes.io/projected/b3fa544c-91c1-4f17-9b65-31230cb12b26-kube-api-access-42q9p\") pod \"lws-controller-manager-79478bfc9c-bjvjk\" (UID: \"b3fa544c-91c1-4f17-9b65-31230cb12b26\") " pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-bjvjk" May 21 03:24:11.782558 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.782497 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b3fa544c-91c1-4f17-9b65-31230cb12b26-metrics-cert\") pod \"lws-controller-manager-79478bfc9c-bjvjk\" (UID: \"b3fa544c-91c1-4f17-9b65-31230cb12b26\") " pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-bjvjk" May 21 03:24:11.883373 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.883308 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b3fa544c-91c1-4f17-9b65-31230cb12b26-manager-config\") pod \"lws-controller-manager-79478bfc9c-bjvjk\" (UID: \"b3fa544c-91c1-4f17-9b65-31230cb12b26\") " pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-bjvjk" May 21 03:24:11.883548 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.883401 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3fa544c-91c1-4f17-9b65-31230cb12b26-cert\") pod \"lws-controller-manager-79478bfc9c-bjvjk\" (UID: \"b3fa544c-91c1-4f17-9b65-31230cb12b26\") " pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-bjvjk" May 21 03:24:11.883548 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.883433 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-42q9p\" (UniqueName: \"kubernetes.io/projected/b3fa544c-91c1-4f17-9b65-31230cb12b26-kube-api-access-42q9p\") pod \"lws-controller-manager-79478bfc9c-bjvjk\" (UID: \"b3fa544c-91c1-4f17-9b65-31230cb12b26\") " pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-bjvjk" May 21 03:24:11.883548 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.883453 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b3fa544c-91c1-4f17-9b65-31230cb12b26-metrics-cert\") pod \"lws-controller-manager-79478bfc9c-bjvjk\" (UID: \"b3fa544c-91c1-4f17-9b65-31230cb12b26\") " pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-bjvjk" May 21 03:24:11.884028 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.883998 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b3fa544c-91c1-4f17-9b65-31230cb12b26-manager-config\") pod \"lws-controller-manager-79478bfc9c-bjvjk\" (UID: \"b3fa544c-91c1-4f17-9b65-31230cb12b26\") " pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-bjvjk" May 21 03:24:11.885851 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.885822 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b3fa544c-91c1-4f17-9b65-31230cb12b26-metrics-cert\") pod \"lws-controller-manager-79478bfc9c-bjvjk\" (UID: \"b3fa544c-91c1-4f17-9b65-31230cb12b26\") " pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-bjvjk" May 21 03:24:11.885968 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.885950 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3fa544c-91c1-4f17-9b65-31230cb12b26-cert\") pod \"lws-controller-manager-79478bfc9c-bjvjk\" (UID: \"b3fa544c-91c1-4f17-9b65-31230cb12b26\") " pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-bjvjk" May 21 03:24:11.892127 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:11.892098 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42q9p\" (UniqueName: \"kubernetes.io/projected/b3fa544c-91c1-4f17-9b65-31230cb12b26-kube-api-access-42q9p\") pod \"lws-controller-manager-79478bfc9c-bjvjk\" (UID: \"b3fa544c-91c1-4f17-9b65-31230cb12b26\") " pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-bjvjk" May 21 03:24:12.007259 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:12.007160 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-bjvjk" May 21 03:24:12.135289 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:12.135256 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79478bfc9c-bjvjk"] May 21 03:24:12.137884 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:24:12.137855 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3fa544c_91c1_4f17_9b65_31230cb12b26.slice/crio-4e5efb64a14a32003130ba3df7de0f3199cc64b6b5ff6d66113b2d884dad28a9 WatchSource:0}: Error finding container 4e5efb64a14a32003130ba3df7de0f3199cc64b6b5ff6d66113b2d884dad28a9: Status 404 returned error can't find the container with id 4e5efb64a14a32003130ba3df7de0f3199cc64b6b5ff6d66113b2d884dad28a9 May 21 03:24:13.087710 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:13.087670 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-bjvjk" event={"ID":"b3fa544c-91c1-4f17-9b65-31230cb12b26","Type":"ContainerStarted","Data":"4e5efb64a14a32003130ba3df7de0f3199cc64b6b5ff6d66113b2d884dad28a9"} May 21 03:24:14.092378 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:14.092321 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-bjvjk" event={"ID":"b3fa544c-91c1-4f17-9b65-31230cb12b26","Type":"ContainerStarted","Data":"32fffabc9b6d2bcb442c88b18ebaab889a393c4add8d355226045d0d3bf89255"} May 21 03:24:14.092826 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:14.092429 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-bjvjk" May 21 03:24:14.111597 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:14.111545 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-bjvjk" podStartSLOduration=1.785312088 podStartE2EDuration="3.111527628s" podCreationTimestamp="2026-05-21 03:24:11 +0000 UTC" firstStartedPulling="2026-05-21 03:24:12.139652165 +0000 UTC m=+276.505872535" lastFinishedPulling="2026-05-21 03:24:13.465867702 +0000 UTC m=+277.832088075" observedRunningTime="2026-05-21 03:24:14.109565419 +0000 UTC m=+278.475785811" watchObservedRunningTime="2026-05-21 03:24:14.111527628 +0000 UTC m=+278.477748020" May 21 03:24:18.278705 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.278669 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs"] May 21 03:24:18.281059 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.281042 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs" May 21 03:24:18.283182 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.283152 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4jmgw\"" May 21 03:24:18.283182 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.283167 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 03:24:18.283992 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.283977 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 03:24:18.288274 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.288252 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs"] May 21 03:24:18.333343 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.333299 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85b0eeff-4f45-42ad-864d-a69800c88343-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs\" (UID: \"85b0eeff-4f45-42ad-864d-a69800c88343\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs" May 21 03:24:18.333343 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.333341 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q25jm\" (UniqueName: \"kubernetes.io/projected/85b0eeff-4f45-42ad-864d-a69800c88343-kube-api-access-q25jm\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs\" (UID: \"85b0eeff-4f45-42ad-864d-a69800c88343\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs" May 21 03:24:18.333617 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.333504 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85b0eeff-4f45-42ad-864d-a69800c88343-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs\" (UID: \"85b0eeff-4f45-42ad-864d-a69800c88343\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs" May 21 03:24:18.434767 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.434726 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85b0eeff-4f45-42ad-864d-a69800c88343-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs\" (UID: \"85b0eeff-4f45-42ad-864d-a69800c88343\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs" May 21 03:24:18.434967 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.434794 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85b0eeff-4f45-42ad-864d-a69800c88343-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs\" (UID: \"85b0eeff-4f45-42ad-864d-a69800c88343\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs" May 21 03:24:18.434967 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.434817 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q25jm\" (UniqueName: \"kubernetes.io/projected/85b0eeff-4f45-42ad-864d-a69800c88343-kube-api-access-q25jm\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs\" (UID: \"85b0eeff-4f45-42ad-864d-a69800c88343\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs" May 21 03:24:18.435221 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.435199 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85b0eeff-4f45-42ad-864d-a69800c88343-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs\" (UID: \"85b0eeff-4f45-42ad-864d-a69800c88343\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs" May 21 03:24:18.435221 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.435212 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85b0eeff-4f45-42ad-864d-a69800c88343-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs\" (UID: \"85b0eeff-4f45-42ad-864d-a69800c88343\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs" May 21 03:24:18.443285 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.443258 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q25jm\" (UniqueName: \"kubernetes.io/projected/85b0eeff-4f45-42ad-864d-a69800c88343-kube-api-access-q25jm\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs\" (UID: \"85b0eeff-4f45-42ad-864d-a69800c88343\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs" May 21 03:24:18.590685 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.590645 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs" May 21 03:24:18.720651 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.720615 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs"] May 21 03:24:18.724473 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:24:18.724442 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85b0eeff_4f45_42ad_864d_a69800c88343.slice/crio-9de426534dd6daa5ef3287e38ffdbdcce51a890dbc22673b1518d080bcb7b9e4 WatchSource:0}: Error finding container 9de426534dd6daa5ef3287e38ffdbdcce51a890dbc22673b1518d080bcb7b9e4: Status 404 returned error can't find the container with id 9de426534dd6daa5ef3287e38ffdbdcce51a890dbc22673b1518d080bcb7b9e4 May 21 03:24:18.874027 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.873952 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-xrmps"] May 21 03:24:18.876015 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.875995 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-xrmps" May 21 03:24:18.878539 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.878517 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 03:24:18.879009 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.878992 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 03:24:18.879234 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.879215 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 03:24:18.879234 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.879228 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5rz5x\"" May 21 03:24:18.879538 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.879523 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 03:24:18.889715 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.889687 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-xrmps"] May 21 03:24:18.939073 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.939038 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1f242c0-4c42-447a-9092-955adf578651-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-xrmps\" (UID: \"f1f242c0-4c42-447a-9092-955adf578651\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-xrmps" May 21 03:24:18.939073 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.939075 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6g6v\" (UniqueName: \"kubernetes.io/projected/f1f242c0-4c42-447a-9092-955adf578651-kube-api-access-n6g6v\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-xrmps\" (UID: \"f1f242c0-4c42-447a-9092-955adf578651\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-xrmps" May 21 03:24:18.939313 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:18.939123 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1f242c0-4c42-447a-9092-955adf578651-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-xrmps\" (UID: \"f1f242c0-4c42-447a-9092-955adf578651\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-xrmps" May 21 03:24:19.040095 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:19.040062 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1f242c0-4c42-447a-9092-955adf578651-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-xrmps\" (UID: \"f1f242c0-4c42-447a-9092-955adf578651\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-xrmps" May 21 03:24:19.040276 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:19.040128 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1f242c0-4c42-447a-9092-955adf578651-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-xrmps\" (UID: \"f1f242c0-4c42-447a-9092-955adf578651\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-xrmps" May 21 03:24:19.040276 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:19.040148 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6g6v\" (UniqueName: \"kubernetes.io/projected/f1f242c0-4c42-447a-9092-955adf578651-kube-api-access-n6g6v\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-xrmps\" (UID: \"f1f242c0-4c42-447a-9092-955adf578651\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-xrmps" May 21 03:24:19.042670 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:19.042634 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1f242c0-4c42-447a-9092-955adf578651-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-xrmps\" (UID: \"f1f242c0-4c42-447a-9092-955adf578651\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-xrmps" May 21 03:24:19.042801 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:19.042642 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1f242c0-4c42-447a-9092-955adf578651-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-xrmps\" (UID: \"f1f242c0-4c42-447a-9092-955adf578651\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-xrmps" May 21 03:24:19.048061 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:19.048035 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6g6v\" (UniqueName: \"kubernetes.io/projected/f1f242c0-4c42-447a-9092-955adf578651-kube-api-access-n6g6v\") pod \"opendatahub-operator-controller-manager-5fcf489fb9-xrmps\" (UID: \"f1f242c0-4c42-447a-9092-955adf578651\") " pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-xrmps" May 21 03:24:19.110337 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:19.110306 2575 generic.go:358] "Generic (PLEG): container finished" podID="85b0eeff-4f45-42ad-864d-a69800c88343" containerID="36a67d336eab77cf5ba7821a47c2b1b04e229f7d83fa8a4f0fbb7019f0acec29" exitCode=0 May 21 03:24:19.110548 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:19.110401 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs" event={"ID":"85b0eeff-4f45-42ad-864d-a69800c88343","Type":"ContainerDied","Data":"36a67d336eab77cf5ba7821a47c2b1b04e229f7d83fa8a4f0fbb7019f0acec29"} May 21 03:24:19.110548 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:19.110447 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs" event={"ID":"85b0eeff-4f45-42ad-864d-a69800c88343","Type":"ContainerStarted","Data":"9de426534dd6daa5ef3287e38ffdbdcce51a890dbc22673b1518d080bcb7b9e4"} May 21 03:24:19.202419 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:19.202309 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-xrmps" May 21 03:24:19.338634 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:19.338597 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-xrmps"] May 21 03:24:19.345377 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:24:19.345317 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1f242c0_4c42_447a_9092_955adf578651.slice/crio-109a2018d00beb543a769f3d556ecbaa85ae54f768939d9e7b5e3a91ae70b3d7 WatchSource:0}: Error finding container 109a2018d00beb543a769f3d556ecbaa85ae54f768939d9e7b5e3a91ae70b3d7: Status 404 returned error can't find the container with id 109a2018d00beb543a769f3d556ecbaa85ae54f768939d9e7b5e3a91ae70b3d7 May 21 03:24:20.115710 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:20.115600 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-xrmps" event={"ID":"f1f242c0-4c42-447a-9092-955adf578651","Type":"ContainerStarted","Data":"109a2018d00beb543a769f3d556ecbaa85ae54f768939d9e7b5e3a91ae70b3d7"} May 21 03:24:20.117810 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:20.117731 2575 generic.go:358] "Generic (PLEG): container finished" podID="85b0eeff-4f45-42ad-864d-a69800c88343" containerID="406f4e9a4082d1eb76bda62ec9c45d675bc6c530b524e7d8d50436799e6f6fce" exitCode=0 May 21 03:24:20.117810 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:20.117786 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs" event={"ID":"85b0eeff-4f45-42ad-864d-a69800c88343","Type":"ContainerDied","Data":"406f4e9a4082d1eb76bda62ec9c45d675bc6c530b524e7d8d50436799e6f6fce"} May 21 03:24:21.124071 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:21.124030 2575 generic.go:358] "Generic (PLEG): container finished" podID="85b0eeff-4f45-42ad-864d-a69800c88343" containerID="fc4b1a3612c04d739d1d7bd358ed7a02cd3db7251c149dd4dba587698354c296" exitCode=0 May 21 03:24:21.124487 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:21.124112 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs" event={"ID":"85b0eeff-4f45-42ad-864d-a69800c88343","Type":"ContainerDied","Data":"fc4b1a3612c04d739d1d7bd358ed7a02cd3db7251c149dd4dba587698354c296"} May 21 03:24:22.129746 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:22.129706 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-xrmps" event={"ID":"f1f242c0-4c42-447a-9092-955adf578651","Type":"ContainerStarted","Data":"35afcedbb695964ac43005cc6206516f83920493f2a11ccf1ec97d0a19afdca0"} May 21 03:24:22.130150 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:22.130131 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-xrmps" May 21 03:24:22.158343 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:22.157701 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-xrmps" podStartSLOduration=1.7198936040000001 podStartE2EDuration="4.157656711s" podCreationTimestamp="2026-05-21 03:24:18 +0000 UTC" firstStartedPulling="2026-05-21 03:24:19.347038908 +0000 UTC m=+283.713259278" lastFinishedPulling="2026-05-21 03:24:21.784802007 +0000 UTC m=+286.151022385" observedRunningTime="2026-05-21 03:24:22.15548515 +0000 UTC m=+286.521705541" watchObservedRunningTime="2026-05-21 03:24:22.157656711 +0000 UTC m=+286.523877104" May 21 03:24:22.258491 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:22.258466 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs" May 21 03:24:22.369474 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:22.369431 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85b0eeff-4f45-42ad-864d-a69800c88343-util\") pod \"85b0eeff-4f45-42ad-864d-a69800c88343\" (UID: \"85b0eeff-4f45-42ad-864d-a69800c88343\") " May 21 03:24:22.369644 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:22.369543 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85b0eeff-4f45-42ad-864d-a69800c88343-bundle\") pod \"85b0eeff-4f45-42ad-864d-a69800c88343\" (UID: \"85b0eeff-4f45-42ad-864d-a69800c88343\") " May 21 03:24:22.369644 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:22.369577 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q25jm\" (UniqueName: \"kubernetes.io/projected/85b0eeff-4f45-42ad-864d-a69800c88343-kube-api-access-q25jm\") pod \"85b0eeff-4f45-42ad-864d-a69800c88343\" (UID: \"85b0eeff-4f45-42ad-864d-a69800c88343\") " May 21 03:24:22.370451 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:22.370420 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85b0eeff-4f45-42ad-864d-a69800c88343-bundle" (OuterVolumeSpecName: "bundle") pod "85b0eeff-4f45-42ad-864d-a69800c88343" (UID: "85b0eeff-4f45-42ad-864d-a69800c88343"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:24:22.371563 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:22.371537 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85b0eeff-4f45-42ad-864d-a69800c88343-kube-api-access-q25jm" (OuterVolumeSpecName: "kube-api-access-q25jm") pod "85b0eeff-4f45-42ad-864d-a69800c88343" (UID: "85b0eeff-4f45-42ad-864d-a69800c88343"). InnerVolumeSpecName "kube-api-access-q25jm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:24:22.375387 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:22.375334 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85b0eeff-4f45-42ad-864d-a69800c88343-util" (OuterVolumeSpecName: "util") pod "85b0eeff-4f45-42ad-864d-a69800c88343" (UID: "85b0eeff-4f45-42ad-864d-a69800c88343"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:24:22.470944 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:22.470864 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q25jm\" (UniqueName: \"kubernetes.io/projected/85b0eeff-4f45-42ad-864d-a69800c88343-kube-api-access-q25jm\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:24:22.470944 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:22.470891 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85b0eeff-4f45-42ad-864d-a69800c88343-util\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:24:22.470944 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:22.470901 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85b0eeff-4f45-42ad-864d-a69800c88343-bundle\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:24:23.134706 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:23.134680 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs" May 21 03:24:23.134706 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:23.134690 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sllqs" event={"ID":"85b0eeff-4f45-42ad-864d-a69800c88343","Type":"ContainerDied","Data":"9de426534dd6daa5ef3287e38ffdbdcce51a890dbc22673b1518d080bcb7b9e4"} May 21 03:24:23.135142 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:23.134720 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9de426534dd6daa5ef3287e38ffdbdcce51a890dbc22673b1518d080bcb7b9e4" May 21 03:24:25.098476 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:25.098445 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-79478bfc9c-bjvjk" May 21 03:24:33.137509 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:33.137472 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5fcf489fb9-xrmps" May 21 03:24:36.118074 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:36.118045 2575 kubelet.go:1628] "Image garbage collection succeeded" May 21 03:24:40.724057 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:40.724017 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5"] May 21 03:24:40.725536 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:40.724287 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85b0eeff-4f45-42ad-864d-a69800c88343" containerName="extract" May 21 03:24:40.725536 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:40.724298 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="85b0eeff-4f45-42ad-864d-a69800c88343" containerName="extract" May 21 03:24:40.725536 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:40.724312 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85b0eeff-4f45-42ad-864d-a69800c88343" containerName="util" May 21 03:24:40.725536 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:40.724318 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="85b0eeff-4f45-42ad-864d-a69800c88343" containerName="util" May 21 03:24:40.725536 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:40.724324 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85b0eeff-4f45-42ad-864d-a69800c88343" containerName="pull" May 21 03:24:40.725536 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:40.724331 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="85b0eeff-4f45-42ad-864d-a69800c88343" containerName="pull" May 21 03:24:40.725536 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:40.724392 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="85b0eeff-4f45-42ad-864d-a69800c88343" containerName="extract" May 21 03:24:40.726516 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:40.726500 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5" May 21 03:24:40.728623 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:40.728592 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 03:24:40.728746 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:40.728648 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4jmgw\"" May 21 03:24:40.728796 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:40.728763 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 03:24:40.733724 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:40.733510 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5"] May 21 03:24:40.822606 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:40.822566 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9pf9\" (UniqueName: \"kubernetes.io/projected/388afa61-3898-4fe1-a00a-1ebccb05a985-kube-api-access-t9pf9\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5\" (UID: \"388afa61-3898-4fe1-a00a-1ebccb05a985\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5" May 21 03:24:40.822812 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:40.822622 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/388afa61-3898-4fe1-a00a-1ebccb05a985-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5\" (UID: \"388afa61-3898-4fe1-a00a-1ebccb05a985\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5" May 21 03:24:40.822812 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:40.822718 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/388afa61-3898-4fe1-a00a-1ebccb05a985-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5\" (UID: \"388afa61-3898-4fe1-a00a-1ebccb05a985\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5" May 21 03:24:40.923625 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:40.923572 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t9pf9\" (UniqueName: \"kubernetes.io/projected/388afa61-3898-4fe1-a00a-1ebccb05a985-kube-api-access-t9pf9\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5\" (UID: \"388afa61-3898-4fe1-a00a-1ebccb05a985\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5" May 21 03:24:40.923834 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:40.923648 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/388afa61-3898-4fe1-a00a-1ebccb05a985-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5\" (UID: \"388afa61-3898-4fe1-a00a-1ebccb05a985\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5" May 21 03:24:40.923834 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:40.923714 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/388afa61-3898-4fe1-a00a-1ebccb05a985-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5\" (UID: \"388afa61-3898-4fe1-a00a-1ebccb05a985\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5" May 21 03:24:40.924057 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:40.924033 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/388afa61-3898-4fe1-a00a-1ebccb05a985-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5\" (UID: \"388afa61-3898-4fe1-a00a-1ebccb05a985\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5" May 21 03:24:40.924126 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:40.924069 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/388afa61-3898-4fe1-a00a-1ebccb05a985-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5\" (UID: \"388afa61-3898-4fe1-a00a-1ebccb05a985\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5" May 21 03:24:40.930881 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:40.930857 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9pf9\" (UniqueName: \"kubernetes.io/projected/388afa61-3898-4fe1-a00a-1ebccb05a985-kube-api-access-t9pf9\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5\" (UID: \"388afa61-3898-4fe1-a00a-1ebccb05a985\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5" May 21 03:24:41.036913 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:41.036879 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5" May 21 03:24:41.166153 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:41.166127 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5"] May 21 03:24:41.168572 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:24:41.168542 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod388afa61_3898_4fe1_a00a_1ebccb05a985.slice/crio-69894be051b0fc4c2ea5152e087844588fc1747f717386bcf235b47137b20a2d WatchSource:0}: Error finding container 69894be051b0fc4c2ea5152e087844588fc1747f717386bcf235b47137b20a2d: Status 404 returned error can't find the container with id 69894be051b0fc4c2ea5152e087844588fc1747f717386bcf235b47137b20a2d May 21 03:24:41.170517 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:41.170499 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 03:24:41.199308 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:41.199272 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5" event={"ID":"388afa61-3898-4fe1-a00a-1ebccb05a985","Type":"ContainerStarted","Data":"69894be051b0fc4c2ea5152e087844588fc1747f717386bcf235b47137b20a2d"} May 21 03:24:42.204255 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:42.204169 2575 generic.go:358] "Generic (PLEG): container finished" podID="388afa61-3898-4fe1-a00a-1ebccb05a985" containerID="385aefabf0d20802ccf704bfbc0ce8f772de5cea1c24ab8749dadb09ddad1ea8" exitCode=0 May 21 03:24:42.205172 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:42.204934 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5" event={"ID":"388afa61-3898-4fe1-a00a-1ebccb05a985","Type":"ContainerDied","Data":"385aefabf0d20802ccf704bfbc0ce8f772de5cea1c24ab8749dadb09ddad1ea8"} May 21 03:24:43.208700 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:43.208602 2575 generic.go:358] "Generic (PLEG): container finished" podID="388afa61-3898-4fe1-a00a-1ebccb05a985" containerID="c323fdd51b3cd91ab8c2fb875f427dfd05b479378e88d213e6a02b9fe5f10d69" exitCode=0 May 21 03:24:43.208700 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:43.208683 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5" event={"ID":"388afa61-3898-4fe1-a00a-1ebccb05a985","Type":"ContainerDied","Data":"c323fdd51b3cd91ab8c2fb875f427dfd05b479378e88d213e6a02b9fe5f10d69"} May 21 03:24:44.214130 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:44.214093 2575 generic.go:358] "Generic (PLEG): container finished" podID="388afa61-3898-4fe1-a00a-1ebccb05a985" containerID="6f054e1c25c3ee789d5d657aa916f84d32476ff35f34ad0f2d21f80e5a7a026b" exitCode=0 May 21 03:24:44.214550 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:44.214135 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5" event={"ID":"388afa61-3898-4fe1-a00a-1ebccb05a985","Type":"ContainerDied","Data":"6f054e1c25c3ee789d5d657aa916f84d32476ff35f34ad0f2d21f80e5a7a026b"} May 21 03:24:45.344843 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:45.344818 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5" May 21 03:24:45.463630 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:45.463590 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/388afa61-3898-4fe1-a00a-1ebccb05a985-bundle\") pod \"388afa61-3898-4fe1-a00a-1ebccb05a985\" (UID: \"388afa61-3898-4fe1-a00a-1ebccb05a985\") " May 21 03:24:45.463796 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:45.463690 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9pf9\" (UniqueName: \"kubernetes.io/projected/388afa61-3898-4fe1-a00a-1ebccb05a985-kube-api-access-t9pf9\") pod \"388afa61-3898-4fe1-a00a-1ebccb05a985\" (UID: \"388afa61-3898-4fe1-a00a-1ebccb05a985\") " May 21 03:24:45.463796 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:45.463725 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/388afa61-3898-4fe1-a00a-1ebccb05a985-util\") pod \"388afa61-3898-4fe1-a00a-1ebccb05a985\" (UID: \"388afa61-3898-4fe1-a00a-1ebccb05a985\") " May 21 03:24:45.464660 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:45.464626 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388afa61-3898-4fe1-a00a-1ebccb05a985-bundle" (OuterVolumeSpecName: "bundle") pod "388afa61-3898-4fe1-a00a-1ebccb05a985" (UID: "388afa61-3898-4fe1-a00a-1ebccb05a985"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:24:45.465825 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:45.465800 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/388afa61-3898-4fe1-a00a-1ebccb05a985-kube-api-access-t9pf9" (OuterVolumeSpecName: "kube-api-access-t9pf9") pod "388afa61-3898-4fe1-a00a-1ebccb05a985" (UID: "388afa61-3898-4fe1-a00a-1ebccb05a985"). InnerVolumeSpecName "kube-api-access-t9pf9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:24:45.471042 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:45.470962 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388afa61-3898-4fe1-a00a-1ebccb05a985-util" (OuterVolumeSpecName: "util") pod "388afa61-3898-4fe1-a00a-1ebccb05a985" (UID: "388afa61-3898-4fe1-a00a-1ebccb05a985"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:24:45.565031 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:45.564989 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9pf9\" (UniqueName: \"kubernetes.io/projected/388afa61-3898-4fe1-a00a-1ebccb05a985-kube-api-access-t9pf9\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:24:45.565031 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:45.565021 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/388afa61-3898-4fe1-a00a-1ebccb05a985-util\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:24:45.565031 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:45.565032 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/388afa61-3898-4fe1-a00a-1ebccb05a985-bundle\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:24:46.222119 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:46.222087 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5" event={"ID":"388afa61-3898-4fe1-a00a-1ebccb05a985","Type":"ContainerDied","Data":"69894be051b0fc4c2ea5152e087844588fc1747f717386bcf235b47137b20a2d"} May 21 03:24:46.222119 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:46.222119 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69894be051b0fc4c2ea5152e087844588fc1747f717386bcf235b47137b20a2d" May 21 03:24:46.222339 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:46.222130 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pwzz5" May 21 03:24:54.881495 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:54.881460 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x"] May 21 03:24:54.881872 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:54.881736 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="388afa61-3898-4fe1-a00a-1ebccb05a985" containerName="util" May 21 03:24:54.881872 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:54.881747 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="388afa61-3898-4fe1-a00a-1ebccb05a985" containerName="util" May 21 03:24:54.881872 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:54.881756 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="388afa61-3898-4fe1-a00a-1ebccb05a985" containerName="pull" May 21 03:24:54.881872 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:54.881762 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="388afa61-3898-4fe1-a00a-1ebccb05a985" containerName="pull" May 21 03:24:54.881872 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:54.881770 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="388afa61-3898-4fe1-a00a-1ebccb05a985" containerName="extract" May 21 03:24:54.881872 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:54.881776 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="388afa61-3898-4fe1-a00a-1ebccb05a985" containerName="extract" May 21 03:24:54.881872 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:54.881829 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="388afa61-3898-4fe1-a00a-1ebccb05a985" containerName="extract" May 21 03:24:54.884445 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:54.884428 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x" May 21 03:24:54.886800 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:54.886776 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 03:24:54.887592 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:54.887573 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 03:24:54.887685 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:54.887580 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4jmgw\"" May 21 03:24:54.894678 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:54.894652 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x"] May 21 03:24:55.047776 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:55.047733 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/226a2d3b-4a02-4dd8-821a-120b45481143-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x\" (UID: \"226a2d3b-4a02-4dd8-821a-120b45481143\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x" May 21 03:24:55.047935 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:55.047853 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czpzc\" (UniqueName: \"kubernetes.io/projected/226a2d3b-4a02-4dd8-821a-120b45481143-kube-api-access-czpzc\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x\" (UID: \"226a2d3b-4a02-4dd8-821a-120b45481143\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x" May 21 03:24:55.047935 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:55.047893 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/226a2d3b-4a02-4dd8-821a-120b45481143-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x\" (UID: \"226a2d3b-4a02-4dd8-821a-120b45481143\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x" May 21 03:24:55.149214 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:55.149124 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/226a2d3b-4a02-4dd8-821a-120b45481143-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x\" (UID: \"226a2d3b-4a02-4dd8-821a-120b45481143\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x" May 21 03:24:55.149214 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:55.149177 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/226a2d3b-4a02-4dd8-821a-120b45481143-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x\" (UID: \"226a2d3b-4a02-4dd8-821a-120b45481143\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x" May 21 03:24:55.149422 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:55.149244 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czpzc\" (UniqueName: \"kubernetes.io/projected/226a2d3b-4a02-4dd8-821a-120b45481143-kube-api-access-czpzc\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x\" (UID: \"226a2d3b-4a02-4dd8-821a-120b45481143\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x" May 21 03:24:55.149576 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:55.149555 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/226a2d3b-4a02-4dd8-821a-120b45481143-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x\" (UID: \"226a2d3b-4a02-4dd8-821a-120b45481143\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x" May 21 03:24:55.149615 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:55.149582 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/226a2d3b-4a02-4dd8-821a-120b45481143-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x\" (UID: \"226a2d3b-4a02-4dd8-821a-120b45481143\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x" May 21 03:24:55.168425 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:55.168401 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czpzc\" (UniqueName: \"kubernetes.io/projected/226a2d3b-4a02-4dd8-821a-120b45481143-kube-api-access-czpzc\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x\" (UID: \"226a2d3b-4a02-4dd8-821a-120b45481143\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x" May 21 03:24:55.193900 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:55.193873 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x" May 21 03:24:55.345991 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:55.345964 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x"] May 21 03:24:55.348297 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:24:55.348259 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod226a2d3b_4a02_4dd8_821a_120b45481143.slice/crio-c9d4f8097513b2dfbd325280924b6ac4cbc119244fe2bb8bffaec2b770847a80 WatchSource:0}: Error finding container c9d4f8097513b2dfbd325280924b6ac4cbc119244fe2bb8bffaec2b770847a80: Status 404 returned error can't find the container with id c9d4f8097513b2dfbd325280924b6ac4cbc119244fe2bb8bffaec2b770847a80 May 21 03:24:56.258292 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:56.258250 2575 generic.go:358] "Generic (PLEG): container finished" podID="226a2d3b-4a02-4dd8-821a-120b45481143" containerID="ebabffe7f6db9209f8b0f2689ff383ab485b6590f98e506951b63a3faab4fb7e" exitCode=0 May 21 03:24:56.258695 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:56.258327 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x" event={"ID":"226a2d3b-4a02-4dd8-821a-120b45481143","Type":"ContainerDied","Data":"ebabffe7f6db9209f8b0f2689ff383ab485b6590f98e506951b63a3faab4fb7e"} May 21 03:24:56.258695 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:56.258372 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x" event={"ID":"226a2d3b-4a02-4dd8-821a-120b45481143","Type":"ContainerStarted","Data":"c9d4f8097513b2dfbd325280924b6ac4cbc119244fe2bb8bffaec2b770847a80"} May 21 03:24:57.264180 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:57.264099 2575 generic.go:358] "Generic (PLEG): container finished" podID="226a2d3b-4a02-4dd8-821a-120b45481143" containerID="3fa2623aae42b2c75144a19d52635c0ce448e6c932b6226bc97b57f4b83c463b" exitCode=0 May 21 03:24:57.264545 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:57.264180 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x" event={"ID":"226a2d3b-4a02-4dd8-821a-120b45481143","Type":"ContainerDied","Data":"3fa2623aae42b2c75144a19d52635c0ce448e6c932b6226bc97b57f4b83c463b"} May 21 03:24:58.269612 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:58.269558 2575 generic.go:358] "Generic (PLEG): container finished" podID="226a2d3b-4a02-4dd8-821a-120b45481143" containerID="68c2eb235c50d7ebd4570bc7344261c53f072cf50cce218beec27222e8bcff7f" exitCode=0 May 21 03:24:58.269612 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:58.269599 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x" event={"ID":"226a2d3b-4a02-4dd8-821a-120b45481143","Type":"ContainerDied","Data":"68c2eb235c50d7ebd4570bc7344261c53f072cf50cce218beec27222e8bcff7f"} May 21 03:24:59.405449 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:59.405423 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x" May 21 03:24:59.582365 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:59.582327 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/226a2d3b-4a02-4dd8-821a-120b45481143-util\") pod \"226a2d3b-4a02-4dd8-821a-120b45481143\" (UID: \"226a2d3b-4a02-4dd8-821a-120b45481143\") " May 21 03:24:59.582549 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:59.582404 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czpzc\" (UniqueName: \"kubernetes.io/projected/226a2d3b-4a02-4dd8-821a-120b45481143-kube-api-access-czpzc\") pod \"226a2d3b-4a02-4dd8-821a-120b45481143\" (UID: \"226a2d3b-4a02-4dd8-821a-120b45481143\") " May 21 03:24:59.582549 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:59.582439 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/226a2d3b-4a02-4dd8-821a-120b45481143-bundle\") pod \"226a2d3b-4a02-4dd8-821a-120b45481143\" (UID: \"226a2d3b-4a02-4dd8-821a-120b45481143\") " May 21 03:24:59.583321 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:59.583293 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/226a2d3b-4a02-4dd8-821a-120b45481143-bundle" (OuterVolumeSpecName: "bundle") pod "226a2d3b-4a02-4dd8-821a-120b45481143" (UID: "226a2d3b-4a02-4dd8-821a-120b45481143"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:24:59.584587 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:59.584556 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/226a2d3b-4a02-4dd8-821a-120b45481143-kube-api-access-czpzc" (OuterVolumeSpecName: "kube-api-access-czpzc") pod "226a2d3b-4a02-4dd8-821a-120b45481143" (UID: "226a2d3b-4a02-4dd8-821a-120b45481143"). InnerVolumeSpecName "kube-api-access-czpzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:24:59.587983 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:59.587948 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/226a2d3b-4a02-4dd8-821a-120b45481143-util" (OuterVolumeSpecName: "util") pod "226a2d3b-4a02-4dd8-821a-120b45481143" (UID: "226a2d3b-4a02-4dd8-821a-120b45481143"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:24:59.683778 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:59.683744 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/226a2d3b-4a02-4dd8-821a-120b45481143-bundle\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:24:59.683778 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:59.683771 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/226a2d3b-4a02-4dd8-821a-120b45481143-util\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:24:59.683778 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:24:59.683781 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czpzc\" (UniqueName: \"kubernetes.io/projected/226a2d3b-4a02-4dd8-821a-120b45481143-kube-api-access-czpzc\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:25:00.280890 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:00.280847 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x" event={"ID":"226a2d3b-4a02-4dd8-821a-120b45481143","Type":"ContainerDied","Data":"c9d4f8097513b2dfbd325280924b6ac4cbc119244fe2bb8bffaec2b770847a80"} May 21 03:25:00.280890 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:00.280894 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9d4f8097513b2dfbd325280924b6ac4cbc119244fe2bb8bffaec2b770847a80" May 21 03:25:00.281099 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:00.280871 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqq69x" May 21 03:25:15.893202 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:15.893164 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq"] May 21 03:25:15.893778 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:15.893679 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="226a2d3b-4a02-4dd8-821a-120b45481143" containerName="util" May 21 03:25:15.893778 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:15.893705 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="226a2d3b-4a02-4dd8-821a-120b45481143" containerName="util" May 21 03:25:15.893778 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:15.893723 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="226a2d3b-4a02-4dd8-821a-120b45481143" containerName="extract" May 21 03:25:15.893778 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:15.893733 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="226a2d3b-4a02-4dd8-821a-120b45481143" containerName="extract" May 21 03:25:15.893778 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:15.893743 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="226a2d3b-4a02-4dd8-821a-120b45481143" containerName="pull" May 21 03:25:15.893778 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:15.893752 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="226a2d3b-4a02-4dd8-821a-120b45481143" containerName="pull" May 21 03:25:15.894066 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:15.893840 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="226a2d3b-4a02-4dd8-821a-120b45481143" containerName="extract" May 21 03:25:15.896361 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:15.896323 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:15.898850 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:15.898824 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 21 03:25:15.898991 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:15.898823 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 03:25:15.898991 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:15.898871 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-gwwcz\"" May 21 03:25:15.899097 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:15.898994 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 03:25:15.908118 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:15.908092 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq"] May 21 03:25:16.003945 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.003907 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.003945 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.003949 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.004172 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.003975 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.004172 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.004048 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.004172 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.004079 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.004172 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.004096 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4pzx\" (UniqueName: \"kubernetes.io/projected/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-kube-api-access-l4pzx\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.004172 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.004115 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.004328 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.004193 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.004328 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.004231 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.104942 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.104903 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.104942 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.104946 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.105160 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.105070 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.105160 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.105103 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l4pzx\" (UniqueName: \"kubernetes.io/projected/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-kube-api-access-l4pzx\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.105255 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.105238 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.105319 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.105303 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.105403 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.105339 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.105462 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.105425 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.105532 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.105459 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.105532 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.105491 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.105708 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.105645 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.105770 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.105706 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.105770 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.105724 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.105876 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.105816 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.107590 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.107566 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.107677 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.107614 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.112596 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.112566 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.112702 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.112682 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4pzx\" (UniqueName: \"kubernetes.io/projected/8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4-kube-api-access-l4pzx\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgctzq\" (UID: \"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.207581 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.207498 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:16.338991 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:16.338954 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq"] May 21 03:25:16.340560 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:25:16.340532 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8879e460_8d8e_4c5f_8761_3ed4b1e4d3f4.slice/crio-49cdc2067eed7bfbf1a85400aa65b68ef0c2a6d7c0005d17725394557df15fef WatchSource:0}: Error finding container 49cdc2067eed7bfbf1a85400aa65b68ef0c2a6d7c0005d17725394557df15fef: Status 404 returned error can't find the container with id 49cdc2067eed7bfbf1a85400aa65b68ef0c2a6d7c0005d17725394557df15fef May 21 03:25:17.341988 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:17.341948 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" event={"ID":"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4","Type":"ContainerStarted","Data":"49cdc2067eed7bfbf1a85400aa65b68ef0c2a6d7c0005d17725394557df15fef"} May 21 03:25:19.176418 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:19.176375 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} May 21 03:25:19.176794 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:19.176466 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} May 21 03:25:19.176794 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:19.176511 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} May 21 03:25:19.351496 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:19.351454 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" event={"ID":"8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4","Type":"ContainerStarted","Data":"6de4adc93ce8eab29cc908380226be5de8ecf0450c1a4b2557224429d84dd033"} May 21 03:25:19.370999 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:19.370947 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" podStartSLOduration=1.537498163 podStartE2EDuration="4.370932515s" podCreationTimestamp="2026-05-21 03:25:15 +0000 UTC" firstStartedPulling="2026-05-21 03:25:16.342671271 +0000 UTC m=+340.708891640" lastFinishedPulling="2026-05-21 03:25:19.176105619 +0000 UTC m=+343.542325992" observedRunningTime="2026-05-21 03:25:19.368665057 +0000 UTC m=+343.734885476" watchObservedRunningTime="2026-05-21 03:25:19.370932515 +0000 UTC m=+343.737152906" May 21 03:25:20.208372 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:20.208319 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:20.213106 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:20.213082 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:20.354983 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:20.354952 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:20.356142 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:20.356118 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgctzq" May 21 03:25:36.517140 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:36.517048 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cvwfk"] May 21 03:25:36.519994 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:36.519971 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cvwfk" May 21 03:25:36.522366 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:36.522330 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-xk5kp\"" May 21 03:25:36.522497 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:36.522330 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 03:25:36.523239 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:36.523224 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 03:25:36.530752 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:36.530725 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cvwfk"] May 21 03:25:36.583207 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:36.583167 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2scr\" (UniqueName: \"kubernetes.io/projected/47e99316-bf76-4071-a032-5f7c591d1564-kube-api-access-z2scr\") pod \"kuadrant-operator-catalog-cvwfk\" (UID: \"47e99316-bf76-4071-a032-5f7c591d1564\") " pod="kuadrant-system/kuadrant-operator-catalog-cvwfk" May 21 03:25:36.684117 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:36.684078 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z2scr\" (UniqueName: \"kubernetes.io/projected/47e99316-bf76-4071-a032-5f7c591d1564-kube-api-access-z2scr\") pod \"kuadrant-operator-catalog-cvwfk\" (UID: \"47e99316-bf76-4071-a032-5f7c591d1564\") " pod="kuadrant-system/kuadrant-operator-catalog-cvwfk" May 21 03:25:36.691783 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:36.691757 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2scr\" (UniqueName: \"kubernetes.io/projected/47e99316-bf76-4071-a032-5f7c591d1564-kube-api-access-z2scr\") pod \"kuadrant-operator-catalog-cvwfk\" (UID: \"47e99316-bf76-4071-a032-5f7c591d1564\") " pod="kuadrant-system/kuadrant-operator-catalog-cvwfk" May 21 03:25:36.831100 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:36.831058 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cvwfk" May 21 03:25:36.884989 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:36.884954 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cvwfk"] May 21 03:25:36.961941 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:36.961915 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cvwfk"] May 21 03:25:36.963918 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:25:36.963887 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e99316_bf76_4071_a032_5f7c591d1564.slice/crio-a6d3d499e97a52cbcedf156b419628167da88bb6505e4efbd766fb3f8a82e317 WatchSource:0}: Error finding container a6d3d499e97a52cbcedf156b419628167da88bb6505e4efbd766fb3f8a82e317: Status 404 returned error can't find the container with id a6d3d499e97a52cbcedf156b419628167da88bb6505e4efbd766fb3f8a82e317 May 21 03:25:37.092117 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:37.092038 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g7vp6"] May 21 03:25:37.095073 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:37.095057 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g7vp6" May 21 03:25:37.102052 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:37.102019 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g7vp6"] May 21 03:25:37.188775 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:37.188734 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h22rf\" (UniqueName: \"kubernetes.io/projected/03e0ec74-368e-45e5-8c04-b98fb2def8bf-kube-api-access-h22rf\") pod \"kuadrant-operator-catalog-g7vp6\" (UID: \"03e0ec74-368e-45e5-8c04-b98fb2def8bf\") " pod="kuadrant-system/kuadrant-operator-catalog-g7vp6" May 21 03:25:37.290198 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:37.290157 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h22rf\" (UniqueName: \"kubernetes.io/projected/03e0ec74-368e-45e5-8c04-b98fb2def8bf-kube-api-access-h22rf\") pod \"kuadrant-operator-catalog-g7vp6\" (UID: \"03e0ec74-368e-45e5-8c04-b98fb2def8bf\") " pod="kuadrant-system/kuadrant-operator-catalog-g7vp6" May 21 03:25:37.301205 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:37.301176 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h22rf\" (UniqueName: \"kubernetes.io/projected/03e0ec74-368e-45e5-8c04-b98fb2def8bf-kube-api-access-h22rf\") pod \"kuadrant-operator-catalog-g7vp6\" (UID: \"03e0ec74-368e-45e5-8c04-b98fb2def8bf\") " pod="kuadrant-system/kuadrant-operator-catalog-g7vp6" May 21 03:25:37.405436 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:37.405340 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g7vp6" May 21 03:25:37.418822 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:37.418778 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cvwfk" event={"ID":"47e99316-bf76-4071-a032-5f7c591d1564","Type":"ContainerStarted","Data":"a6d3d499e97a52cbcedf156b419628167da88bb6505e4efbd766fb3f8a82e317"} May 21 03:25:37.547544 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:37.547517 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g7vp6"] May 21 03:25:37.550388 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:25:37.550338 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e0ec74_368e_45e5_8c04_b98fb2def8bf.slice/crio-93b6139940c6dda13a36a8d471224109681ade67c7c4de366eb12c1693f11ae5 WatchSource:0}: Error finding container 93b6139940c6dda13a36a8d471224109681ade67c7c4de366eb12c1693f11ae5: Status 404 returned error can't find the container with id 93b6139940c6dda13a36a8d471224109681ade67c7c4de366eb12c1693f11ae5 May 21 03:25:38.424043 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:38.424003 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g7vp6" event={"ID":"03e0ec74-368e-45e5-8c04-b98fb2def8bf","Type":"ContainerStarted","Data":"93b6139940c6dda13a36a8d471224109681ade67c7c4de366eb12c1693f11ae5"} May 21 03:25:39.433695 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:39.433652 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g7vp6" event={"ID":"03e0ec74-368e-45e5-8c04-b98fb2def8bf","Type":"ContainerStarted","Data":"883a4065d6852d02ef6bba999076ac470219b106ab13b52d8b9ecc039cb4f7e8"} May 21 03:25:39.434958 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:39.434932 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cvwfk" event={"ID":"47e99316-bf76-4071-a032-5f7c591d1564","Type":"ContainerStarted","Data":"50654e10026eb722f08eba3f3e7dd404873318c35597186898eb6ce89a2ee611"} May 21 03:25:39.435088 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:39.435029 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-cvwfk" podUID="47e99316-bf76-4071-a032-5f7c591d1564" containerName="registry-server" containerID="cri-o://50654e10026eb722f08eba3f3e7dd404873318c35597186898eb6ce89a2ee611" gracePeriod=2 May 21 03:25:39.450445 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:39.450386 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-g7vp6" podStartSLOduration=1.010594651 podStartE2EDuration="2.450371458s" podCreationTimestamp="2026-05-21 03:25:37 +0000 UTC" firstStartedPulling="2026-05-21 03:25:37.55187579 +0000 UTC m=+361.918096161" lastFinishedPulling="2026-05-21 03:25:38.991652595 +0000 UTC m=+363.357872968" observedRunningTime="2026-05-21 03:25:39.448383512 +0000 UTC m=+363.814603904" watchObservedRunningTime="2026-05-21 03:25:39.450371458 +0000 UTC m=+363.816591882" May 21 03:25:39.462566 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:39.462520 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-cvwfk" podStartSLOduration=1.439227944 podStartE2EDuration="3.462505194s" podCreationTimestamp="2026-05-21 03:25:36 +0000 UTC" firstStartedPulling="2026-05-21 03:25:36.965485572 +0000 UTC m=+361.331705957" lastFinishedPulling="2026-05-21 03:25:38.988762833 +0000 UTC m=+363.354983207" observedRunningTime="2026-05-21 03:25:39.462200441 +0000 UTC m=+363.828420846" watchObservedRunningTime="2026-05-21 03:25:39.462505194 +0000 UTC m=+363.828725698" May 21 03:25:39.679797 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:39.679768 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cvwfk" May 21 03:25:39.811721 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:39.811681 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2scr\" (UniqueName: \"kubernetes.io/projected/47e99316-bf76-4071-a032-5f7c591d1564-kube-api-access-z2scr\") pod \"47e99316-bf76-4071-a032-5f7c591d1564\" (UID: \"47e99316-bf76-4071-a032-5f7c591d1564\") " May 21 03:25:39.813927 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:39.813902 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47e99316-bf76-4071-a032-5f7c591d1564-kube-api-access-z2scr" (OuterVolumeSpecName: "kube-api-access-z2scr") pod "47e99316-bf76-4071-a032-5f7c591d1564" (UID: "47e99316-bf76-4071-a032-5f7c591d1564"). InnerVolumeSpecName "kube-api-access-z2scr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:25:39.913161 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:39.913115 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2scr\" (UniqueName: \"kubernetes.io/projected/47e99316-bf76-4071-a032-5f7c591d1564-kube-api-access-z2scr\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:25:40.439526 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:40.439488 2575 generic.go:358] "Generic (PLEG): container finished" podID="47e99316-bf76-4071-a032-5f7c591d1564" containerID="50654e10026eb722f08eba3f3e7dd404873318c35597186898eb6ce89a2ee611" exitCode=0 May 21 03:25:40.439924 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:40.439545 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cvwfk" May 21 03:25:40.439924 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:40.439575 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cvwfk" event={"ID":"47e99316-bf76-4071-a032-5f7c591d1564","Type":"ContainerDied","Data":"50654e10026eb722f08eba3f3e7dd404873318c35597186898eb6ce89a2ee611"} May 21 03:25:40.439924 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:40.439616 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cvwfk" event={"ID":"47e99316-bf76-4071-a032-5f7c591d1564","Type":"ContainerDied","Data":"a6d3d499e97a52cbcedf156b419628167da88bb6505e4efbd766fb3f8a82e317"} May 21 03:25:40.439924 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:40.439635 2575 scope.go:117] "RemoveContainer" containerID="50654e10026eb722f08eba3f3e7dd404873318c35597186898eb6ce89a2ee611" May 21 03:25:40.448317 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:40.448288 2575 scope.go:117] "RemoveContainer" containerID="50654e10026eb722f08eba3f3e7dd404873318c35597186898eb6ce89a2ee611" May 21 03:25:40.448603 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:25:40.448584 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50654e10026eb722f08eba3f3e7dd404873318c35597186898eb6ce89a2ee611\": container with ID starting with 50654e10026eb722f08eba3f3e7dd404873318c35597186898eb6ce89a2ee611 not found: ID does not exist" containerID="50654e10026eb722f08eba3f3e7dd404873318c35597186898eb6ce89a2ee611" May 21 03:25:40.448666 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:40.448613 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50654e10026eb722f08eba3f3e7dd404873318c35597186898eb6ce89a2ee611"} err="failed to get container status \"50654e10026eb722f08eba3f3e7dd404873318c35597186898eb6ce89a2ee611\": rpc error: code = NotFound desc = could not find container \"50654e10026eb722f08eba3f3e7dd404873318c35597186898eb6ce89a2ee611\": container with ID starting with 50654e10026eb722f08eba3f3e7dd404873318c35597186898eb6ce89a2ee611 not found: ID does not exist" May 21 03:25:40.455894 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:40.455870 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cvwfk"] May 21 03:25:40.461786 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:40.461763 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cvwfk"] May 21 03:25:42.205040 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:42.205003 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47e99316-bf76-4071-a032-5f7c591d1564" path="/var/lib/kubelet/pods/47e99316-bf76-4071-a032-5f7c591d1564/volumes" May 21 03:25:47.406449 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:47.406411 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-g7vp6" May 21 03:25:47.406449 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:47.406452 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-g7vp6" May 21 03:25:47.427888 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:47.427861 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-g7vp6" May 21 03:25:47.485846 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:47.485810 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-g7vp6" May 21 03:25:51.654303 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:51.654261 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk"] May 21 03:25:51.654809 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:51.654710 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47e99316-bf76-4071-a032-5f7c591d1564" containerName="registry-server" May 21 03:25:51.654809 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:51.654730 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="47e99316-bf76-4071-a032-5f7c591d1564" containerName="registry-server" May 21 03:25:51.654809 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:51.654803 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="47e99316-bf76-4071-a032-5f7c591d1564" containerName="registry-server" May 21 03:25:51.661011 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:51.660984 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk" May 21 03:25:51.663344 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:51.663320 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2trq2\"" May 21 03:25:51.663684 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:51.663664 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk"] May 21 03:25:51.816629 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:51.816596 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jh9f\" (UniqueName: \"kubernetes.io/projected/a57742d5-c427-4885-93b1-a933a4938c61-kube-api-access-7jh9f\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk\" (UID: \"a57742d5-c427-4885-93b1-a933a4938c61\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk" May 21 03:25:51.816824 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:51.816667 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a57742d5-c427-4885-93b1-a933a4938c61-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk\" (UID: \"a57742d5-c427-4885-93b1-a933a4938c61\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk" May 21 03:25:51.816824 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:51.816692 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a57742d5-c427-4885-93b1-a933a4938c61-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk\" (UID: \"a57742d5-c427-4885-93b1-a933a4938c61\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk" May 21 03:25:51.917749 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:51.917656 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7jh9f\" (UniqueName: \"kubernetes.io/projected/a57742d5-c427-4885-93b1-a933a4938c61-kube-api-access-7jh9f\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk\" (UID: \"a57742d5-c427-4885-93b1-a933a4938c61\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk" May 21 03:25:51.917904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:51.917808 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a57742d5-c427-4885-93b1-a933a4938c61-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk\" (UID: \"a57742d5-c427-4885-93b1-a933a4938c61\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk" May 21 03:25:51.917904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:51.917827 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a57742d5-c427-4885-93b1-a933a4938c61-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk\" (UID: \"a57742d5-c427-4885-93b1-a933a4938c61\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk" May 21 03:25:51.918150 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:51.918135 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a57742d5-c427-4885-93b1-a933a4938c61-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk\" (UID: \"a57742d5-c427-4885-93b1-a933a4938c61\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk" May 21 03:25:51.918202 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:51.918181 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a57742d5-c427-4885-93b1-a933a4938c61-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk\" (UID: \"a57742d5-c427-4885-93b1-a933a4938c61\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk" May 21 03:25:51.925230 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:51.925210 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jh9f\" (UniqueName: \"kubernetes.io/projected/a57742d5-c427-4885-93b1-a933a4938c61-kube-api-access-7jh9f\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk\" (UID: \"a57742d5-c427-4885-93b1-a933a4938c61\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk" May 21 03:25:51.971892 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:51.971857 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk" May 21 03:25:52.053552 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.053526 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6"] May 21 03:25:52.060064 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.060035 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6" May 21 03:25:52.069949 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.069916 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6"] May 21 03:25:52.107816 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.107783 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk"] May 21 03:25:52.114493 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:25:52.114465 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda57742d5_c427_4885_93b1_a933a4938c61.slice/crio-7649fcbb08a261ecfb3a21ba045a90355b51a9682c747104590625e6f70c648c WatchSource:0}: Error finding container 7649fcbb08a261ecfb3a21ba045a90355b51a9682c747104590625e6f70c648c: Status 404 returned error can't find the container with id 7649fcbb08a261ecfb3a21ba045a90355b51a9682c747104590625e6f70c648c May 21 03:25:52.221007 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.220973 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49prw\" (UniqueName: \"kubernetes.io/projected/270b1265-4a50-4d19-9c0a-fb334622b2e8-kube-api-access-49prw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6\" (UID: \"270b1265-4a50-4d19-9c0a-fb334622b2e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6" May 21 03:25:52.221157 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.221037 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/270b1265-4a50-4d19-9c0a-fb334622b2e8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6\" (UID: \"270b1265-4a50-4d19-9c0a-fb334622b2e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6" May 21 03:25:52.221157 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.221111 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/270b1265-4a50-4d19-9c0a-fb334622b2e8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6\" (UID: \"270b1265-4a50-4d19-9c0a-fb334622b2e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6" May 21 03:25:52.322013 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.321973 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/270b1265-4a50-4d19-9c0a-fb334622b2e8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6\" (UID: \"270b1265-4a50-4d19-9c0a-fb334622b2e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6" May 21 03:25:52.322185 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.322019 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/270b1265-4a50-4d19-9c0a-fb334622b2e8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6\" (UID: \"270b1265-4a50-4d19-9c0a-fb334622b2e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6" May 21 03:25:52.322185 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.322062 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-49prw\" (UniqueName: \"kubernetes.io/projected/270b1265-4a50-4d19-9c0a-fb334622b2e8-kube-api-access-49prw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6\" (UID: \"270b1265-4a50-4d19-9c0a-fb334622b2e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6" May 21 03:25:52.322476 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.322450 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/270b1265-4a50-4d19-9c0a-fb334622b2e8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6\" (UID: \"270b1265-4a50-4d19-9c0a-fb334622b2e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6" May 21 03:25:52.322515 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.322457 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/270b1265-4a50-4d19-9c0a-fb334622b2e8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6\" (UID: \"270b1265-4a50-4d19-9c0a-fb334622b2e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6" May 21 03:25:52.329888 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.329863 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49prw\" (UniqueName: \"kubernetes.io/projected/270b1265-4a50-4d19-9c0a-fb334622b2e8-kube-api-access-49prw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6\" (UID: \"270b1265-4a50-4d19-9c0a-fb334622b2e8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6" May 21 03:25:52.382826 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.382787 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6" May 21 03:25:52.483146 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.483108 2575 generic.go:358] "Generic (PLEG): container finished" podID="a57742d5-c427-4885-93b1-a933a4938c61" containerID="6a6f6114e5a90b13e1c6c13e00ddb804af9aaa4bcdd6f4f581dca421fae62e44" exitCode=0 May 21 03:25:52.483321 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.483162 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk" event={"ID":"a57742d5-c427-4885-93b1-a933a4938c61","Type":"ContainerDied","Data":"6a6f6114e5a90b13e1c6c13e00ddb804af9aaa4bcdd6f4f581dca421fae62e44"} May 21 03:25:52.483321 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.483190 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk" event={"ID":"a57742d5-c427-4885-93b1-a933a4938c61","Type":"ContainerStarted","Data":"7649fcbb08a261ecfb3a21ba045a90355b51a9682c747104590625e6f70c648c"} May 21 03:25:52.543172 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.543144 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6"] May 21 03:25:52.545107 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:25:52.545077 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod270b1265_4a50_4d19_9c0a_fb334622b2e8.slice/crio-81292be0189c207e82afe2e1f0e71c00268370d7fa93caf9db5045e533cf9716 WatchSource:0}: Error finding container 81292be0189c207e82afe2e1f0e71c00268370d7fa93caf9db5045e533cf9716: Status 404 returned error can't find the container with id 81292be0189c207e82afe2e1f0e71c00268370d7fa93caf9db5045e533cf9716 May 21 03:25:52.655051 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.655022 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd"] May 21 03:25:52.658404 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.658387 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd" May 21 03:25:52.664966 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.664940 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd"] May 21 03:25:52.828337 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.828296 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/514003f1-3abe-42fc-9367-7ff3a74b0d7b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd\" (UID: \"514003f1-3abe-42fc-9367-7ff3a74b0d7b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd" May 21 03:25:52.828583 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.828383 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/514003f1-3abe-42fc-9367-7ff3a74b0d7b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd\" (UID: \"514003f1-3abe-42fc-9367-7ff3a74b0d7b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd" May 21 03:25:52.828583 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.828416 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhf2m\" (UniqueName: \"kubernetes.io/projected/514003f1-3abe-42fc-9367-7ff3a74b0d7b-kube-api-access-mhf2m\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd\" (UID: \"514003f1-3abe-42fc-9367-7ff3a74b0d7b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd" May 21 03:25:52.929642 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.929606 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/514003f1-3abe-42fc-9367-7ff3a74b0d7b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd\" (UID: \"514003f1-3abe-42fc-9367-7ff3a74b0d7b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd" May 21 03:25:52.929821 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.929662 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mhf2m\" (UniqueName: \"kubernetes.io/projected/514003f1-3abe-42fc-9367-7ff3a74b0d7b-kube-api-access-mhf2m\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd\" (UID: \"514003f1-3abe-42fc-9367-7ff3a74b0d7b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd" May 21 03:25:52.929821 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.929759 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/514003f1-3abe-42fc-9367-7ff3a74b0d7b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd\" (UID: \"514003f1-3abe-42fc-9367-7ff3a74b0d7b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd" May 21 03:25:52.930020 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.930001 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/514003f1-3abe-42fc-9367-7ff3a74b0d7b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd\" (UID: \"514003f1-3abe-42fc-9367-7ff3a74b0d7b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd" May 21 03:25:52.930094 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.930067 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/514003f1-3abe-42fc-9367-7ff3a74b0d7b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd\" (UID: \"514003f1-3abe-42fc-9367-7ff3a74b0d7b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd" May 21 03:25:52.937832 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:52.937805 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhf2m\" (UniqueName: \"kubernetes.io/projected/514003f1-3abe-42fc-9367-7ff3a74b0d7b-kube-api-access-mhf2m\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd\" (UID: \"514003f1-3abe-42fc-9367-7ff3a74b0d7b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd" May 21 03:25:53.004613 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:53.004520 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd" May 21 03:25:53.138672 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:53.138646 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd"] May 21 03:25:53.212729 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:25:53.212696 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod514003f1_3abe_42fc_9367_7ff3a74b0d7b.slice/crio-66921e4ce30f56135433cae6444ca45d7e61f2af0d712d97f6b21ea1560f5a57 WatchSource:0}: Error finding container 66921e4ce30f56135433cae6444ca45d7e61f2af0d712d97f6b21ea1560f5a57: Status 404 returned error can't find the container with id 66921e4ce30f56135433cae6444ca45d7e61f2af0d712d97f6b21ea1560f5a57 May 21 03:25:53.254105 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:53.254078 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24"] May 21 03:25:53.257706 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:53.257682 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24" May 21 03:25:53.269133 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:53.269109 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24"] May 21 03:25:53.434047 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:53.434006 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e98ac779-339f-4be7-9e16-71018f21d7e4-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24\" (UID: \"e98ac779-339f-4be7-9e16-71018f21d7e4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24" May 21 03:25:53.434211 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:53.434102 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e98ac779-339f-4be7-9e16-71018f21d7e4-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24\" (UID: \"e98ac779-339f-4be7-9e16-71018f21d7e4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24" May 21 03:25:53.434211 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:53.434163 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzw6p\" (UniqueName: \"kubernetes.io/projected/e98ac779-339f-4be7-9e16-71018f21d7e4-kube-api-access-gzw6p\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24\" (UID: \"e98ac779-339f-4be7-9e16-71018f21d7e4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24" May 21 03:25:53.488408 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:53.488341 2575 generic.go:358] "Generic (PLEG): container finished" podID="270b1265-4a50-4d19-9c0a-fb334622b2e8" containerID="4475ef892332be8616df688d15afb5b3a67e40c3e89bb2262e484a5ae23c5b8f" exitCode=0 May 21 03:25:53.488408 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:53.488390 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6" event={"ID":"270b1265-4a50-4d19-9c0a-fb334622b2e8","Type":"ContainerDied","Data":"4475ef892332be8616df688d15afb5b3a67e40c3e89bb2262e484a5ae23c5b8f"} May 21 03:25:53.488648 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:53.488421 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6" event={"ID":"270b1265-4a50-4d19-9c0a-fb334622b2e8","Type":"ContainerStarted","Data":"81292be0189c207e82afe2e1f0e71c00268370d7fa93caf9db5045e533cf9716"} May 21 03:25:53.490212 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:53.490184 2575 generic.go:358] "Generic (PLEG): container finished" podID="a57742d5-c427-4885-93b1-a933a4938c61" containerID="61b296c98489fce3f720f2315f7109d250b1f241db1bb4521fd0aee63b78f3d3" exitCode=0 May 21 03:25:53.490337 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:53.490271 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk" event={"ID":"a57742d5-c427-4885-93b1-a933a4938c61","Type":"ContainerDied","Data":"61b296c98489fce3f720f2315f7109d250b1f241db1bb4521fd0aee63b78f3d3"} May 21 03:25:53.491768 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:53.491742 2575 generic.go:358] "Generic (PLEG): container finished" podID="514003f1-3abe-42fc-9367-7ff3a74b0d7b" containerID="188756f3674864dbd09609b143030fffe185c795a674e55bb7e38ab0e30e9119" exitCode=0 May 21 03:25:53.491893 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:53.491804 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd" event={"ID":"514003f1-3abe-42fc-9367-7ff3a74b0d7b","Type":"ContainerDied","Data":"188756f3674864dbd09609b143030fffe185c795a674e55bb7e38ab0e30e9119"} May 21 03:25:53.491893 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:53.491824 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd" event={"ID":"514003f1-3abe-42fc-9367-7ff3a74b0d7b","Type":"ContainerStarted","Data":"66921e4ce30f56135433cae6444ca45d7e61f2af0d712d97f6b21ea1560f5a57"} May 21 03:25:53.534560 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:53.534531 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzw6p\" (UniqueName: \"kubernetes.io/projected/e98ac779-339f-4be7-9e16-71018f21d7e4-kube-api-access-gzw6p\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24\" (UID: \"e98ac779-339f-4be7-9e16-71018f21d7e4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24" May 21 03:25:53.534712 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:53.534582 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e98ac779-339f-4be7-9e16-71018f21d7e4-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24\" (UID: \"e98ac779-339f-4be7-9e16-71018f21d7e4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24" May 21 03:25:53.534712 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:53.534630 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e98ac779-339f-4be7-9e16-71018f21d7e4-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24\" (UID: \"e98ac779-339f-4be7-9e16-71018f21d7e4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24" May 21 03:25:53.535089 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:53.535065 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e98ac779-339f-4be7-9e16-71018f21d7e4-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24\" (UID: \"e98ac779-339f-4be7-9e16-71018f21d7e4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24" May 21 03:25:53.535134 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:53.535078 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e98ac779-339f-4be7-9e16-71018f21d7e4-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24\" (UID: \"e98ac779-339f-4be7-9e16-71018f21d7e4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24" May 21 03:25:53.541987 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:53.541963 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzw6p\" (UniqueName: \"kubernetes.io/projected/e98ac779-339f-4be7-9e16-71018f21d7e4-kube-api-access-gzw6p\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24\" (UID: \"e98ac779-339f-4be7-9e16-71018f21d7e4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24" May 21 03:25:53.567705 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:53.567676 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24" May 21 03:25:53.701425 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:53.701398 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24"] May 21 03:25:53.703021 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:25:53.702983 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode98ac779_339f_4be7_9e16_71018f21d7e4.slice/crio-9e0e1ee7e749eb237a03b64238333efc3f9dfdfb94c955f05fe785b95a355fda WatchSource:0}: Error finding container 9e0e1ee7e749eb237a03b64238333efc3f9dfdfb94c955f05fe785b95a355fda: Status 404 returned error can't find the container with id 9e0e1ee7e749eb237a03b64238333efc3f9dfdfb94c955f05fe785b95a355fda May 21 03:25:54.497614 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:54.497518 2575 generic.go:358] "Generic (PLEG): container finished" podID="a57742d5-c427-4885-93b1-a933a4938c61" containerID="f4cb1834e47caa6849f3825a4be31b3aaacac98748f82b5477d6434704ef2e7c" exitCode=0 May 21 03:25:54.497804 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:54.497765 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk" event={"ID":"a57742d5-c427-4885-93b1-a933a4938c61","Type":"ContainerDied","Data":"f4cb1834e47caa6849f3825a4be31b3aaacac98748f82b5477d6434704ef2e7c"} May 21 03:25:54.499265 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:54.499236 2575 generic.go:358] "Generic (PLEG): container finished" podID="e98ac779-339f-4be7-9e16-71018f21d7e4" containerID="8bb7053efdc68e89003de558b85be3429ef8bee0108fd26a775bfd70466f254f" exitCode=0 May 21 03:25:54.499405 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:54.499306 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24" event={"ID":"e98ac779-339f-4be7-9e16-71018f21d7e4","Type":"ContainerDied","Data":"8bb7053efdc68e89003de558b85be3429ef8bee0108fd26a775bfd70466f254f"} May 21 03:25:54.499405 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:54.499336 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24" event={"ID":"e98ac779-339f-4be7-9e16-71018f21d7e4","Type":"ContainerStarted","Data":"9e0e1ee7e749eb237a03b64238333efc3f9dfdfb94c955f05fe785b95a355fda"} May 21 03:25:54.501280 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:54.501257 2575 generic.go:358] "Generic (PLEG): container finished" podID="514003f1-3abe-42fc-9367-7ff3a74b0d7b" containerID="798b1c8254ad4150cb06d00401466e5440176d2b27f8fe9e9f67e0e0fe8da07b" exitCode=0 May 21 03:25:54.501408 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:54.501284 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd" event={"ID":"514003f1-3abe-42fc-9367-7ff3a74b0d7b","Type":"ContainerDied","Data":"798b1c8254ad4150cb06d00401466e5440176d2b27f8fe9e9f67e0e0fe8da07b"} May 21 03:25:54.503714 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:54.503285 2575 generic.go:358] "Generic (PLEG): container finished" podID="270b1265-4a50-4d19-9c0a-fb334622b2e8" containerID="5e3b502eccfc3c7deaa8e06018bffbaceb3ba3511521073147df2b476416ae28" exitCode=0 May 21 03:25:54.503714 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:54.503408 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6" event={"ID":"270b1265-4a50-4d19-9c0a-fb334622b2e8","Type":"ContainerDied","Data":"5e3b502eccfc3c7deaa8e06018bffbaceb3ba3511521073147df2b476416ae28"} May 21 03:25:55.508713 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:55.508614 2575 generic.go:358] "Generic (PLEG): container finished" podID="270b1265-4a50-4d19-9c0a-fb334622b2e8" containerID="ec6fb1b10be6f842e6875b141abb810349f9fab8176612dca23913e01b1cbde2" exitCode=0 May 21 03:25:55.509127 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:55.508705 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6" event={"ID":"270b1265-4a50-4d19-9c0a-fb334622b2e8","Type":"ContainerDied","Data":"ec6fb1b10be6f842e6875b141abb810349f9fab8176612dca23913e01b1cbde2"} May 21 03:25:55.510338 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:55.510300 2575 generic.go:358] "Generic (PLEG): container finished" podID="e98ac779-339f-4be7-9e16-71018f21d7e4" containerID="8a698318b2cb3688bd13fd3e14ae205620ae667526d2dbb44e2e38dc25577b85" exitCode=0 May 21 03:25:55.510494 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:55.510384 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24" event={"ID":"e98ac779-339f-4be7-9e16-71018f21d7e4","Type":"ContainerDied","Data":"8a698318b2cb3688bd13fd3e14ae205620ae667526d2dbb44e2e38dc25577b85"} May 21 03:25:55.512222 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:55.512198 2575 generic.go:358] "Generic (PLEG): container finished" podID="514003f1-3abe-42fc-9367-7ff3a74b0d7b" containerID="15754ef2cf7c32cea3603a41ad5fa4271b28b023aff89083296a3a7490eddb98" exitCode=0 May 21 03:25:55.512326 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:55.512226 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd" event={"ID":"514003f1-3abe-42fc-9367-7ff3a74b0d7b","Type":"ContainerDied","Data":"15754ef2cf7c32cea3603a41ad5fa4271b28b023aff89083296a3a7490eddb98"} May 21 03:25:55.700202 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:55.700177 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk" May 21 03:25:55.853080 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:55.853052 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jh9f\" (UniqueName: \"kubernetes.io/projected/a57742d5-c427-4885-93b1-a933a4938c61-kube-api-access-7jh9f\") pod \"a57742d5-c427-4885-93b1-a933a4938c61\" (UID: \"a57742d5-c427-4885-93b1-a933a4938c61\") " May 21 03:25:55.853264 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:55.853107 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a57742d5-c427-4885-93b1-a933a4938c61-util\") pod \"a57742d5-c427-4885-93b1-a933a4938c61\" (UID: \"a57742d5-c427-4885-93b1-a933a4938c61\") " May 21 03:25:55.853264 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:55.853189 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a57742d5-c427-4885-93b1-a933a4938c61-bundle\") pod \"a57742d5-c427-4885-93b1-a933a4938c61\" (UID: \"a57742d5-c427-4885-93b1-a933a4938c61\") " May 21 03:25:55.853757 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:55.853727 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a57742d5-c427-4885-93b1-a933a4938c61-bundle" (OuterVolumeSpecName: "bundle") pod "a57742d5-c427-4885-93b1-a933a4938c61" (UID: "a57742d5-c427-4885-93b1-a933a4938c61"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:25:55.855289 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:55.855261 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a57742d5-c427-4885-93b1-a933a4938c61-kube-api-access-7jh9f" (OuterVolumeSpecName: "kube-api-access-7jh9f") pod "a57742d5-c427-4885-93b1-a933a4938c61" (UID: "a57742d5-c427-4885-93b1-a933a4938c61"). InnerVolumeSpecName "kube-api-access-7jh9f". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:25:55.859377 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:55.859337 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a57742d5-c427-4885-93b1-a933a4938c61-util" (OuterVolumeSpecName: "util") pod "a57742d5-c427-4885-93b1-a933a4938c61" (UID: "a57742d5-c427-4885-93b1-a933a4938c61"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:25:55.954281 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:55.954239 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a57742d5-c427-4885-93b1-a933a4938c61-util\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:25:55.954281 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:55.954274 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a57742d5-c427-4885-93b1-a933a4938c61-bundle\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:25:55.954281 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:55.954284 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jh9f\" (UniqueName: \"kubernetes.io/projected/a57742d5-c427-4885-93b1-a933a4938c61-kube-api-access-7jh9f\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:25:56.517738 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.517655 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk" May 21 03:25:56.518127 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.517652 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk" event={"ID":"a57742d5-c427-4885-93b1-a933a4938c61","Type":"ContainerDied","Data":"7649fcbb08a261ecfb3a21ba045a90355b51a9682c747104590625e6f70c648c"} May 21 03:25:56.518127 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.517776 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7649fcbb08a261ecfb3a21ba045a90355b51a9682c747104590625e6f70c648c" May 21 03:25:56.519749 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.519718 2575 generic.go:358] "Generic (PLEG): container finished" podID="e98ac779-339f-4be7-9e16-71018f21d7e4" containerID="97b4a966e70f72edea7e48c3c02a32ecdcccbe4987a31b1e69becd491bec6e4d" exitCode=0 May 21 03:25:56.519901 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.519871 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24" event={"ID":"e98ac779-339f-4be7-9e16-71018f21d7e4","Type":"ContainerDied","Data":"97b4a966e70f72edea7e48c3c02a32ecdcccbe4987a31b1e69becd491bec6e4d"} May 21 03:25:56.653167 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.653142 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6" May 21 03:25:56.677615 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.677588 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd" May 21 03:25:56.759445 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.759412 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/270b1265-4a50-4d19-9c0a-fb334622b2e8-util\") pod \"270b1265-4a50-4d19-9c0a-fb334622b2e8\" (UID: \"270b1265-4a50-4d19-9c0a-fb334622b2e8\") " May 21 03:25:56.759646 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.759487 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49prw\" (UniqueName: \"kubernetes.io/projected/270b1265-4a50-4d19-9c0a-fb334622b2e8-kube-api-access-49prw\") pod \"270b1265-4a50-4d19-9c0a-fb334622b2e8\" (UID: \"270b1265-4a50-4d19-9c0a-fb334622b2e8\") " May 21 03:25:56.759646 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.759513 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/270b1265-4a50-4d19-9c0a-fb334622b2e8-bundle\") pod \"270b1265-4a50-4d19-9c0a-fb334622b2e8\" (UID: \"270b1265-4a50-4d19-9c0a-fb334622b2e8\") " May 21 03:25:56.760198 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.760156 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/270b1265-4a50-4d19-9c0a-fb334622b2e8-bundle" (OuterVolumeSpecName: "bundle") pod "270b1265-4a50-4d19-9c0a-fb334622b2e8" (UID: "270b1265-4a50-4d19-9c0a-fb334622b2e8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:25:56.761650 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.761629 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/270b1265-4a50-4d19-9c0a-fb334622b2e8-kube-api-access-49prw" (OuterVolumeSpecName: "kube-api-access-49prw") pod "270b1265-4a50-4d19-9c0a-fb334622b2e8" (UID: "270b1265-4a50-4d19-9c0a-fb334622b2e8"). InnerVolumeSpecName "kube-api-access-49prw". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:25:56.765034 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.765001 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/270b1265-4a50-4d19-9c0a-fb334622b2e8-util" (OuterVolumeSpecName: "util") pod "270b1265-4a50-4d19-9c0a-fb334622b2e8" (UID: "270b1265-4a50-4d19-9c0a-fb334622b2e8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:25:56.860532 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.860497 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/514003f1-3abe-42fc-9367-7ff3a74b0d7b-bundle\") pod \"514003f1-3abe-42fc-9367-7ff3a74b0d7b\" (UID: \"514003f1-3abe-42fc-9367-7ff3a74b0d7b\") " May 21 03:25:56.860685 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.860597 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/514003f1-3abe-42fc-9367-7ff3a74b0d7b-util\") pod \"514003f1-3abe-42fc-9367-7ff3a74b0d7b\" (UID: \"514003f1-3abe-42fc-9367-7ff3a74b0d7b\") " May 21 03:25:56.860685 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.860633 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhf2m\" (UniqueName: \"kubernetes.io/projected/514003f1-3abe-42fc-9367-7ff3a74b0d7b-kube-api-access-mhf2m\") pod \"514003f1-3abe-42fc-9367-7ff3a74b0d7b\" (UID: \"514003f1-3abe-42fc-9367-7ff3a74b0d7b\") " May 21 03:25:56.860900 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.860882 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/270b1265-4a50-4d19-9c0a-fb334622b2e8-util\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:25:56.860989 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.860907 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49prw\" (UniqueName: \"kubernetes.io/projected/270b1265-4a50-4d19-9c0a-fb334622b2e8-kube-api-access-49prw\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:25:56.860989 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.860924 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/270b1265-4a50-4d19-9c0a-fb334622b2e8-bundle\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:25:56.861088 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.861066 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/514003f1-3abe-42fc-9367-7ff3a74b0d7b-bundle" (OuterVolumeSpecName: "bundle") pod "514003f1-3abe-42fc-9367-7ff3a74b0d7b" (UID: "514003f1-3abe-42fc-9367-7ff3a74b0d7b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:25:56.862703 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.862678 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/514003f1-3abe-42fc-9367-7ff3a74b0d7b-kube-api-access-mhf2m" (OuterVolumeSpecName: "kube-api-access-mhf2m") pod "514003f1-3abe-42fc-9367-7ff3a74b0d7b" (UID: "514003f1-3abe-42fc-9367-7ff3a74b0d7b"). InnerVolumeSpecName "kube-api-access-mhf2m". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:25:56.865594 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.865572 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/514003f1-3abe-42fc-9367-7ff3a74b0d7b-util" (OuterVolumeSpecName: "util") pod "514003f1-3abe-42fc-9367-7ff3a74b0d7b" (UID: "514003f1-3abe-42fc-9367-7ff3a74b0d7b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:25:56.961654 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.961622 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/514003f1-3abe-42fc-9367-7ff3a74b0d7b-util\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:25:56.961654 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.961653 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhf2m\" (UniqueName: \"kubernetes.io/projected/514003f1-3abe-42fc-9367-7ff3a74b0d7b-kube-api-access-mhf2m\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:25:56.961848 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:56.961664 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/514003f1-3abe-42fc-9367-7ff3a74b0d7b-bundle\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:25:57.524820 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:57.524780 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6" event={"ID":"270b1265-4a50-4d19-9c0a-fb334622b2e8","Type":"ContainerDied","Data":"81292be0189c207e82afe2e1f0e71c00268370d7fa93caf9db5045e533cf9716"} May 21 03:25:57.524820 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:57.524822 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81292be0189c207e82afe2e1f0e71c00268370d7fa93caf9db5045e533cf9716" May 21 03:25:57.525273 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:57.524794 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6" May 21 03:25:57.526451 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:57.526419 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd" event={"ID":"514003f1-3abe-42fc-9367-7ff3a74b0d7b","Type":"ContainerDied","Data":"66921e4ce30f56135433cae6444ca45d7e61f2af0d712d97f6b21ea1560f5a57"} May 21 03:25:57.526451 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:57.526448 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66921e4ce30f56135433cae6444ca45d7e61f2af0d712d97f6b21ea1560f5a57" May 21 03:25:57.526619 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:57.526503 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd" May 21 03:25:57.653928 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:57.653903 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24" May 21 03:25:57.667273 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:57.667248 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e98ac779-339f-4be7-9e16-71018f21d7e4-util\") pod \"e98ac779-339f-4be7-9e16-71018f21d7e4\" (UID: \"e98ac779-339f-4be7-9e16-71018f21d7e4\") " May 21 03:25:57.667430 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:57.667319 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzw6p\" (UniqueName: \"kubernetes.io/projected/e98ac779-339f-4be7-9e16-71018f21d7e4-kube-api-access-gzw6p\") pod \"e98ac779-339f-4be7-9e16-71018f21d7e4\" (UID: \"e98ac779-339f-4be7-9e16-71018f21d7e4\") " May 21 03:25:57.667510 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:57.667493 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e98ac779-339f-4be7-9e16-71018f21d7e4-bundle\") pod \"e98ac779-339f-4be7-9e16-71018f21d7e4\" (UID: \"e98ac779-339f-4be7-9e16-71018f21d7e4\") " May 21 03:25:57.667944 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:57.667915 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e98ac779-339f-4be7-9e16-71018f21d7e4-bundle" (OuterVolumeSpecName: "bundle") pod "e98ac779-339f-4be7-9e16-71018f21d7e4" (UID: "e98ac779-339f-4be7-9e16-71018f21d7e4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:25:57.669396 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:57.669322 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e98ac779-339f-4be7-9e16-71018f21d7e4-kube-api-access-gzw6p" (OuterVolumeSpecName: "kube-api-access-gzw6p") pod "e98ac779-339f-4be7-9e16-71018f21d7e4" (UID: "e98ac779-339f-4be7-9e16-71018f21d7e4"). InnerVolumeSpecName "kube-api-access-gzw6p". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:25:57.674613 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:57.674582 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e98ac779-339f-4be7-9e16-71018f21d7e4-util" (OuterVolumeSpecName: "util") pod "e98ac779-339f-4be7-9e16-71018f21d7e4" (UID: "e98ac779-339f-4be7-9e16-71018f21d7e4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:25:57.768423 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:57.768383 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e98ac779-339f-4be7-9e16-71018f21d7e4-util\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:25:57.768423 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:57.768413 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzw6p\" (UniqueName: \"kubernetes.io/projected/e98ac779-339f-4be7-9e16-71018f21d7e4-kube-api-access-gzw6p\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:25:57.768423 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:57.768424 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e98ac779-339f-4be7-9e16-71018f21d7e4-bundle\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:25:58.532526 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:58.532438 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24" May 21 03:25:58.532920 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:58.532438 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24" event={"ID":"e98ac779-339f-4be7-9e16-71018f21d7e4","Type":"ContainerDied","Data":"9e0e1ee7e749eb237a03b64238333efc3f9dfdfb94c955f05fe785b95a355fda"} May 21 03:25:58.532920 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:25:58.532555 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e0e1ee7e749eb237a03b64238333efc3f9dfdfb94c955f05fe785b95a355fda" May 21 03:26:09.690257 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690216 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8"] May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690545 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a57742d5-c427-4885-93b1-a933a4938c61" containerName="pull" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690556 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a57742d5-c427-4885-93b1-a933a4938c61" containerName="pull" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690570 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e98ac779-339f-4be7-9e16-71018f21d7e4" containerName="util" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690575 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e98ac779-339f-4be7-9e16-71018f21d7e4" containerName="util" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690581 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="514003f1-3abe-42fc-9367-7ff3a74b0d7b" containerName="extract" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690587 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="514003f1-3abe-42fc-9367-7ff3a74b0d7b" containerName="extract" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690597 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="514003f1-3abe-42fc-9367-7ff3a74b0d7b" containerName="util" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690602 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="514003f1-3abe-42fc-9367-7ff3a74b0d7b" containerName="util" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690610 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="270b1265-4a50-4d19-9c0a-fb334622b2e8" containerName="util" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690614 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="270b1265-4a50-4d19-9c0a-fb334622b2e8" containerName="util" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690621 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="270b1265-4a50-4d19-9c0a-fb334622b2e8" containerName="pull" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690626 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="270b1265-4a50-4d19-9c0a-fb334622b2e8" containerName="pull" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690631 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="514003f1-3abe-42fc-9367-7ff3a74b0d7b" containerName="pull" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690636 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="514003f1-3abe-42fc-9367-7ff3a74b0d7b" containerName="pull" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690642 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e98ac779-339f-4be7-9e16-71018f21d7e4" containerName="extract" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690647 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e98ac779-339f-4be7-9e16-71018f21d7e4" containerName="extract" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690654 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a57742d5-c427-4885-93b1-a933a4938c61" containerName="util" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690659 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a57742d5-c427-4885-93b1-a933a4938c61" containerName="util" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690663 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a57742d5-c427-4885-93b1-a933a4938c61" containerName="extract" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690668 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a57742d5-c427-4885-93b1-a933a4938c61" containerName="extract" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690673 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="270b1265-4a50-4d19-9c0a-fb334622b2e8" containerName="extract" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690677 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="270b1265-4a50-4d19-9c0a-fb334622b2e8" containerName="extract" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690683 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e98ac779-339f-4be7-9e16-71018f21d7e4" containerName="pull" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690688 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e98ac779-339f-4be7-9e16-71018f21d7e4" containerName="pull" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690731 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="a57742d5-c427-4885-93b1-a933a4938c61" containerName="extract" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690737 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="e98ac779-339f-4be7-9e16-71018f21d7e4" containerName="extract" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690745 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="270b1265-4a50-4d19-9c0a-fb334622b2e8" containerName="extract" May 21 03:26:09.690739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.690751 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="514003f1-3abe-42fc-9367-7ff3a74b0d7b" containerName="extract" May 21 03:26:09.698987 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.698969 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8" May 21 03:26:09.701834 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.701814 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hwxq5\"" May 21 03:26:09.708143 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.708115 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8"] May 21 03:26:09.761647 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.761607 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/66914f79-6fa3-4f5e-ba21-abf9a105ea05-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-w6lw8\" (UID: \"66914f79-6fa3-4f5e-ba21-abf9a105ea05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8" May 21 03:26:09.761834 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.761675 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfqx6\" (UniqueName: \"kubernetes.io/projected/66914f79-6fa3-4f5e-ba21-abf9a105ea05-kube-api-access-lfqx6\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-w6lw8\" (UID: \"66914f79-6fa3-4f5e-ba21-abf9a105ea05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8" May 21 03:26:09.862789 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.862742 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lfqx6\" (UniqueName: \"kubernetes.io/projected/66914f79-6fa3-4f5e-ba21-abf9a105ea05-kube-api-access-lfqx6\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-w6lw8\" (UID: \"66914f79-6fa3-4f5e-ba21-abf9a105ea05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8" May 21 03:26:09.862970 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.862831 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/66914f79-6fa3-4f5e-ba21-abf9a105ea05-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-w6lw8\" (UID: \"66914f79-6fa3-4f5e-ba21-abf9a105ea05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8" May 21 03:26:09.863194 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.863178 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/66914f79-6fa3-4f5e-ba21-abf9a105ea05-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-w6lw8\" (UID: \"66914f79-6fa3-4f5e-ba21-abf9a105ea05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8" May 21 03:26:09.875581 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:09.875546 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfqx6\" (UniqueName: \"kubernetes.io/projected/66914f79-6fa3-4f5e-ba21-abf9a105ea05-kube-api-access-lfqx6\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-w6lw8\" (UID: \"66914f79-6fa3-4f5e-ba21-abf9a105ea05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8" May 21 03:26:10.009900 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:10.009793 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8" May 21 03:26:10.150883 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:10.150852 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8"] May 21 03:26:10.152589 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:26:10.152564 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66914f79_6fa3_4f5e_ba21_abf9a105ea05.slice/crio-d2b33736d8bda136056abe3aa153b5787684002d3850d9bcfd6c8cd20f21c7ee WatchSource:0}: Error finding container d2b33736d8bda136056abe3aa153b5787684002d3850d9bcfd6c8cd20f21c7ee: Status 404 returned error can't find the container with id d2b33736d8bda136056abe3aa153b5787684002d3850d9bcfd6c8cd20f21c7ee May 21 03:26:10.576903 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:10.576865 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8" event={"ID":"66914f79-6fa3-4f5e-ba21-abf9a105ea05","Type":"ContainerStarted","Data":"d2b33736d8bda136056abe3aa153b5787684002d3850d9bcfd6c8cd20f21c7ee"} May 21 03:26:16.600911 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:16.600862 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8" event={"ID":"66914f79-6fa3-4f5e-ba21-abf9a105ea05","Type":"ContainerStarted","Data":"080e82ba2a9b7533b8312da59414856127066dd7d952f2557357bef8af47ea51"} May 21 03:26:16.601442 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:16.600988 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8" May 21 03:26:16.621034 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:16.620974 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8" podStartSLOduration=1.8704082629999998 podStartE2EDuration="7.620959664s" podCreationTimestamp="2026-05-21 03:26:09 +0000 UTC" firstStartedPulling="2026-05-21 03:26:10.15484842 +0000 UTC m=+394.521068789" lastFinishedPulling="2026-05-21 03:26:15.905399816 +0000 UTC m=+400.271620190" observedRunningTime="2026-05-21 03:26:16.619613059 +0000 UTC m=+400.985833453" watchObservedRunningTime="2026-05-21 03:26:16.620959664 +0000 UTC m=+400.987180114" May 21 03:26:19.103538 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:19.103497 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vsnxq"] May 21 03:26:19.106837 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:19.106817 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vsnxq" May 21 03:26:19.108986 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:19.108962 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 21 03:26:19.109247 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:19.109225 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2trq2\"" May 21 03:26:19.109294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:19.109238 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 21 03:26:19.114476 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:19.114455 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vsnxq"] May 21 03:26:19.245589 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:19.245541 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf2bt\" (UniqueName: \"kubernetes.io/projected/6dfba232-1fd9-4775-8e72-6a3e33d8047c-kube-api-access-zf2bt\") pod \"kuadrant-console-plugin-6cb54b5c86-vsnxq\" (UID: \"6dfba232-1fd9-4775-8e72-6a3e33d8047c\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vsnxq" May 21 03:26:19.245775 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:19.245606 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6dfba232-1fd9-4775-8e72-6a3e33d8047c-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-vsnxq\" (UID: \"6dfba232-1fd9-4775-8e72-6a3e33d8047c\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vsnxq" May 21 03:26:19.245775 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:19.245695 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6dfba232-1fd9-4775-8e72-6a3e33d8047c-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-vsnxq\" (UID: \"6dfba232-1fd9-4775-8e72-6a3e33d8047c\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vsnxq" May 21 03:26:19.347010 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:19.346971 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6dfba232-1fd9-4775-8e72-6a3e33d8047c-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-vsnxq\" (UID: \"6dfba232-1fd9-4775-8e72-6a3e33d8047c\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vsnxq" May 21 03:26:19.347210 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:19.347073 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6dfba232-1fd9-4775-8e72-6a3e33d8047c-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-vsnxq\" (UID: \"6dfba232-1fd9-4775-8e72-6a3e33d8047c\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vsnxq" May 21 03:26:19.347210 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:19.347135 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zf2bt\" (UniqueName: \"kubernetes.io/projected/6dfba232-1fd9-4775-8e72-6a3e33d8047c-kube-api-access-zf2bt\") pod \"kuadrant-console-plugin-6cb54b5c86-vsnxq\" (UID: \"6dfba232-1fd9-4775-8e72-6a3e33d8047c\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vsnxq" May 21 03:26:19.347776 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:19.347752 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6dfba232-1fd9-4775-8e72-6a3e33d8047c-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-vsnxq\" (UID: \"6dfba232-1fd9-4775-8e72-6a3e33d8047c\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vsnxq" May 21 03:26:19.349694 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:19.349661 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6dfba232-1fd9-4775-8e72-6a3e33d8047c-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-vsnxq\" (UID: \"6dfba232-1fd9-4775-8e72-6a3e33d8047c\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vsnxq" May 21 03:26:19.354802 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:19.354752 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf2bt\" (UniqueName: \"kubernetes.io/projected/6dfba232-1fd9-4775-8e72-6a3e33d8047c-kube-api-access-zf2bt\") pod \"kuadrant-console-plugin-6cb54b5c86-vsnxq\" (UID: \"6dfba232-1fd9-4775-8e72-6a3e33d8047c\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vsnxq" May 21 03:26:19.416928 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:19.416888 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vsnxq" May 21 03:26:19.546925 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:19.546898 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vsnxq"] May 21 03:26:19.548577 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:26:19.548546 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6dfba232_1fd9_4775_8e72_6a3e33d8047c.slice/crio-3b569c0fee8748ecb6c98eb54d136aba82eb4462e64b203f85a56fd5f38ab194 WatchSource:0}: Error finding container 3b569c0fee8748ecb6c98eb54d136aba82eb4462e64b203f85a56fd5f38ab194: Status 404 returned error can't find the container with id 3b569c0fee8748ecb6c98eb54d136aba82eb4462e64b203f85a56fd5f38ab194 May 21 03:26:19.612833 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:19.612740 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vsnxq" event={"ID":"6dfba232-1fd9-4775-8e72-6a3e33d8047c","Type":"ContainerStarted","Data":"3b569c0fee8748ecb6c98eb54d136aba82eb4462e64b203f85a56fd5f38ab194"} May 21 03:26:27.606861 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:27.606830 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8" May 21 03:26:29.067101 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.067057 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wc9gr"] May 21 03:26:29.078302 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.078264 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wc9gr" May 21 03:26:29.081727 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.081698 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wc9gr"] May 21 03:26:29.244521 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.244479 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bae0145e-50d0-4f77-8862-cc1165ec1924-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-wc9gr\" (UID: \"bae0145e-50d0-4f77-8862-cc1165ec1924\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wc9gr" May 21 03:26:29.244712 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.244617 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7js6\" (UniqueName: \"kubernetes.io/projected/bae0145e-50d0-4f77-8862-cc1165ec1924-kube-api-access-j7js6\") pod \"kuadrant-operator-controller-manager-84b657d985-wc9gr\" (UID: \"bae0145e-50d0-4f77-8862-cc1165ec1924\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wc9gr" May 21 03:26:29.335686 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.335596 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8"] May 21 03:26:29.335936 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.335906 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8" podUID="66914f79-6fa3-4f5e-ba21-abf9a105ea05" containerName="manager" containerID="cri-o://080e82ba2a9b7533b8312da59414856127066dd7d952f2557357bef8af47ea51" gracePeriod=2 May 21 03:26:29.344132 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.344055 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8"] May 21 03:26:29.345436 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.345265 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j7js6\" (UniqueName: \"kubernetes.io/projected/bae0145e-50d0-4f77-8862-cc1165ec1924-kube-api-access-j7js6\") pod \"kuadrant-operator-controller-manager-84b657d985-wc9gr\" (UID: \"bae0145e-50d0-4f77-8862-cc1165ec1924\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wc9gr" May 21 03:26:29.345565 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.345437 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bae0145e-50d0-4f77-8862-cc1165ec1924-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-wc9gr\" (UID: \"bae0145e-50d0-4f77-8862-cc1165ec1924\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wc9gr" May 21 03:26:29.345869 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.345844 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bae0145e-50d0-4f77-8862-cc1165ec1924-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-wc9gr\" (UID: \"bae0145e-50d0-4f77-8862-cc1165ec1924\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wc9gr" May 21 03:26:29.355771 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.355380 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k55t5"] May 21 03:26:29.355853 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.355830 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66914f79-6fa3-4f5e-ba21-abf9a105ea05" containerName="manager" May 21 03:26:29.355853 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.355844 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="66914f79-6fa3-4f5e-ba21-abf9a105ea05" containerName="manager" May 21 03:26:29.355981 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.355913 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="66914f79-6fa3-4f5e-ba21-abf9a105ea05" containerName="manager" May 21 03:26:29.358985 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.358944 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wc9gr"] May 21 03:26:29.359304 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:26:29.359219 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-j7js6], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wc9gr" podUID="bae0145e-50d0-4f77-8862-cc1165ec1924" May 21 03:26:29.359520 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.359486 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k55t5" May 21 03:26:29.362064 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.362041 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wc9gr"] May 21 03:26:29.363120 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.363096 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7js6\" (UniqueName: \"kubernetes.io/projected/bae0145e-50d0-4f77-8862-cc1165ec1924-kube-api-access-j7js6\") pod \"kuadrant-operator-controller-manager-84b657d985-wc9gr\" (UID: \"bae0145e-50d0-4f77-8862-cc1165ec1924\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wc9gr" May 21 03:26:29.369579 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.369552 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k55t5"] May 21 03:26:29.387839 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.387808 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fg4m2"] May 21 03:26:29.389585 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.389541 2575 status_manager.go:895] "Failed to get status for pod" podUID="66914f79-6fa3-4f5e-ba21-abf9a105ea05" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-w6lw8\" is forbidden: User \"system:node:ip-10-0-137-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-251.ec2.internal' and this object" May 21 03:26:29.392181 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.392155 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fg4m2" May 21 03:26:29.394501 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.394464 2575 status_manager.go:895] "Failed to get status for pod" podUID="66914f79-6fa3-4f5e-ba21-abf9a105ea05" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-w6lw8\" is forbidden: User \"system:node:ip-10-0-137-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-251.ec2.internal' and this object" May 21 03:26:29.413589 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.412963 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fg4m2"] May 21 03:26:29.446141 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.446111 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3600bf10-e520-4036-8942-482297c75e0c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-k55t5\" (UID: \"3600bf10-e520-4036-8942-482297c75e0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k55t5" May 21 03:26:29.446284 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.446146 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7plm\" (UniqueName: \"kubernetes.io/projected/3600bf10-e520-4036-8942-482297c75e0c-kube-api-access-f7plm\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-k55t5\" (UID: \"3600bf10-e520-4036-8942-482297c75e0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k55t5" May 21 03:26:29.546781 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.546735 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3600bf10-e520-4036-8942-482297c75e0c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-k55t5\" (UID: \"3600bf10-e520-4036-8942-482297c75e0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k55t5" May 21 03:26:29.546781 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.546775 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f7plm\" (UniqueName: \"kubernetes.io/projected/3600bf10-e520-4036-8942-482297c75e0c-kube-api-access-f7plm\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-k55t5\" (UID: \"3600bf10-e520-4036-8942-482297c75e0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k55t5" May 21 03:26:29.547002 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.546817 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01d18ef7-0c02-4f80-b4ed-fdde745b3ceb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-fg4m2\" (UID: \"01d18ef7-0c02-4f80-b4ed-fdde745b3ceb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fg4m2" May 21 03:26:29.547002 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.546974 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7rwb\" (UniqueName: \"kubernetes.io/projected/01d18ef7-0c02-4f80-b4ed-fdde745b3ceb-kube-api-access-k7rwb\") pod \"kuadrant-operator-controller-manager-84b657d985-fg4m2\" (UID: \"01d18ef7-0c02-4f80-b4ed-fdde745b3ceb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fg4m2" May 21 03:26:29.547153 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.547136 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3600bf10-e520-4036-8942-482297c75e0c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-k55t5\" (UID: \"3600bf10-e520-4036-8942-482297c75e0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k55t5" May 21 03:26:29.555362 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.555315 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7plm\" (UniqueName: \"kubernetes.io/projected/3600bf10-e520-4036-8942-482297c75e0c-kube-api-access-f7plm\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-k55t5\" (UID: \"3600bf10-e520-4036-8942-482297c75e0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k55t5" May 21 03:26:29.647761 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.647656 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7rwb\" (UniqueName: \"kubernetes.io/projected/01d18ef7-0c02-4f80-b4ed-fdde745b3ceb-kube-api-access-k7rwb\") pod \"kuadrant-operator-controller-manager-84b657d985-fg4m2\" (UID: \"01d18ef7-0c02-4f80-b4ed-fdde745b3ceb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fg4m2" May 21 03:26:29.647934 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.647817 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01d18ef7-0c02-4f80-b4ed-fdde745b3ceb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-fg4m2\" (UID: \"01d18ef7-0c02-4f80-b4ed-fdde745b3ceb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fg4m2" May 21 03:26:29.648325 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.648301 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01d18ef7-0c02-4f80-b4ed-fdde745b3ceb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-fg4m2\" (UID: \"01d18ef7-0c02-4f80-b4ed-fdde745b3ceb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fg4m2" May 21 03:26:29.652953 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.652927 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wc9gr" May 21 03:26:29.655103 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.655067 2575 status_manager.go:895] "Failed to get status for pod" podUID="bae0145e-50d0-4f77-8862-cc1165ec1924" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wc9gr" err="pods \"kuadrant-operator-controller-manager-84b657d985-wc9gr\" is forbidden: User \"system:node:ip-10-0-137-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-251.ec2.internal' and this object" May 21 03:26:29.657005 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.656974 2575 status_manager.go:895] "Failed to get status for pod" podUID="66914f79-6fa3-4f5e-ba21-abf9a105ea05" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-w6lw8\" is forbidden: User \"system:node:ip-10-0-137-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-251.ec2.internal' and this object" May 21 03:26:29.658667 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.658648 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wc9gr" May 21 03:26:29.660445 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.660415 2575 status_manager.go:895] "Failed to get status for pod" podUID="66914f79-6fa3-4f5e-ba21-abf9a105ea05" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-w6lw8\" is forbidden: User \"system:node:ip-10-0-137-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-251.ec2.internal' and this object" May 21 03:26:29.661803 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.661781 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7rwb\" (UniqueName: \"kubernetes.io/projected/01d18ef7-0c02-4f80-b4ed-fdde745b3ceb-kube-api-access-k7rwb\") pod \"kuadrant-operator-controller-manager-84b657d985-fg4m2\" (UID: \"01d18ef7-0c02-4f80-b4ed-fdde745b3ceb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fg4m2" May 21 03:26:29.662020 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.661993 2575 status_manager.go:895] "Failed to get status for pod" podUID="bae0145e-50d0-4f77-8862-cc1165ec1924" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wc9gr" err="pods \"kuadrant-operator-controller-manager-84b657d985-wc9gr\" is forbidden: User \"system:node:ip-10-0-137-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-251.ec2.internal' and this object" May 21 03:26:29.741904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.741863 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k55t5" May 21 03:26:29.748392 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.748367 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7js6\" (UniqueName: \"kubernetes.io/projected/bae0145e-50d0-4f77-8862-cc1165ec1924-kube-api-access-j7js6\") pod \"bae0145e-50d0-4f77-8862-cc1165ec1924\" (UID: \"bae0145e-50d0-4f77-8862-cc1165ec1924\") " May 21 03:26:29.748534 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.748433 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bae0145e-50d0-4f77-8862-cc1165ec1924-extensions-socket-volume\") pod \"bae0145e-50d0-4f77-8862-cc1165ec1924\" (UID: \"bae0145e-50d0-4f77-8862-cc1165ec1924\") " May 21 03:26:29.748714 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.748687 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bae0145e-50d0-4f77-8862-cc1165ec1924-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bae0145e-50d0-4f77-8862-cc1165ec1924" (UID: "bae0145e-50d0-4f77-8862-cc1165ec1924"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:26:29.749079 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.749059 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fg4m2" May 21 03:26:29.750735 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.750706 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bae0145e-50d0-4f77-8862-cc1165ec1924-kube-api-access-j7js6" (OuterVolumeSpecName: "kube-api-access-j7js6") pod "bae0145e-50d0-4f77-8862-cc1165ec1924" (UID: "bae0145e-50d0-4f77-8862-cc1165ec1924"). InnerVolumeSpecName "kube-api-access-j7js6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:26:29.849414 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.849371 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7js6\" (UniqueName: \"kubernetes.io/projected/bae0145e-50d0-4f77-8862-cc1165ec1924-kube-api-access-j7js6\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:26:29.849414 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:29.849413 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bae0145e-50d0-4f77-8862-cc1165ec1924-extensions-socket-volume\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:26:30.206187 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:30.206147 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bae0145e-50d0-4f77-8862-cc1165ec1924" path="/var/lib/kubelet/pods/bae0145e-50d0-4f77-8862-cc1165ec1924/volumes" May 21 03:26:30.657149 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:30.657119 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wc9gr" May 21 03:26:30.662155 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:30.662121 2575 status_manager.go:895] "Failed to get status for pod" podUID="bae0145e-50d0-4f77-8862-cc1165ec1924" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wc9gr" err="pods \"kuadrant-operator-controller-manager-84b657d985-wc9gr\" is forbidden: User \"system:node:ip-10-0-137-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-251.ec2.internal' and this object" May 21 03:26:42.920798 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:42.920770 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8" May 21 03:26:42.923020 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:42.922985 2575 status_manager.go:895] "Failed to get status for pod" podUID="66914f79-6fa3-4f5e-ba21-abf9a105ea05" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-w6lw8\" is forbidden: User \"system:node:ip-10-0-137-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-251.ec2.internal' and this object" May 21 03:26:43.079638 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.079603 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/66914f79-6fa3-4f5e-ba21-abf9a105ea05-extensions-socket-volume\") pod \"66914f79-6fa3-4f5e-ba21-abf9a105ea05\" (UID: \"66914f79-6fa3-4f5e-ba21-abf9a105ea05\") " May 21 03:26:43.079820 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.079733 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfqx6\" (UniqueName: \"kubernetes.io/projected/66914f79-6fa3-4f5e-ba21-abf9a105ea05-kube-api-access-lfqx6\") pod \"66914f79-6fa3-4f5e-ba21-abf9a105ea05\" (UID: \"66914f79-6fa3-4f5e-ba21-abf9a105ea05\") " May 21 03:26:43.080100 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.080073 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66914f79-6fa3-4f5e-ba21-abf9a105ea05-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "66914f79-6fa3-4f5e-ba21-abf9a105ea05" (UID: "66914f79-6fa3-4f5e-ba21-abf9a105ea05"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:26:43.081791 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.081772 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66914f79-6fa3-4f5e-ba21-abf9a105ea05-kube-api-access-lfqx6" (OuterVolumeSpecName: "kube-api-access-lfqx6") pod "66914f79-6fa3-4f5e-ba21-abf9a105ea05" (UID: "66914f79-6fa3-4f5e-ba21-abf9a105ea05"). InnerVolumeSpecName "kube-api-access-lfqx6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:26:43.126492 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.126459 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fg4m2"] May 21 03:26:43.127914 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:26:43.127890 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01d18ef7_0c02_4f80_b4ed_fdde745b3ceb.slice/crio-e9c712237b205577f1b04111e0e7c9422838c9a9a796f43a4240665bf2e01496 WatchSource:0}: Error finding container e9c712237b205577f1b04111e0e7c9422838c9a9a796f43a4240665bf2e01496: Status 404 returned error can't find the container with id e9c712237b205577f1b04111e0e7c9422838c9a9a796f43a4240665bf2e01496 May 21 03:26:43.128678 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.128645 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k55t5"] May 21 03:26:43.129974 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:26:43.129941 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3600bf10_e520_4036_8942_482297c75e0c.slice/crio-f59b593c5cebd56a4dd10f0b9c455d02c156ed93a7d1757a5b0aba39f38dbc5f WatchSource:0}: Error finding container f59b593c5cebd56a4dd10f0b9c455d02c156ed93a7d1757a5b0aba39f38dbc5f: Status 404 returned error can't find the container with id f59b593c5cebd56a4dd10f0b9c455d02c156ed93a7d1757a5b0aba39f38dbc5f May 21 03:26:43.181003 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.180969 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfqx6\" (UniqueName: \"kubernetes.io/projected/66914f79-6fa3-4f5e-ba21-abf9a105ea05-kube-api-access-lfqx6\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:26:43.181003 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.181004 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/66914f79-6fa3-4f5e-ba21-abf9a105ea05-extensions-socket-volume\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:26:43.711209 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.711172 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vsnxq" event={"ID":"6dfba232-1fd9-4775-8e72-6a3e33d8047c","Type":"ContainerStarted","Data":"0132f0781ed5bd1bd6a853618ec137cda35e16e15790cc74bf1d4bb7a60655da"} May 21 03:26:43.712386 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.712341 2575 generic.go:358] "Generic (PLEG): container finished" podID="66914f79-6fa3-4f5e-ba21-abf9a105ea05" containerID="080e82ba2a9b7533b8312da59414856127066dd7d952f2557357bef8af47ea51" exitCode=0 May 21 03:26:43.712506 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.712387 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8" May 21 03:26:43.712506 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.712430 2575 scope.go:117] "RemoveContainer" containerID="080e82ba2a9b7533b8312da59414856127066dd7d952f2557357bef8af47ea51" May 21 03:26:43.713065 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.713037 2575 status_manager.go:895] "Failed to get status for pod" podUID="66914f79-6fa3-4f5e-ba21-abf9a105ea05" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-w6lw8\" is forbidden: User \"system:node:ip-10-0-137-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-251.ec2.internal' and this object" May 21 03:26:43.713988 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.713957 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fg4m2" event={"ID":"01d18ef7-0c02-4f80-b4ed-fdde745b3ceb","Type":"ContainerStarted","Data":"bd86e5c5700c29fe031dc6e948771649452adf2aecfbbaa6936afc027d8b973a"} May 21 03:26:43.714096 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.713992 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fg4m2" event={"ID":"01d18ef7-0c02-4f80-b4ed-fdde745b3ceb","Type":"ContainerStarted","Data":"e9c712237b205577f1b04111e0e7c9422838c9a9a796f43a4240665bf2e01496"} May 21 03:26:43.714096 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.714035 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fg4m2" May 21 03:26:43.715645 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.715620 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k55t5" event={"ID":"3600bf10-e520-4036-8942-482297c75e0c","Type":"ContainerStarted","Data":"50d7f10b536e2fd130716a5faaa5b231ca4e4e7d680007080fa99181dea483b7"} May 21 03:26:43.715645 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.715652 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k55t5" event={"ID":"3600bf10-e520-4036-8942-482297c75e0c","Type":"ContainerStarted","Data":"f59b593c5cebd56a4dd10f0b9c455d02c156ed93a7d1757a5b0aba39f38dbc5f"} May 21 03:26:43.716045 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.715733 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k55t5" May 21 03:26:43.721502 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.721483 2575 scope.go:117] "RemoveContainer" containerID="080e82ba2a9b7533b8312da59414856127066dd7d952f2557357bef8af47ea51" May 21 03:26:43.721762 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:26:43.721745 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"080e82ba2a9b7533b8312da59414856127066dd7d952f2557357bef8af47ea51\": container with ID starting with 080e82ba2a9b7533b8312da59414856127066dd7d952f2557357bef8af47ea51 not found: ID does not exist" containerID="080e82ba2a9b7533b8312da59414856127066dd7d952f2557357bef8af47ea51" May 21 03:26:43.721822 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.721771 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"080e82ba2a9b7533b8312da59414856127066dd7d952f2557357bef8af47ea51"} err="failed to get container status \"080e82ba2a9b7533b8312da59414856127066dd7d952f2557357bef8af47ea51\": rpc error: code = NotFound desc = could not find container \"080e82ba2a9b7533b8312da59414856127066dd7d952f2557357bef8af47ea51\": container with ID starting with 080e82ba2a9b7533b8312da59414856127066dd7d952f2557357bef8af47ea51 not found: ID does not exist" May 21 03:26:43.727747 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.727696 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vsnxq" podStartSLOduration=1.082829793 podStartE2EDuration="24.727681153s" podCreationTimestamp="2026-05-21 03:26:19 +0000 UTC" firstStartedPulling="2026-05-21 03:26:19.549778893 +0000 UTC m=+403.915999263" lastFinishedPulling="2026-05-21 03:26:43.194630235 +0000 UTC m=+427.560850623" observedRunningTime="2026-05-21 03:26:43.726799216 +0000 UTC m=+428.093019609" watchObservedRunningTime="2026-05-21 03:26:43.727681153 +0000 UTC m=+428.093901557" May 21 03:26:43.728755 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.728721 2575 status_manager.go:895] "Failed to get status for pod" podUID="66914f79-6fa3-4f5e-ba21-abf9a105ea05" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w6lw8" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-w6lw8\" is forbidden: User \"system:node:ip-10-0-137-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-251.ec2.internal' and this object" May 21 03:26:43.749954 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.749901 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k55t5" podStartSLOduration=14.749887885 podStartE2EDuration="14.749887885s" podCreationTimestamp="2026-05-21 03:26:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:26:43.747691557 +0000 UTC m=+428.113911940" watchObservedRunningTime="2026-05-21 03:26:43.749887885 +0000 UTC m=+428.116108276" May 21 03:26:43.764556 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:43.764505 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fg4m2" podStartSLOduration=14.764490499 podStartE2EDuration="14.764490499s" podCreationTimestamp="2026-05-21 03:26:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:26:43.76230606 +0000 UTC m=+428.128526462" watchObservedRunningTime="2026-05-21 03:26:43.764490499 +0000 UTC m=+428.130710957" May 21 03:26:44.205743 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:44.205713 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66914f79-6fa3-4f5e-ba21-abf9a105ea05" path="/var/lib/kubelet/pods/66914f79-6fa3-4f5e-ba21-abf9a105ea05/volumes" May 21 03:26:54.222934 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:54.222897 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56cbc6997d-9d5kd"] May 21 03:26:54.728372 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:54.728317 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fg4m2" May 21 03:26:54.728557 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:54.728401 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k55t5" May 21 03:26:54.792910 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:54.792876 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k55t5"] May 21 03:26:54.793231 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:54.793156 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k55t5" podUID="3600bf10-e520-4036-8942-482297c75e0c" containerName="manager" containerID="cri-o://50d7f10b536e2fd130716a5faaa5b231ca4e4e7d680007080fa99181dea483b7" gracePeriod=10 May 21 03:26:55.028911 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.028883 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wdhf"] May 21 03:26:55.031195 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.031173 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wdhf" May 21 03:26:55.042911 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.042886 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k55t5" May 21 03:26:55.043290 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.043268 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wdhf"] May 21 03:26:55.084179 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.084152 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3600bf10-e520-4036-8942-482297c75e0c-extensions-socket-volume\") pod \"3600bf10-e520-4036-8942-482297c75e0c\" (UID: \"3600bf10-e520-4036-8942-482297c75e0c\") " May 21 03:26:55.084385 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.084257 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7plm\" (UniqueName: \"kubernetes.io/projected/3600bf10-e520-4036-8942-482297c75e0c-kube-api-access-f7plm\") pod \"3600bf10-e520-4036-8942-482297c75e0c\" (UID: \"3600bf10-e520-4036-8942-482297c75e0c\") " May 21 03:26:55.084467 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.084423 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77rrg\" (UniqueName: \"kubernetes.io/projected/01385ffd-4c45-41a7-8dd9-be14d41afd72-kube-api-access-77rrg\") pod \"kuadrant-operator-controller-manager-55c7f4c975-5wdhf\" (UID: \"01385ffd-4c45-41a7-8dd9-be14d41afd72\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wdhf" May 21 03:26:55.084529 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.084480 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01385ffd-4c45-41a7-8dd9-be14d41afd72-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-5wdhf\" (UID: \"01385ffd-4c45-41a7-8dd9-be14d41afd72\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wdhf" May 21 03:26:55.084626 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.084602 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3600bf10-e520-4036-8942-482297c75e0c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3600bf10-e520-4036-8942-482297c75e0c" (UID: "3600bf10-e520-4036-8942-482297c75e0c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:26:55.086237 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.086217 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3600bf10-e520-4036-8942-482297c75e0c-kube-api-access-f7plm" (OuterVolumeSpecName: "kube-api-access-f7plm") pod "3600bf10-e520-4036-8942-482297c75e0c" (UID: "3600bf10-e520-4036-8942-482297c75e0c"). InnerVolumeSpecName "kube-api-access-f7plm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:26:55.185744 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.185706 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01385ffd-4c45-41a7-8dd9-be14d41afd72-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-5wdhf\" (UID: \"01385ffd-4c45-41a7-8dd9-be14d41afd72\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wdhf" May 21 03:26:55.185937 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.185826 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-77rrg\" (UniqueName: \"kubernetes.io/projected/01385ffd-4c45-41a7-8dd9-be14d41afd72-kube-api-access-77rrg\") pod \"kuadrant-operator-controller-manager-55c7f4c975-5wdhf\" (UID: \"01385ffd-4c45-41a7-8dd9-be14d41afd72\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wdhf" May 21 03:26:55.185937 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.185874 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7plm\" (UniqueName: \"kubernetes.io/projected/3600bf10-e520-4036-8942-482297c75e0c-kube-api-access-f7plm\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:26:55.185937 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.185889 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3600bf10-e520-4036-8942-482297c75e0c-extensions-socket-volume\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:26:55.186120 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.186103 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01385ffd-4c45-41a7-8dd9-be14d41afd72-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-5wdhf\" (UID: \"01385ffd-4c45-41a7-8dd9-be14d41afd72\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wdhf" May 21 03:26:55.194105 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.194074 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77rrg\" (UniqueName: \"kubernetes.io/projected/01385ffd-4c45-41a7-8dd9-be14d41afd72-kube-api-access-77rrg\") pod \"kuadrant-operator-controller-manager-55c7f4c975-5wdhf\" (UID: \"01385ffd-4c45-41a7-8dd9-be14d41afd72\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wdhf" May 21 03:26:55.351761 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.351717 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wdhf" May 21 03:26:55.486323 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.486298 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wdhf"] May 21 03:26:55.488925 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:26:55.488871 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01385ffd_4c45_41a7_8dd9_be14d41afd72.slice/crio-c3402b215b21bcc7613c04e490930a3d75cad5c5543e92ebd0f2d71fe6ebbc46 WatchSource:0}: Error finding container c3402b215b21bcc7613c04e490930a3d75cad5c5543e92ebd0f2d71fe6ebbc46: Status 404 returned error can't find the container with id c3402b215b21bcc7613c04e490930a3d75cad5c5543e92ebd0f2d71fe6ebbc46 May 21 03:26:55.771969 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.771834 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wdhf" event={"ID":"01385ffd-4c45-41a7-8dd9-be14d41afd72","Type":"ContainerStarted","Data":"113a3bb5ae97779adf21c27c64c455dbbdfff251cb4173cb8b1cb369ea382f43"} May 21 03:26:55.771969 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.771884 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wdhf" event={"ID":"01385ffd-4c45-41a7-8dd9-be14d41afd72","Type":"ContainerStarted","Data":"c3402b215b21bcc7613c04e490930a3d75cad5c5543e92ebd0f2d71fe6ebbc46"} May 21 03:26:55.771969 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.771917 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wdhf" May 21 03:26:55.773051 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.773022 2575 generic.go:358] "Generic (PLEG): container finished" podID="3600bf10-e520-4036-8942-482297c75e0c" containerID="50d7f10b536e2fd130716a5faaa5b231ca4e4e7d680007080fa99181dea483b7" exitCode=0 May 21 03:26:55.773182 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.773065 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k55t5" event={"ID":"3600bf10-e520-4036-8942-482297c75e0c","Type":"ContainerDied","Data":"50d7f10b536e2fd130716a5faaa5b231ca4e4e7d680007080fa99181dea483b7"} May 21 03:26:55.773182 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.773090 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k55t5" event={"ID":"3600bf10-e520-4036-8942-482297c75e0c","Type":"ContainerDied","Data":"f59b593c5cebd56a4dd10f0b9c455d02c156ed93a7d1757a5b0aba39f38dbc5f"} May 21 03:26:55.773182 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.773093 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k55t5" May 21 03:26:55.773182 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.773108 2575 scope.go:117] "RemoveContainer" containerID="50d7f10b536e2fd130716a5faaa5b231ca4e4e7d680007080fa99181dea483b7" May 21 03:26:55.782337 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.782321 2575 scope.go:117] "RemoveContainer" containerID="50d7f10b536e2fd130716a5faaa5b231ca4e4e7d680007080fa99181dea483b7" May 21 03:26:55.782605 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:26:55.782585 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50d7f10b536e2fd130716a5faaa5b231ca4e4e7d680007080fa99181dea483b7\": container with ID starting with 50d7f10b536e2fd130716a5faaa5b231ca4e4e7d680007080fa99181dea483b7 not found: ID does not exist" containerID="50d7f10b536e2fd130716a5faaa5b231ca4e4e7d680007080fa99181dea483b7" May 21 03:26:55.782660 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.782614 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50d7f10b536e2fd130716a5faaa5b231ca4e4e7d680007080fa99181dea483b7"} err="failed to get container status \"50d7f10b536e2fd130716a5faaa5b231ca4e4e7d680007080fa99181dea483b7\": rpc error: code = NotFound desc = could not find container \"50d7f10b536e2fd130716a5faaa5b231ca4e4e7d680007080fa99181dea483b7\": container with ID starting with 50d7f10b536e2fd130716a5faaa5b231ca4e4e7d680007080fa99181dea483b7 not found: ID does not exist" May 21 03:26:55.807498 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.807452 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wdhf" podStartSLOduration=0.807438487 podStartE2EDuration="807.438487ms" podCreationTimestamp="2026-05-21 03:26:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:26:55.804880529 +0000 UTC m=+440.171100922" watchObservedRunningTime="2026-05-21 03:26:55.807438487 +0000 UTC m=+440.173658878" May 21 03:26:55.832697 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.832658 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k55t5"] May 21 03:26:55.846989 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:55.846953 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k55t5"] May 21 03:26:56.205595 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:26:56.205558 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3600bf10-e520-4036-8942-482297c75e0c" path="/var/lib/kubelet/pods/3600bf10-e520-4036-8942-482297c75e0c/volumes" May 21 03:27:06.781209 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:06.781172 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wdhf" May 21 03:27:06.825873 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:06.825839 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fg4m2"] May 21 03:27:06.826103 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:06.826074 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fg4m2" podUID="01d18ef7-0c02-4f80-b4ed-fdde745b3ceb" containerName="manager" containerID="cri-o://bd86e5c5700c29fe031dc6e948771649452adf2aecfbbaa6936afc027d8b973a" gracePeriod=10 May 21 03:27:07.087424 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:07.087393 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fg4m2" May 21 03:27:07.189648 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:07.189605 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7rwb\" (UniqueName: \"kubernetes.io/projected/01d18ef7-0c02-4f80-b4ed-fdde745b3ceb-kube-api-access-k7rwb\") pod \"01d18ef7-0c02-4f80-b4ed-fdde745b3ceb\" (UID: \"01d18ef7-0c02-4f80-b4ed-fdde745b3ceb\") " May 21 03:27:07.189830 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:07.189674 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01d18ef7-0c02-4f80-b4ed-fdde745b3ceb-extensions-socket-volume\") pod \"01d18ef7-0c02-4f80-b4ed-fdde745b3ceb\" (UID: \"01d18ef7-0c02-4f80-b4ed-fdde745b3ceb\") " May 21 03:27:07.190042 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:07.190010 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01d18ef7-0c02-4f80-b4ed-fdde745b3ceb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "01d18ef7-0c02-4f80-b4ed-fdde745b3ceb" (UID: "01d18ef7-0c02-4f80-b4ed-fdde745b3ceb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:27:07.191790 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:07.191761 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01d18ef7-0c02-4f80-b4ed-fdde745b3ceb-kube-api-access-k7rwb" (OuterVolumeSpecName: "kube-api-access-k7rwb") pod "01d18ef7-0c02-4f80-b4ed-fdde745b3ceb" (UID: "01d18ef7-0c02-4f80-b4ed-fdde745b3ceb"). InnerVolumeSpecName "kube-api-access-k7rwb". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:27:07.290632 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:07.290593 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7rwb\" (UniqueName: \"kubernetes.io/projected/01d18ef7-0c02-4f80-b4ed-fdde745b3ceb-kube-api-access-k7rwb\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:27:07.290632 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:07.290623 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01d18ef7-0c02-4f80-b4ed-fdde745b3ceb-extensions-socket-volume\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:27:07.829086 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:07.829047 2575 generic.go:358] "Generic (PLEG): container finished" podID="01d18ef7-0c02-4f80-b4ed-fdde745b3ceb" containerID="bd86e5c5700c29fe031dc6e948771649452adf2aecfbbaa6936afc027d8b973a" exitCode=0 May 21 03:27:07.829516 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:07.829110 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fg4m2" May 21 03:27:07.829516 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:07.829133 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fg4m2" event={"ID":"01d18ef7-0c02-4f80-b4ed-fdde745b3ceb","Type":"ContainerDied","Data":"bd86e5c5700c29fe031dc6e948771649452adf2aecfbbaa6936afc027d8b973a"} May 21 03:27:07.829516 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:07.829176 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fg4m2" event={"ID":"01d18ef7-0c02-4f80-b4ed-fdde745b3ceb","Type":"ContainerDied","Data":"e9c712237b205577f1b04111e0e7c9422838c9a9a796f43a4240665bf2e01496"} May 21 03:27:07.829516 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:07.829192 2575 scope.go:117] "RemoveContainer" containerID="bd86e5c5700c29fe031dc6e948771649452adf2aecfbbaa6936afc027d8b973a" May 21 03:27:07.838343 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:07.838328 2575 scope.go:117] "RemoveContainer" containerID="bd86e5c5700c29fe031dc6e948771649452adf2aecfbbaa6936afc027d8b973a" May 21 03:27:07.838648 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:27:07.838627 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd86e5c5700c29fe031dc6e948771649452adf2aecfbbaa6936afc027d8b973a\": container with ID starting with bd86e5c5700c29fe031dc6e948771649452adf2aecfbbaa6936afc027d8b973a not found: ID does not exist" containerID="bd86e5c5700c29fe031dc6e948771649452adf2aecfbbaa6936afc027d8b973a" May 21 03:27:07.838699 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:07.838657 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd86e5c5700c29fe031dc6e948771649452adf2aecfbbaa6936afc027d8b973a"} err="failed to get container status \"bd86e5c5700c29fe031dc6e948771649452adf2aecfbbaa6936afc027d8b973a\": rpc error: code = NotFound desc = could not find container \"bd86e5c5700c29fe031dc6e948771649452adf2aecfbbaa6936afc027d8b973a\": container with ID starting with bd86e5c5700c29fe031dc6e948771649452adf2aecfbbaa6936afc027d8b973a not found: ID does not exist" May 21 03:27:07.852858 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:07.852826 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fg4m2"] May 21 03:27:07.858043 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:07.858018 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-fg4m2"] May 21 03:27:08.205662 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:08.205587 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01d18ef7-0c02-4f80-b4ed-fdde745b3ceb" path="/var/lib/kubelet/pods/01d18ef7-0c02-4f80-b4ed-fdde745b3ceb/volumes" May 21 03:27:11.021668 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.021632 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln"] May 21 03:27:11.022047 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.021951 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01d18ef7-0c02-4f80-b4ed-fdde745b3ceb" containerName="manager" May 21 03:27:11.022047 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.021963 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="01d18ef7-0c02-4f80-b4ed-fdde745b3ceb" containerName="manager" May 21 03:27:11.022047 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.021979 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3600bf10-e520-4036-8942-482297c75e0c" containerName="manager" May 21 03:27:11.022047 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.021985 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3600bf10-e520-4036-8942-482297c75e0c" containerName="manager" May 21 03:27:11.022047 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.022035 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="3600bf10-e520-4036-8942-482297c75e0c" containerName="manager" May 21 03:27:11.022047 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.022048 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="01d18ef7-0c02-4f80-b4ed-fdde745b3ceb" containerName="manager" May 21 03:27:11.063697 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.063668 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln"] May 21 03:27:11.063859 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.063841 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.066276 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.066254 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-svgfs\"" May 21 03:27:11.124294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.124252 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12134405-014b-447a-a952-76681ca3850c-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.124294 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.124294 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12134405-014b-447a-a952-76681ca3850c-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.124544 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.124321 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12134405-014b-447a-a952-76681ca3850c-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.124544 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.124373 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12134405-014b-447a-a952-76681ca3850c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.124544 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.124405 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12134405-014b-447a-a952-76681ca3850c-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.124544 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.124445 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12134405-014b-447a-a952-76681ca3850c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.124544 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.124523 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szh54\" (UniqueName: \"kubernetes.io/projected/12134405-014b-447a-a952-76681ca3850c-kube-api-access-szh54\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.124729 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.124564 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12134405-014b-447a-a952-76681ca3850c-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.124729 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.124588 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12134405-014b-447a-a952-76681ca3850c-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.226009 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.225968 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12134405-014b-447a-a952-76681ca3850c-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.226212 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.226027 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12134405-014b-447a-a952-76681ca3850c-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.226212 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.226134 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12134405-014b-447a-a952-76681ca3850c-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.226212 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.226200 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12134405-014b-447a-a952-76681ca3850c-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.226419 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.226228 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12134405-014b-447a-a952-76681ca3850c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.226419 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.226254 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12134405-014b-447a-a952-76681ca3850c-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.226419 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.226310 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12134405-014b-447a-a952-76681ca3850c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.226574 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.226423 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-szh54\" (UniqueName: \"kubernetes.io/projected/12134405-014b-447a-a952-76681ca3850c-kube-api-access-szh54\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.226574 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.226468 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12134405-014b-447a-a952-76681ca3850c-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.226574 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.226526 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12134405-014b-447a-a952-76681ca3850c-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.226702 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.226621 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12134405-014b-447a-a952-76681ca3850c-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.226702 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.226657 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12134405-014b-447a-a952-76681ca3850c-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.226904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.226880 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12134405-014b-447a-a952-76681ca3850c-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.227120 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.227101 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12134405-014b-447a-a952-76681ca3850c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.228743 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.228711 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12134405-014b-447a-a952-76681ca3850c-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.228968 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.228944 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12134405-014b-447a-a952-76681ca3850c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.234421 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.234401 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12134405-014b-447a-a952-76681ca3850c-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.234687 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.234663 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szh54\" (UniqueName: \"kubernetes.io/projected/12134405-014b-447a-a952-76681ca3850c-kube-api-access-szh54\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-nmsln\" (UID: \"12134405-014b-447a-a952-76681ca3850c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.374399 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.374336 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:11.512079 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.512056 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln"] May 21 03:27:11.514057 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:27:11.514025 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12134405_014b_447a_a952_76681ca3850c.slice/crio-afb89484ebc48c3ff3c8e9b0fa129c6700da87d6ad0589f2b9dfb00aa25ab71e WatchSource:0}: Error finding container afb89484ebc48c3ff3c8e9b0fa129c6700da87d6ad0589f2b9dfb00aa25ab71e: Status 404 returned error can't find the container with id afb89484ebc48c3ff3c8e9b0fa129c6700da87d6ad0589f2b9dfb00aa25ab71e May 21 03:27:11.516229 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.516194 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} May 21 03:27:11.516317 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.516264 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} May 21 03:27:11.516317 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.516293 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} May 21 03:27:11.846796 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.846759 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" event={"ID":"12134405-014b-447a-a952-76681ca3850c","Type":"ContainerStarted","Data":"cdcceeab6a94cc978751f0c9596df4d36a9931f72a0f374d3726b8da675b3a25"} May 21 03:27:11.846992 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.846804 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" event={"ID":"12134405-014b-447a-a952-76681ca3850c","Type":"ContainerStarted","Data":"afb89484ebc48c3ff3c8e9b0fa129c6700da87d6ad0589f2b9dfb00aa25ab71e"} May 21 03:27:11.866105 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:11.866057 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" podStartSLOduration=0.866041679 podStartE2EDuration="866.041679ms" podCreationTimestamp="2026-05-21 03:27:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:27:11.863314215 +0000 UTC m=+456.229534607" watchObservedRunningTime="2026-05-21 03:27:11.866041679 +0000 UTC m=+456.232262072" May 21 03:27:12.375209 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:12.375172 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:12.380026 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:12.379999 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:12.850494 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:12.850465 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:12.851519 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:12.851495 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-nmsln" May 21 03:27:19.241830 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.241789 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-56cbc6997d-9d5kd" podUID="319656d7-e054-4e29-aa1a-b0c6b595d671" containerName="console" containerID="cri-o://2c5f6a5fbc160634101659e97cbc20f5ad996acfdb33b5638125f243f7dd394c" gracePeriod=15 May 21 03:27:19.512010 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.511984 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-56cbc6997d-9d5kd_319656d7-e054-4e29-aa1a-b0c6b595d671/console/0.log" May 21 03:27:19.512147 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.512048 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:27:19.601321 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.601259 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/319656d7-e054-4e29-aa1a-b0c6b595d671-trusted-ca-bundle\") pod \"319656d7-e054-4e29-aa1a-b0c6b595d671\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " May 21 03:27:19.601559 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.601393 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt4sx\" (UniqueName: \"kubernetes.io/projected/319656d7-e054-4e29-aa1a-b0c6b595d671-kube-api-access-pt4sx\") pod \"319656d7-e054-4e29-aa1a-b0c6b595d671\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " May 21 03:27:19.601559 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.601440 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/319656d7-e054-4e29-aa1a-b0c6b595d671-oauth-serving-cert\") pod \"319656d7-e054-4e29-aa1a-b0c6b595d671\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " May 21 03:27:19.601559 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.601472 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/319656d7-e054-4e29-aa1a-b0c6b595d671-console-serving-cert\") pod \"319656d7-e054-4e29-aa1a-b0c6b595d671\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " May 21 03:27:19.601559 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.601500 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/319656d7-e054-4e29-aa1a-b0c6b595d671-console-config\") pod \"319656d7-e054-4e29-aa1a-b0c6b595d671\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " May 21 03:27:19.601559 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.601527 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/319656d7-e054-4e29-aa1a-b0c6b595d671-console-oauth-config\") pod \"319656d7-e054-4e29-aa1a-b0c6b595d671\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " May 21 03:27:19.601559 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.601557 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/319656d7-e054-4e29-aa1a-b0c6b595d671-service-ca\") pod \"319656d7-e054-4e29-aa1a-b0c6b595d671\" (UID: \"319656d7-e054-4e29-aa1a-b0c6b595d671\") " May 21 03:27:19.601848 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.601765 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/319656d7-e054-4e29-aa1a-b0c6b595d671-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "319656d7-e054-4e29-aa1a-b0c6b595d671" (UID: "319656d7-e054-4e29-aa1a-b0c6b595d671"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 03:27:19.601848 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.601803 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/319656d7-e054-4e29-aa1a-b0c6b595d671-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "319656d7-e054-4e29-aa1a-b0c6b595d671" (UID: "319656d7-e054-4e29-aa1a-b0c6b595d671"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 03:27:19.602050 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.602017 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/319656d7-e054-4e29-aa1a-b0c6b595d671-console-config" (OuterVolumeSpecName: "console-config") pod "319656d7-e054-4e29-aa1a-b0c6b595d671" (UID: "319656d7-e054-4e29-aa1a-b0c6b595d671"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 03:27:19.602147 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.602097 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/319656d7-e054-4e29-aa1a-b0c6b595d671-service-ca" (OuterVolumeSpecName: "service-ca") pod "319656d7-e054-4e29-aa1a-b0c6b595d671" (UID: "319656d7-e054-4e29-aa1a-b0c6b595d671"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 03:27:19.603663 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.603634 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/319656d7-e054-4e29-aa1a-b0c6b595d671-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "319656d7-e054-4e29-aa1a-b0c6b595d671" (UID: "319656d7-e054-4e29-aa1a-b0c6b595d671"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 03:27:19.603783 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.603705 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/319656d7-e054-4e29-aa1a-b0c6b595d671-kube-api-access-pt4sx" (OuterVolumeSpecName: "kube-api-access-pt4sx") pod "319656d7-e054-4e29-aa1a-b0c6b595d671" (UID: "319656d7-e054-4e29-aa1a-b0c6b595d671"). InnerVolumeSpecName "kube-api-access-pt4sx". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:27:19.603844 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.603793 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/319656d7-e054-4e29-aa1a-b0c6b595d671-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "319656d7-e054-4e29-aa1a-b0c6b595d671" (UID: "319656d7-e054-4e29-aa1a-b0c6b595d671"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 03:27:19.702414 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.702334 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt4sx\" (UniqueName: \"kubernetes.io/projected/319656d7-e054-4e29-aa1a-b0c6b595d671-kube-api-access-pt4sx\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:27:19.702414 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.702409 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/319656d7-e054-4e29-aa1a-b0c6b595d671-oauth-serving-cert\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:27:19.702414 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.702422 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/319656d7-e054-4e29-aa1a-b0c6b595d671-console-serving-cert\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:27:19.702414 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.702433 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/319656d7-e054-4e29-aa1a-b0c6b595d671-console-config\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:27:19.702701 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.702443 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/319656d7-e054-4e29-aa1a-b0c6b595d671-console-oauth-config\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:27:19.702701 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.702452 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/319656d7-e054-4e29-aa1a-b0c6b595d671-service-ca\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:27:19.702701 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.702460 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/319656d7-e054-4e29-aa1a-b0c6b595d671-trusted-ca-bundle\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:27:19.878902 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.878876 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-56cbc6997d-9d5kd_319656d7-e054-4e29-aa1a-b0c6b595d671/console/0.log" May 21 03:27:19.879095 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.878918 2575 generic.go:358] "Generic (PLEG): container finished" podID="319656d7-e054-4e29-aa1a-b0c6b595d671" containerID="2c5f6a5fbc160634101659e97cbc20f5ad996acfdb33b5638125f243f7dd394c" exitCode=2 May 21 03:27:19.879095 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.879002 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56cbc6997d-9d5kd" May 21 03:27:19.879095 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.879020 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56cbc6997d-9d5kd" event={"ID":"319656d7-e054-4e29-aa1a-b0c6b595d671","Type":"ContainerDied","Data":"2c5f6a5fbc160634101659e97cbc20f5ad996acfdb33b5638125f243f7dd394c"} May 21 03:27:19.879095 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.879060 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56cbc6997d-9d5kd" event={"ID":"319656d7-e054-4e29-aa1a-b0c6b595d671","Type":"ContainerDied","Data":"238378336c92cade1e06ac1081ef888de662b4ef7e9c3d08c6d177815b4cf45e"} May 21 03:27:19.879095 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.879080 2575 scope.go:117] "RemoveContainer" containerID="2c5f6a5fbc160634101659e97cbc20f5ad996acfdb33b5638125f243f7dd394c" May 21 03:27:19.889030 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.889009 2575 scope.go:117] "RemoveContainer" containerID="2c5f6a5fbc160634101659e97cbc20f5ad996acfdb33b5638125f243f7dd394c" May 21 03:27:19.889289 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:27:19.889272 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c5f6a5fbc160634101659e97cbc20f5ad996acfdb33b5638125f243f7dd394c\": container with ID starting with 2c5f6a5fbc160634101659e97cbc20f5ad996acfdb33b5638125f243f7dd394c not found: ID does not exist" containerID="2c5f6a5fbc160634101659e97cbc20f5ad996acfdb33b5638125f243f7dd394c" May 21 03:27:19.889334 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.889296 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c5f6a5fbc160634101659e97cbc20f5ad996acfdb33b5638125f243f7dd394c"} err="failed to get container status \"2c5f6a5fbc160634101659e97cbc20f5ad996acfdb33b5638125f243f7dd394c\": rpc error: code = NotFound desc = could not find container \"2c5f6a5fbc160634101659e97cbc20f5ad996acfdb33b5638125f243f7dd394c\": container with ID starting with 2c5f6a5fbc160634101659e97cbc20f5ad996acfdb33b5638125f243f7dd394c not found: ID does not exist" May 21 03:27:19.900826 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.900791 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56cbc6997d-9d5kd"] May 21 03:27:19.904672 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:19.904647 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56cbc6997d-9d5kd"] May 21 03:27:20.208573 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:20.208485 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="319656d7-e054-4e29-aa1a-b0c6b595d671" path="/var/lib/kubelet/pods/319656d7-e054-4e29-aa1a-b0c6b595d671/volumes" May 21 03:27:27.175582 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:27.175549 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-g5ddx"] May 21 03:27:27.175988 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:27.175845 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="319656d7-e054-4e29-aa1a-b0c6b595d671" containerName="console" May 21 03:27:27.175988 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:27.175856 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="319656d7-e054-4e29-aa1a-b0c6b595d671" containerName="console" May 21 03:27:27.175988 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:27.175913 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="319656d7-e054-4e29-aa1a-b0c6b595d671" containerName="console" May 21 03:27:27.178624 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:27.178603 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-g5ddx" May 21 03:27:27.180882 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:27.180859 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5rsxw\"" May 21 03:27:27.186290 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:27.185927 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-g5ddx"] May 21 03:27:27.270419 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:27.270337 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbpr8\" (UniqueName: \"kubernetes.io/projected/8a9f6897-59fd-4c6a-8cd9-35cafc91890e-kube-api-access-vbpr8\") pod \"authorino-f99f4b5cd-g5ddx\" (UID: \"8a9f6897-59fd-4c6a-8cd9-35cafc91890e\") " pod="kuadrant-system/authorino-f99f4b5cd-g5ddx" May 21 03:27:27.371856 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:27.371822 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vbpr8\" (UniqueName: \"kubernetes.io/projected/8a9f6897-59fd-4c6a-8cd9-35cafc91890e-kube-api-access-vbpr8\") pod \"authorino-f99f4b5cd-g5ddx\" (UID: \"8a9f6897-59fd-4c6a-8cd9-35cafc91890e\") " pod="kuadrant-system/authorino-f99f4b5cd-g5ddx" May 21 03:27:27.384871 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:27.384841 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbpr8\" (UniqueName: \"kubernetes.io/projected/8a9f6897-59fd-4c6a-8cd9-35cafc91890e-kube-api-access-vbpr8\") pod \"authorino-f99f4b5cd-g5ddx\" (UID: \"8a9f6897-59fd-4c6a-8cd9-35cafc91890e\") " pod="kuadrant-system/authorino-f99f4b5cd-g5ddx" May 21 03:27:27.408611 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:27.408579 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-497nk"] May 21 03:27:27.411724 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:27.411705 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-497nk" May 21 03:27:27.415442 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:27.415407 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-497nk"] May 21 03:27:27.489365 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:27.489279 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-g5ddx" May 21 03:27:27.573884 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:27.573849 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4k6z\" (UniqueName: \"kubernetes.io/projected/12b0520f-3c4f-4547-ab07-b6683cf04f90-kube-api-access-t4k6z\") pod \"authorino-7498df8756-497nk\" (UID: \"12b0520f-3c4f-4547-ab07-b6683cf04f90\") " pod="kuadrant-system/authorino-7498df8756-497nk" May 21 03:27:27.616134 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:27.616103 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-g5ddx"] May 21 03:27:27.619724 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:27:27.619694 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a9f6897_59fd_4c6a_8cd9_35cafc91890e.slice/crio-cda78b2a429bbf87a97ca6a099c09a51e514f25768148ec401df6ca1acc97535 WatchSource:0}: Error finding container cda78b2a429bbf87a97ca6a099c09a51e514f25768148ec401df6ca1acc97535: Status 404 returned error can't find the container with id cda78b2a429bbf87a97ca6a099c09a51e514f25768148ec401df6ca1acc97535 May 21 03:27:27.675414 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:27.675341 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t4k6z\" (UniqueName: \"kubernetes.io/projected/12b0520f-3c4f-4547-ab07-b6683cf04f90-kube-api-access-t4k6z\") pod \"authorino-7498df8756-497nk\" (UID: \"12b0520f-3c4f-4547-ab07-b6683cf04f90\") " pod="kuadrant-system/authorino-7498df8756-497nk" May 21 03:27:27.682683 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:27.682653 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4k6z\" (UniqueName: \"kubernetes.io/projected/12b0520f-3c4f-4547-ab07-b6683cf04f90-kube-api-access-t4k6z\") pod \"authorino-7498df8756-497nk\" (UID: \"12b0520f-3c4f-4547-ab07-b6683cf04f90\") " pod="kuadrant-system/authorino-7498df8756-497nk" May 21 03:27:27.722566 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:27.722518 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-497nk" May 21 03:27:27.850548 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:27.850516 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-497nk"] May 21 03:27:27.852432 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:27:27.852405 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12b0520f_3c4f_4547_ab07_b6683cf04f90.slice/crio-ce3844d78a5c398a4bc5404400014cec2bf32219b868ceb5ff9bda8f077604dc WatchSource:0}: Error finding container ce3844d78a5c398a4bc5404400014cec2bf32219b868ceb5ff9bda8f077604dc: Status 404 returned error can't find the container with id ce3844d78a5c398a4bc5404400014cec2bf32219b868ceb5ff9bda8f077604dc May 21 03:27:27.919922 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:27.919884 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-g5ddx" event={"ID":"8a9f6897-59fd-4c6a-8cd9-35cafc91890e","Type":"ContainerStarted","Data":"cda78b2a429bbf87a97ca6a099c09a51e514f25768148ec401df6ca1acc97535"} May 21 03:27:27.920901 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:27.920881 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-497nk" event={"ID":"12b0520f-3c4f-4547-ab07-b6683cf04f90","Type":"ContainerStarted","Data":"ce3844d78a5c398a4bc5404400014cec2bf32219b868ceb5ff9bda8f077604dc"} May 21 03:27:31.947804 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:31.947767 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-g5ddx" event={"ID":"8a9f6897-59fd-4c6a-8cd9-35cafc91890e","Type":"ContainerStarted","Data":"8dc31a157a25ae8dc8b12d07f464f98950f84ced03dd915bbc5c04a0769da460"} May 21 03:27:31.949123 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:31.949101 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-497nk" event={"ID":"12b0520f-3c4f-4547-ab07-b6683cf04f90","Type":"ContainerStarted","Data":"2bfbdf2c2c36310b93d967ad8cac1eef1045ef55c74dda0e8342052f3b659e5d"} May 21 03:27:31.962605 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:31.962559 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-g5ddx" podStartSLOduration=1.389606065 podStartE2EDuration="4.962544024s" podCreationTimestamp="2026-05-21 03:27:27 +0000 UTC" firstStartedPulling="2026-05-21 03:27:27.621106962 +0000 UTC m=+471.987327333" lastFinishedPulling="2026-05-21 03:27:31.194044919 +0000 UTC m=+475.560265292" observedRunningTime="2026-05-21 03:27:31.960715253 +0000 UTC m=+476.326935644" watchObservedRunningTime="2026-05-21 03:27:31.962544024 +0000 UTC m=+476.328764491" May 21 03:27:31.974766 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:31.974702 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-497nk" podStartSLOduration=1.649013085 podStartE2EDuration="4.974682957s" podCreationTimestamp="2026-05-21 03:27:27 +0000 UTC" firstStartedPulling="2026-05-21 03:27:27.853738325 +0000 UTC m=+472.219958695" lastFinishedPulling="2026-05-21 03:27:31.179408194 +0000 UTC m=+475.545628567" observedRunningTime="2026-05-21 03:27:31.973118797 +0000 UTC m=+476.339339190" watchObservedRunningTime="2026-05-21 03:27:31.974682957 +0000 UTC m=+476.340903349" May 21 03:27:31.994468 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:31.994427 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-g5ddx"] May 21 03:27:33.957780 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:33.957714 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-g5ddx" podUID="8a9f6897-59fd-4c6a-8cd9-35cafc91890e" containerName="authorino" containerID="cri-o://8dc31a157a25ae8dc8b12d07f464f98950f84ced03dd915bbc5c04a0769da460" gracePeriod=30 May 21 03:27:34.199958 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:34.199931 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-g5ddx" May 21 03:27:34.334569 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:34.334540 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbpr8\" (UniqueName: \"kubernetes.io/projected/8a9f6897-59fd-4c6a-8cd9-35cafc91890e-kube-api-access-vbpr8\") pod \"8a9f6897-59fd-4c6a-8cd9-35cafc91890e\" (UID: \"8a9f6897-59fd-4c6a-8cd9-35cafc91890e\") " May 21 03:27:34.336680 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:34.336644 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a9f6897-59fd-4c6a-8cd9-35cafc91890e-kube-api-access-vbpr8" (OuterVolumeSpecName: "kube-api-access-vbpr8") pod "8a9f6897-59fd-4c6a-8cd9-35cafc91890e" (UID: "8a9f6897-59fd-4c6a-8cd9-35cafc91890e"). InnerVolumeSpecName "kube-api-access-vbpr8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:27:34.435925 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:34.435879 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbpr8\" (UniqueName: \"kubernetes.io/projected/8a9f6897-59fd-4c6a-8cd9-35cafc91890e-kube-api-access-vbpr8\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:27:34.962511 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:34.962471 2575 generic.go:358] "Generic (PLEG): container finished" podID="8a9f6897-59fd-4c6a-8cd9-35cafc91890e" containerID="8dc31a157a25ae8dc8b12d07f464f98950f84ced03dd915bbc5c04a0769da460" exitCode=0 May 21 03:27:34.962511 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:34.962514 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-g5ddx" event={"ID":"8a9f6897-59fd-4c6a-8cd9-35cafc91890e","Type":"ContainerDied","Data":"8dc31a157a25ae8dc8b12d07f464f98950f84ced03dd915bbc5c04a0769da460"} May 21 03:27:34.963024 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:34.962520 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-g5ddx" May 21 03:27:34.963024 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:34.962535 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-g5ddx" event={"ID":"8a9f6897-59fd-4c6a-8cd9-35cafc91890e","Type":"ContainerDied","Data":"cda78b2a429bbf87a97ca6a099c09a51e514f25768148ec401df6ca1acc97535"} May 21 03:27:34.963024 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:34.962555 2575 scope.go:117] "RemoveContainer" containerID="8dc31a157a25ae8dc8b12d07f464f98950f84ced03dd915bbc5c04a0769da460" May 21 03:27:34.971863 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:34.971839 2575 scope.go:117] "RemoveContainer" containerID="8dc31a157a25ae8dc8b12d07f464f98950f84ced03dd915bbc5c04a0769da460" May 21 03:27:34.972114 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:27:34.972093 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dc31a157a25ae8dc8b12d07f464f98950f84ced03dd915bbc5c04a0769da460\": container with ID starting with 8dc31a157a25ae8dc8b12d07f464f98950f84ced03dd915bbc5c04a0769da460 not found: ID does not exist" containerID="8dc31a157a25ae8dc8b12d07f464f98950f84ced03dd915bbc5c04a0769da460" May 21 03:27:34.972160 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:34.972124 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dc31a157a25ae8dc8b12d07f464f98950f84ced03dd915bbc5c04a0769da460"} err="failed to get container status \"8dc31a157a25ae8dc8b12d07f464f98950f84ced03dd915bbc5c04a0769da460\": rpc error: code = NotFound desc = could not find container \"8dc31a157a25ae8dc8b12d07f464f98950f84ced03dd915bbc5c04a0769da460\": container with ID starting with 8dc31a157a25ae8dc8b12d07f464f98950f84ced03dd915bbc5c04a0769da460 not found: ID does not exist" May 21 03:27:34.983797 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:34.983772 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-g5ddx"] May 21 03:27:34.987119 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:34.987097 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-g5ddx"] May 21 03:27:36.205200 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:36.205164 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a9f6897-59fd-4c6a-8cd9-35cafc91890e" path="/var/lib/kubelet/pods/8a9f6897-59fd-4c6a-8cd9-35cafc91890e/volumes" May 21 03:27:58.681042 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:58.681008 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-nhdkd"] May 21 03:27:58.681563 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:58.681305 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a9f6897-59fd-4c6a-8cd9-35cafc91890e" containerName="authorino" May 21 03:27:58.681563 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:58.681315 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a9f6897-59fd-4c6a-8cd9-35cafc91890e" containerName="authorino" May 21 03:27:58.681563 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:58.681388 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="8a9f6897-59fd-4c6a-8cd9-35cafc91890e" containerName="authorino" May 21 03:27:58.684109 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:58.684086 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-nhdkd" May 21 03:27:58.690210 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:58.690186 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-nhdkd"] May 21 03:27:58.743508 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:58.743472 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9db8g\" (UniqueName: \"kubernetes.io/projected/4d4a97af-125f-4b91-b97a-2b39c359743a-kube-api-access-9db8g\") pod \"authorino-8b475cf9f-nhdkd\" (UID: \"4d4a97af-125f-4b91-b97a-2b39c359743a\") " pod="kuadrant-system/authorino-8b475cf9f-nhdkd" May 21 03:27:58.844710 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:58.844663 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9db8g\" (UniqueName: \"kubernetes.io/projected/4d4a97af-125f-4b91-b97a-2b39c359743a-kube-api-access-9db8g\") pod \"authorino-8b475cf9f-nhdkd\" (UID: \"4d4a97af-125f-4b91-b97a-2b39c359743a\") " pod="kuadrant-system/authorino-8b475cf9f-nhdkd" May 21 03:27:58.855375 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:58.852328 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-nhdkd"] May 21 03:27:58.855375 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:27:58.852974 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-9db8g], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-nhdkd" podUID="4d4a97af-125f-4b91-b97a-2b39c359743a" May 21 03:27:58.855375 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:58.854693 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9db8g\" (UniqueName: \"kubernetes.io/projected/4d4a97af-125f-4b91-b97a-2b39c359743a-kube-api-access-9db8g\") pod \"authorino-8b475cf9f-nhdkd\" (UID: \"4d4a97af-125f-4b91-b97a-2b39c359743a\") " pod="kuadrant-system/authorino-8b475cf9f-nhdkd" May 21 03:27:58.880067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:58.880036 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56fdd757f5-b2w72"] May 21 03:27:58.883358 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:58.883332 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-b2w72" May 21 03:27:58.885742 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:58.885717 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 21 03:27:58.891991 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:58.891966 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-b2w72"] May 21 03:27:58.926702 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:58.926667 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-b2w72"] May 21 03:27:58.926924 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:27:58.926906 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-9hnb9 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-56fdd757f5-b2w72" podUID="ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4" May 21 03:27:58.945804 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:58.945722 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hnb9\" (UniqueName: \"kubernetes.io/projected/ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4-kube-api-access-9hnb9\") pod \"authorino-56fdd757f5-b2w72\" (UID: \"ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4\") " pod="kuadrant-system/authorino-56fdd757f5-b2w72" May 21 03:27:58.945804 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:58.945786 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4-tls-cert\") pod \"authorino-56fdd757f5-b2w72\" (UID: \"ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4\") " pod="kuadrant-system/authorino-56fdd757f5-b2w72" May 21 03:27:58.952520 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:58.952490 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-69fdd45b69-l5bl8"] May 21 03:27:58.955712 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:58.955698 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69fdd45b69-l5bl8" May 21 03:27:58.961166 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:58.961145 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69fdd45b69-l5bl8"] May 21 03:27:59.046310 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.046269 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb550ca8-caae-4119-8455-285640091ab4-tls-cert\") pod \"authorino-69fdd45b69-l5bl8\" (UID: \"fb550ca8-caae-4119-8455-285640091ab4\") " pod="kuadrant-system/authorino-69fdd45b69-l5bl8" May 21 03:27:59.046516 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.046339 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4-tls-cert\") pod \"authorino-56fdd757f5-b2w72\" (UID: \"ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4\") " pod="kuadrant-system/authorino-56fdd757f5-b2w72" May 21 03:27:59.046516 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.046410 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj896\" (UniqueName: \"kubernetes.io/projected/fb550ca8-caae-4119-8455-285640091ab4-kube-api-access-wj896\") pod \"authorino-69fdd45b69-l5bl8\" (UID: \"fb550ca8-caae-4119-8455-285640091ab4\") " pod="kuadrant-system/authorino-69fdd45b69-l5bl8" May 21 03:27:59.046516 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.046460 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9hnb9\" (UniqueName: \"kubernetes.io/projected/ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4-kube-api-access-9hnb9\") pod \"authorino-56fdd757f5-b2w72\" (UID: \"ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4\") " pod="kuadrant-system/authorino-56fdd757f5-b2w72" May 21 03:27:59.048924 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.048900 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4-tls-cert\") pod \"authorino-56fdd757f5-b2w72\" (UID: \"ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4\") " pod="kuadrant-system/authorino-56fdd757f5-b2w72" May 21 03:27:59.049781 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.049770 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-nhdkd" May 21 03:27:59.049832 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.049778 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-b2w72" May 21 03:27:59.053801 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.053777 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hnb9\" (UniqueName: \"kubernetes.io/projected/ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4-kube-api-access-9hnb9\") pod \"authorino-56fdd757f5-b2w72\" (UID: \"ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4\") " pod="kuadrant-system/authorino-56fdd757f5-b2w72" May 21 03:27:59.067158 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.067136 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-nhdkd" May 21 03:27:59.070333 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.070313 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-b2w72" May 21 03:27:59.147261 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.147226 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9db8g\" (UniqueName: \"kubernetes.io/projected/4d4a97af-125f-4b91-b97a-2b39c359743a-kube-api-access-9db8g\") pod \"4d4a97af-125f-4b91-b97a-2b39c359743a\" (UID: \"4d4a97af-125f-4b91-b97a-2b39c359743a\") " May 21 03:27:59.147466 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.147374 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hnb9\" (UniqueName: \"kubernetes.io/projected/ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4-kube-api-access-9hnb9\") pod \"ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4\" (UID: \"ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4\") " May 21 03:27:59.147466 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.147398 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4-tls-cert\") pod \"ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4\" (UID: \"ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4\") " May 21 03:27:59.147549 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.147499 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb550ca8-caae-4119-8455-285640091ab4-tls-cert\") pod \"authorino-69fdd45b69-l5bl8\" (UID: \"fb550ca8-caae-4119-8455-285640091ab4\") " pod="kuadrant-system/authorino-69fdd45b69-l5bl8" May 21 03:27:59.147595 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.147548 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wj896\" (UniqueName: \"kubernetes.io/projected/fb550ca8-caae-4119-8455-285640091ab4-kube-api-access-wj896\") pod \"authorino-69fdd45b69-l5bl8\" (UID: \"fb550ca8-caae-4119-8455-285640091ab4\") " pod="kuadrant-system/authorino-69fdd45b69-l5bl8" May 21 03:27:59.149487 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.149453 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4" (UID: "ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 03:27:59.149621 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.149537 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4-kube-api-access-9hnb9" (OuterVolumeSpecName: "kube-api-access-9hnb9") pod "ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4" (UID: "ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4"). InnerVolumeSpecName "kube-api-access-9hnb9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:27:59.149621 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.149544 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d4a97af-125f-4b91-b97a-2b39c359743a-kube-api-access-9db8g" (OuterVolumeSpecName: "kube-api-access-9db8g") pod "4d4a97af-125f-4b91-b97a-2b39c359743a" (UID: "4d4a97af-125f-4b91-b97a-2b39c359743a"). InnerVolumeSpecName "kube-api-access-9db8g". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:27:59.149874 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.149857 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb550ca8-caae-4119-8455-285640091ab4-tls-cert\") pod \"authorino-69fdd45b69-l5bl8\" (UID: \"fb550ca8-caae-4119-8455-285640091ab4\") " pod="kuadrant-system/authorino-69fdd45b69-l5bl8" May 21 03:27:59.154438 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.154421 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj896\" (UniqueName: \"kubernetes.io/projected/fb550ca8-caae-4119-8455-285640091ab4-kube-api-access-wj896\") pod \"authorino-69fdd45b69-l5bl8\" (UID: \"fb550ca8-caae-4119-8455-285640091ab4\") " pod="kuadrant-system/authorino-69fdd45b69-l5bl8" May 21 03:27:59.248768 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.248676 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hnb9\" (UniqueName: \"kubernetes.io/projected/ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4-kube-api-access-9hnb9\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:27:59.248768 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.248707 2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4-tls-cert\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:27:59.248768 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.248723 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9db8g\" (UniqueName: \"kubernetes.io/projected/4d4a97af-125f-4b91-b97a-2b39c359743a-kube-api-access-9db8g\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:27:59.265099 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.265064 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69fdd45b69-l5bl8" May 21 03:27:59.398576 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:27:59.398545 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69fdd45b69-l5bl8"] May 21 03:27:59.400531 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:27:59.400498 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb550ca8_caae_4119_8455_285640091ab4.slice/crio-dbfa79bc3deb6595bade4fc83863ec95addc5c3d0adc1da961dc499c5f308f7b WatchSource:0}: Error finding container dbfa79bc3deb6595bade4fc83863ec95addc5c3d0adc1da961dc499c5f308f7b: Status 404 returned error can't find the container with id dbfa79bc3deb6595bade4fc83863ec95addc5c3d0adc1da961dc499c5f308f7b May 21 03:28:00.054760 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:00.054729 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-b2w72" May 21 03:28:00.055234 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:00.054762 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69fdd45b69-l5bl8" event={"ID":"fb550ca8-caae-4119-8455-285640091ab4","Type":"ContainerStarted","Data":"e9455b4d2422cd491d588996994156418e123efaf69aec40aae8bb4daf6fb361"} May 21 03:28:00.055234 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:00.054793 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69fdd45b69-l5bl8" event={"ID":"fb550ca8-caae-4119-8455-285640091ab4","Type":"ContainerStarted","Data":"dbfa79bc3deb6595bade4fc83863ec95addc5c3d0adc1da961dc499c5f308f7b"} May 21 03:28:00.055234 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:00.054915 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-nhdkd" May 21 03:28:00.072112 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:00.072056 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-69fdd45b69-l5bl8" podStartSLOduration=1.768482761 podStartE2EDuration="2.07203923s" podCreationTimestamp="2026-05-21 03:27:58 +0000 UTC" firstStartedPulling="2026-05-21 03:27:59.401618657 +0000 UTC m=+503.767839027" lastFinishedPulling="2026-05-21 03:27:59.705175126 +0000 UTC m=+504.071395496" observedRunningTime="2026-05-21 03:28:00.071466728 +0000 UTC m=+504.437687119" watchObservedRunningTime="2026-05-21 03:28:00.07203923 +0000 UTC m=+504.438259623" May 21 03:28:00.094176 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:00.094144 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-b2w72"] May 21 03:28:00.099206 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:00.099177 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-497nk"] May 21 03:28:00.099407 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:00.099384 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-497nk" podUID="12b0520f-3c4f-4547-ab07-b6683cf04f90" containerName="authorino" containerID="cri-o://2bfbdf2c2c36310b93d967ad8cac1eef1045ef55c74dda0e8342052f3b659e5d" gracePeriod=30 May 21 03:28:00.105630 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:00.105604 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-b2w72"] May 21 03:28:00.127156 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:00.127126 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-nhdkd"] May 21 03:28:00.130316 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:00.130277 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-nhdkd"] May 21 03:28:00.204985 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:00.204954 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d4a97af-125f-4b91-b97a-2b39c359743a" path="/var/lib/kubelet/pods/4d4a97af-125f-4b91-b97a-2b39c359743a/volumes" May 21 03:28:00.205204 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:00.205193 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4" path="/var/lib/kubelet/pods/ba90c5fe-e7db-4f39-b935-ee6bf8d3d5f4/volumes" May 21 03:28:00.361396 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:00.361372 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-497nk" May 21 03:28:00.459625 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:00.459584 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4k6z\" (UniqueName: \"kubernetes.io/projected/12b0520f-3c4f-4547-ab07-b6683cf04f90-kube-api-access-t4k6z\") pod \"12b0520f-3c4f-4547-ab07-b6683cf04f90\" (UID: \"12b0520f-3c4f-4547-ab07-b6683cf04f90\") " May 21 03:28:00.461659 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:00.461635 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12b0520f-3c4f-4547-ab07-b6683cf04f90-kube-api-access-t4k6z" (OuterVolumeSpecName: "kube-api-access-t4k6z") pod "12b0520f-3c4f-4547-ab07-b6683cf04f90" (UID: "12b0520f-3c4f-4547-ab07-b6683cf04f90"). InnerVolumeSpecName "kube-api-access-t4k6z". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:28:00.560464 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:00.560426 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4k6z\" (UniqueName: \"kubernetes.io/projected/12b0520f-3c4f-4547-ab07-b6683cf04f90-kube-api-access-t4k6z\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:28:01.059612 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:01.059573 2575 generic.go:358] "Generic (PLEG): container finished" podID="12b0520f-3c4f-4547-ab07-b6683cf04f90" containerID="2bfbdf2c2c36310b93d967ad8cac1eef1045ef55c74dda0e8342052f3b659e5d" exitCode=0 May 21 03:28:01.060048 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:01.059627 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-497nk" May 21 03:28:01.060048 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:01.059658 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-497nk" event={"ID":"12b0520f-3c4f-4547-ab07-b6683cf04f90","Type":"ContainerDied","Data":"2bfbdf2c2c36310b93d967ad8cac1eef1045ef55c74dda0e8342052f3b659e5d"} May 21 03:28:01.060048 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:01.059698 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-497nk" event={"ID":"12b0520f-3c4f-4547-ab07-b6683cf04f90","Type":"ContainerDied","Data":"ce3844d78a5c398a4bc5404400014cec2bf32219b868ceb5ff9bda8f077604dc"} May 21 03:28:01.060048 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:01.059713 2575 scope.go:117] "RemoveContainer" containerID="2bfbdf2c2c36310b93d967ad8cac1eef1045ef55c74dda0e8342052f3b659e5d" May 21 03:28:01.069130 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:01.069106 2575 scope.go:117] "RemoveContainer" containerID="2bfbdf2c2c36310b93d967ad8cac1eef1045ef55c74dda0e8342052f3b659e5d" May 21 03:28:01.069436 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:28:01.069417 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bfbdf2c2c36310b93d967ad8cac1eef1045ef55c74dda0e8342052f3b659e5d\": container with ID starting with 2bfbdf2c2c36310b93d967ad8cac1eef1045ef55c74dda0e8342052f3b659e5d not found: ID does not exist" containerID="2bfbdf2c2c36310b93d967ad8cac1eef1045ef55c74dda0e8342052f3b659e5d" May 21 03:28:01.069487 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:01.069446 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bfbdf2c2c36310b93d967ad8cac1eef1045ef55c74dda0e8342052f3b659e5d"} err="failed to get container status \"2bfbdf2c2c36310b93d967ad8cac1eef1045ef55c74dda0e8342052f3b659e5d\": rpc error: code = NotFound desc = could not find container \"2bfbdf2c2c36310b93d967ad8cac1eef1045ef55c74dda0e8342052f3b659e5d\": container with ID starting with 2bfbdf2c2c36310b93d967ad8cac1eef1045ef55c74dda0e8342052f3b659e5d not found: ID does not exist" May 21 03:28:01.080992 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:01.080965 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-497nk"] May 21 03:28:01.086562 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:01.086539 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-497nk"] May 21 03:28:02.210039 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:02.210003 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12b0520f-3c4f-4547-ab07-b6683cf04f90" path="/var/lib/kubelet/pods/12b0520f-3c4f-4547-ab07-b6683cf04f90/volumes" May 21 03:28:03.557279 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:03.557237 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-765c799b5d-s6sk7"] May 21 03:28:03.557715 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:03.557618 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12b0520f-3c4f-4547-ab07-b6683cf04f90" containerName="authorino" May 21 03:28:03.557715 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:03.557633 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="12b0520f-3c4f-4547-ab07-b6683cf04f90" containerName="authorino" May 21 03:28:03.557715 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:03.557696 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="12b0520f-3c4f-4547-ab07-b6683cf04f90" containerName="authorino" May 21 03:28:03.562019 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:03.562004 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-765c799b5d-s6sk7" May 21 03:28:03.564180 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:03.564156 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 03:28:03.564320 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:03.564263 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-h48fc\"" May 21 03:28:03.570521 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:03.570499 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-765c799b5d-s6sk7"] May 21 03:28:03.686652 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:03.686617 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swhdr\" (UniqueName: \"kubernetes.io/projected/638c7989-6ce9-4763-a9ed-15a0264b846c-kube-api-access-swhdr\") pod \"maas-controller-765c799b5d-s6sk7\" (UID: \"638c7989-6ce9-4763-a9ed-15a0264b846c\") " pod="opendatahub/maas-controller-765c799b5d-s6sk7" May 21 03:28:03.719868 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:03.719832 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6485c8677d-rh2mw"] May 21 03:28:03.723163 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:03.723142 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6485c8677d-rh2mw" May 21 03:28:03.733837 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:03.733811 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6485c8677d-rh2mw"] May 21 03:28:03.787773 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:03.787733 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-swhdr\" (UniqueName: \"kubernetes.io/projected/638c7989-6ce9-4763-a9ed-15a0264b846c-kube-api-access-swhdr\") pod \"maas-controller-765c799b5d-s6sk7\" (UID: \"638c7989-6ce9-4763-a9ed-15a0264b846c\") " pod="opendatahub/maas-controller-765c799b5d-s6sk7" May 21 03:28:03.787957 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:03.787792 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm664\" (UniqueName: \"kubernetes.io/projected/fcfa892d-9a48-4b41-9a47-ae288a52975d-kube-api-access-sm664\") pod \"maas-controller-6485c8677d-rh2mw\" (UID: \"fcfa892d-9a48-4b41-9a47-ae288a52975d\") " pod="opendatahub/maas-controller-6485c8677d-rh2mw" May 21 03:28:03.796288 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:03.796253 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swhdr\" (UniqueName: \"kubernetes.io/projected/638c7989-6ce9-4763-a9ed-15a0264b846c-kube-api-access-swhdr\") pod \"maas-controller-765c799b5d-s6sk7\" (UID: \"638c7989-6ce9-4763-a9ed-15a0264b846c\") " pod="opendatahub/maas-controller-765c799b5d-s6sk7" May 21 03:28:03.873041 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:03.872948 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-765c799b5d-s6sk7" May 21 03:28:03.889211 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:03.889176 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sm664\" (UniqueName: \"kubernetes.io/projected/fcfa892d-9a48-4b41-9a47-ae288a52975d-kube-api-access-sm664\") pod \"maas-controller-6485c8677d-rh2mw\" (UID: \"fcfa892d-9a48-4b41-9a47-ae288a52975d\") " pod="opendatahub/maas-controller-6485c8677d-rh2mw" May 21 03:28:03.897729 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:03.897701 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm664\" (UniqueName: \"kubernetes.io/projected/fcfa892d-9a48-4b41-9a47-ae288a52975d-kube-api-access-sm664\") pod \"maas-controller-6485c8677d-rh2mw\" (UID: \"fcfa892d-9a48-4b41-9a47-ae288a52975d\") " pod="opendatahub/maas-controller-6485c8677d-rh2mw" May 21 03:28:04.007039 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:04.007015 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-765c799b5d-s6sk7"] May 21 03:28:04.008927 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:28:04.008891 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod638c7989_6ce9_4763_a9ed_15a0264b846c.slice/crio-d3bde2f522e149c9046be66363be56793e18430cf3ca20259fb35c183c2534bb WatchSource:0}: Error finding container d3bde2f522e149c9046be66363be56793e18430cf3ca20259fb35c183c2534bb: Status 404 returned error can't find the container with id d3bde2f522e149c9046be66363be56793e18430cf3ca20259fb35c183c2534bb May 21 03:28:04.033822 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:04.033790 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6485c8677d-rh2mw" May 21 03:28:04.074498 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:04.074455 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-765c799b5d-s6sk7" event={"ID":"638c7989-6ce9-4763-a9ed-15a0264b846c","Type":"ContainerStarted","Data":"d3bde2f522e149c9046be66363be56793e18430cf3ca20259fb35c183c2534bb"} May 21 03:28:04.165330 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:04.165302 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6485c8677d-rh2mw"] May 21 03:28:04.166684 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:28:04.166652 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcfa892d_9a48_4b41_9a47_ae288a52975d.slice/crio-517282cbd46155180b9836f0032d806c1e1bd64820266b70c2522604f478e3ab WatchSource:0}: Error finding container 517282cbd46155180b9836f0032d806c1e1bd64820266b70c2522604f478e3ab: Status 404 returned error can't find the container with id 517282cbd46155180b9836f0032d806c1e1bd64820266b70c2522604f478e3ab May 21 03:28:05.081282 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:05.081236 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6485c8677d-rh2mw" event={"ID":"fcfa892d-9a48-4b41-9a47-ae288a52975d","Type":"ContainerStarted","Data":"517282cbd46155180b9836f0032d806c1e1bd64820266b70c2522604f478e3ab"} May 21 03:28:07.092688 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:07.092645 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-765c799b5d-s6sk7" event={"ID":"638c7989-6ce9-4763-a9ed-15a0264b846c","Type":"ContainerStarted","Data":"5777630033b312f6b3b9eafd8b0372d55a09c32cec7a9bc75f18dc8f0f8130dd"} May 21 03:28:07.092688 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:07.092696 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-765c799b5d-s6sk7" May 21 03:28:07.093999 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:07.093962 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6485c8677d-rh2mw" event={"ID":"fcfa892d-9a48-4b41-9a47-ae288a52975d","Type":"ContainerStarted","Data":"d0304a893303d35b894c10691411040a450bf6911afafc5b856addb27885c0f2"} May 21 03:28:07.094285 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:07.094093 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6485c8677d-rh2mw" May 21 03:28:07.107612 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:07.107564 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-765c799b5d-s6sk7" podStartSLOduration=1.450320817 podStartE2EDuration="4.107549678s" podCreationTimestamp="2026-05-21 03:28:03 +0000 UTC" firstStartedPulling="2026-05-21 03:28:04.010455504 +0000 UTC m=+508.376675874" lastFinishedPulling="2026-05-21 03:28:06.667684355 +0000 UTC m=+511.033904735" observedRunningTime="2026-05-21 03:28:07.106325663 +0000 UTC m=+511.472546055" watchObservedRunningTime="2026-05-21 03:28:07.107549678 +0000 UTC m=+511.473770071" May 21 03:28:07.130929 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:07.130874 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6485c8677d-rh2mw" podStartSLOduration=1.6204517250000001 podStartE2EDuration="4.130858937s" podCreationTimestamp="2026-05-21 03:28:03 +0000 UTC" firstStartedPulling="2026-05-21 03:28:04.168035171 +0000 UTC m=+508.534255540" lastFinishedPulling="2026-05-21 03:28:06.678442367 +0000 UTC m=+511.044662752" observedRunningTime="2026-05-21 03:28:07.128310422 +0000 UTC m=+511.494530825" watchObservedRunningTime="2026-05-21 03:28:07.130858937 +0000 UTC m=+511.497079329" May 21 03:28:18.105430 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:18.105398 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6485c8677d-rh2mw" May 21 03:28:18.105865 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:18.105451 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-765c799b5d-s6sk7" May 21 03:28:18.157280 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:18.157245 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-765c799b5d-s6sk7"] May 21 03:28:18.157526 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:18.157482 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-765c799b5d-s6sk7" podUID="638c7989-6ce9-4763-a9ed-15a0264b846c" containerName="manager" containerID="cri-o://5777630033b312f6b3b9eafd8b0372d55a09c32cec7a9bc75f18dc8f0f8130dd" gracePeriod=30 May 21 03:28:18.402614 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:18.402588 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-765c799b5d-s6sk7" May 21 03:28:18.428403 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:18.428339 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swhdr\" (UniqueName: \"kubernetes.io/projected/638c7989-6ce9-4763-a9ed-15a0264b846c-kube-api-access-swhdr\") pod \"638c7989-6ce9-4763-a9ed-15a0264b846c\" (UID: \"638c7989-6ce9-4763-a9ed-15a0264b846c\") " May 21 03:28:18.430677 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:18.430645 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/638c7989-6ce9-4763-a9ed-15a0264b846c-kube-api-access-swhdr" (OuterVolumeSpecName: "kube-api-access-swhdr") pod "638c7989-6ce9-4763-a9ed-15a0264b846c" (UID: "638c7989-6ce9-4763-a9ed-15a0264b846c"). InnerVolumeSpecName "kube-api-access-swhdr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:28:18.529320 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:18.529286 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swhdr\" (UniqueName: \"kubernetes.io/projected/638c7989-6ce9-4763-a9ed-15a0264b846c-kube-api-access-swhdr\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:28:19.140942 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:19.140908 2575 generic.go:358] "Generic (PLEG): container finished" podID="638c7989-6ce9-4763-a9ed-15a0264b846c" containerID="5777630033b312f6b3b9eafd8b0372d55a09c32cec7a9bc75f18dc8f0f8130dd" exitCode=0 May 21 03:28:19.141391 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:19.140950 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-765c799b5d-s6sk7" event={"ID":"638c7989-6ce9-4763-a9ed-15a0264b846c","Type":"ContainerDied","Data":"5777630033b312f6b3b9eafd8b0372d55a09c32cec7a9bc75f18dc8f0f8130dd"} May 21 03:28:19.141391 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:19.140967 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-765c799b5d-s6sk7" May 21 03:28:19.141391 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:19.140986 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-765c799b5d-s6sk7" event={"ID":"638c7989-6ce9-4763-a9ed-15a0264b846c","Type":"ContainerDied","Data":"d3bde2f522e149c9046be66363be56793e18430cf3ca20259fb35c183c2534bb"} May 21 03:28:19.141391 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:19.141003 2575 scope.go:117] "RemoveContainer" containerID="5777630033b312f6b3b9eafd8b0372d55a09c32cec7a9bc75f18dc8f0f8130dd" May 21 03:28:19.150608 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:19.150589 2575 scope.go:117] "RemoveContainer" containerID="5777630033b312f6b3b9eafd8b0372d55a09c32cec7a9bc75f18dc8f0f8130dd" May 21 03:28:19.150850 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:28:19.150829 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5777630033b312f6b3b9eafd8b0372d55a09c32cec7a9bc75f18dc8f0f8130dd\": container with ID starting with 5777630033b312f6b3b9eafd8b0372d55a09c32cec7a9bc75f18dc8f0f8130dd not found: ID does not exist" containerID="5777630033b312f6b3b9eafd8b0372d55a09c32cec7a9bc75f18dc8f0f8130dd" May 21 03:28:19.150908 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:19.150861 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5777630033b312f6b3b9eafd8b0372d55a09c32cec7a9bc75f18dc8f0f8130dd"} err="failed to get container status \"5777630033b312f6b3b9eafd8b0372d55a09c32cec7a9bc75f18dc8f0f8130dd\": rpc error: code = NotFound desc = could not find container \"5777630033b312f6b3b9eafd8b0372d55a09c32cec7a9bc75f18dc8f0f8130dd\": container with ID starting with 5777630033b312f6b3b9eafd8b0372d55a09c32cec7a9bc75f18dc8f0f8130dd not found: ID does not exist" May 21 03:28:19.165293 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:19.165259 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-765c799b5d-s6sk7"] May 21 03:28:19.169027 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:19.168999 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-765c799b5d-s6sk7"] May 21 03:28:20.205878 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:20.205847 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="638c7989-6ce9-4763-a9ed-15a0264b846c" path="/var/lib/kubelet/pods/638c7989-6ce9-4763-a9ed-15a0264b846c/volumes" May 21 03:28:32.280072 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:32.279974 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6485c8677d-rh2mw"] May 21 03:28:32.280635 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:32.280237 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-6485c8677d-rh2mw" podUID="fcfa892d-9a48-4b41-9a47-ae288a52975d" containerName="manager" containerID="cri-o://d0304a893303d35b894c10691411040a450bf6911afafc5b856addb27885c0f2" gracePeriod=30 May 21 03:28:32.524889 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:32.524862 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6485c8677d-rh2mw" May 21 03:28:32.654256 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:32.654218 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sm664\" (UniqueName: \"kubernetes.io/projected/fcfa892d-9a48-4b41-9a47-ae288a52975d-kube-api-access-sm664\") pod \"fcfa892d-9a48-4b41-9a47-ae288a52975d\" (UID: \"fcfa892d-9a48-4b41-9a47-ae288a52975d\") " May 21 03:28:32.656334 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:32.656307 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcfa892d-9a48-4b41-9a47-ae288a52975d-kube-api-access-sm664" (OuterVolumeSpecName: "kube-api-access-sm664") pod "fcfa892d-9a48-4b41-9a47-ae288a52975d" (UID: "fcfa892d-9a48-4b41-9a47-ae288a52975d"). InnerVolumeSpecName "kube-api-access-sm664". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:28:32.755067 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:32.755033 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sm664\" (UniqueName: \"kubernetes.io/projected/fcfa892d-9a48-4b41-9a47-ae288a52975d-kube-api-access-sm664\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:28:33.197259 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:33.197217 2575 generic.go:358] "Generic (PLEG): container finished" podID="fcfa892d-9a48-4b41-9a47-ae288a52975d" containerID="d0304a893303d35b894c10691411040a450bf6911afafc5b856addb27885c0f2" exitCode=0 May 21 03:28:33.197461 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:33.197281 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6485c8677d-rh2mw" May 21 03:28:33.197461 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:33.197300 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6485c8677d-rh2mw" event={"ID":"fcfa892d-9a48-4b41-9a47-ae288a52975d","Type":"ContainerDied","Data":"d0304a893303d35b894c10691411040a450bf6911afafc5b856addb27885c0f2"} May 21 03:28:33.197461 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:33.197341 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6485c8677d-rh2mw" event={"ID":"fcfa892d-9a48-4b41-9a47-ae288a52975d","Type":"ContainerDied","Data":"517282cbd46155180b9836f0032d806c1e1bd64820266b70c2522604f478e3ab"} May 21 03:28:33.197461 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:33.197380 2575 scope.go:117] "RemoveContainer" containerID="d0304a893303d35b894c10691411040a450bf6911afafc5b856addb27885c0f2" May 21 03:28:33.206476 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:33.206454 2575 scope.go:117] "RemoveContainer" containerID="d0304a893303d35b894c10691411040a450bf6911afafc5b856addb27885c0f2" May 21 03:28:33.206732 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:28:33.206712 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0304a893303d35b894c10691411040a450bf6911afafc5b856addb27885c0f2\": container with ID starting with d0304a893303d35b894c10691411040a450bf6911afafc5b856addb27885c0f2 not found: ID does not exist" containerID="d0304a893303d35b894c10691411040a450bf6911afafc5b856addb27885c0f2" May 21 03:28:33.206785 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:33.206741 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0304a893303d35b894c10691411040a450bf6911afafc5b856addb27885c0f2"} err="failed to get container status \"d0304a893303d35b894c10691411040a450bf6911afafc5b856addb27885c0f2\": rpc error: code = NotFound desc = could not find container \"d0304a893303d35b894c10691411040a450bf6911afafc5b856addb27885c0f2\": container with ID starting with d0304a893303d35b894c10691411040a450bf6911afafc5b856addb27885c0f2 not found: ID does not exist" May 21 03:28:33.218255 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:33.218222 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6485c8677d-rh2mw"] May 21 03:28:33.221538 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:33.221515 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6485c8677d-rh2mw"] May 21 03:28:34.206157 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:34.206125 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcfa892d-9a48-4b41-9a47-ae288a52975d" path="/var/lib/kubelet/pods/fcfa892d-9a48-4b41-9a47-ae288a52975d/volumes" May 21 03:28:51.427405 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.427367 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6b87f59566-9krh9"] May 21 03:28:51.427878 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.427690 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="638c7989-6ce9-4763-a9ed-15a0264b846c" containerName="manager" May 21 03:28:51.427878 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.427701 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="638c7989-6ce9-4763-a9ed-15a0264b846c" containerName="manager" May 21 03:28:51.427878 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.427723 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcfa892d-9a48-4b41-9a47-ae288a52975d" containerName="manager" May 21 03:28:51.427878 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.427729 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcfa892d-9a48-4b41-9a47-ae288a52975d" containerName="manager" May 21 03:28:51.427878 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.427774 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="638c7989-6ce9-4763-a9ed-15a0264b846c" containerName="manager" May 21 03:28:51.427878 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.427781 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="fcfa892d-9a48-4b41-9a47-ae288a52975d" containerName="manager" May 21 03:28:51.433970 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.433952 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6b87f59566-9krh9" May 21 03:28:51.436904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.436878 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 21 03:28:51.436904 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.436892 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 03:28:51.437049 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.436953 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-w6zwm\"" May 21 03:28:51.442341 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.442319 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6b87f59566-9krh9"] May 21 03:28:51.521776 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.521732 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-284q9\" (UniqueName: \"kubernetes.io/projected/d6a7018f-1636-48f6-924b-45ea7c890db0-kube-api-access-284q9\") pod \"maas-api-6b87f59566-9krh9\" (UID: \"d6a7018f-1636-48f6-924b-45ea7c890db0\") " pod="opendatahub/maas-api-6b87f59566-9krh9" May 21 03:28:51.521970 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.521855 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6a7018f-1636-48f6-924b-45ea7c890db0-maas-api-tls\") pod \"maas-api-6b87f59566-9krh9\" (UID: \"d6a7018f-1636-48f6-924b-45ea7c890db0\") " pod="opendatahub/maas-api-6b87f59566-9krh9" May 21 03:28:51.623263 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.623223 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6a7018f-1636-48f6-924b-45ea7c890db0-maas-api-tls\") pod \"maas-api-6b87f59566-9krh9\" (UID: \"d6a7018f-1636-48f6-924b-45ea7c890db0\") " pod="opendatahub/maas-api-6b87f59566-9krh9" May 21 03:28:51.623468 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.623315 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-284q9\" (UniqueName: \"kubernetes.io/projected/d6a7018f-1636-48f6-924b-45ea7c890db0-kube-api-access-284q9\") pod \"maas-api-6b87f59566-9krh9\" (UID: \"d6a7018f-1636-48f6-924b-45ea7c890db0\") " pod="opendatahub/maas-api-6b87f59566-9krh9" May 21 03:28:51.625742 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.625717 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6a7018f-1636-48f6-924b-45ea7c890db0-maas-api-tls\") pod \"maas-api-6b87f59566-9krh9\" (UID: \"d6a7018f-1636-48f6-924b-45ea7c890db0\") " pod="opendatahub/maas-api-6b87f59566-9krh9" May 21 03:28:51.630814 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.630788 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-284q9\" (UniqueName: \"kubernetes.io/projected/d6a7018f-1636-48f6-924b-45ea7c890db0-kube-api-access-284q9\") pod \"maas-api-6b87f59566-9krh9\" (UID: \"d6a7018f-1636-48f6-924b-45ea7c890db0\") " pod="opendatahub/maas-api-6b87f59566-9krh9" May 21 03:28:51.745749 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.745657 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6b87f59566-9krh9" May 21 03:28:51.773151 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.773117 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-qzdmv"] May 21 03:28:51.777722 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.777698 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-qzdmv" May 21 03:28:51.780002 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.779976 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 21 03:28:51.780156 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.780058 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-bbr9r\"" May 21 03:28:51.787675 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.787649 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-qzdmv"] May 21 03:28:51.894269 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.894236 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6b87f59566-9krh9"] May 21 03:28:51.897711 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:28:51.897682 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a7018f_1636_48f6_924b_45ea7c890db0.slice/crio-112ad6fef4a886a76994043899f1c535566063f1f0fb9d79bae46b39302cdc39 WatchSource:0}: Error finding container 112ad6fef4a886a76994043899f1c535566063f1f0fb9d79bae46b39302cdc39: Status 404 returned error can't find the container with id 112ad6fef4a886a76994043899f1c535566063f1f0fb9d79bae46b39302cdc39 May 21 03:28:51.927284 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:51.927252 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlc96\" (UniqueName: \"kubernetes.io/projected/a39f3ad5-c0e4-46fa-ac08-967b79df17b2-kube-api-access-hlc96\") pod \"payload-processing-58b6c8fdc7-qzdmv\" (UID: \"a39f3ad5-c0e4-46fa-ac08-967b79df17b2\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-qzdmv" May 21 03:28:52.028776 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:52.028689 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hlc96\" (UniqueName: \"kubernetes.io/projected/a39f3ad5-c0e4-46fa-ac08-967b79df17b2-kube-api-access-hlc96\") pod \"payload-processing-58b6c8fdc7-qzdmv\" (UID: \"a39f3ad5-c0e4-46fa-ac08-967b79df17b2\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-qzdmv" May 21 03:28:52.041043 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:52.041014 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlc96\" (UniqueName: \"kubernetes.io/projected/a39f3ad5-c0e4-46fa-ac08-967b79df17b2-kube-api-access-hlc96\") pod \"payload-processing-58b6c8fdc7-qzdmv\" (UID: \"a39f3ad5-c0e4-46fa-ac08-967b79df17b2\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-qzdmv" May 21 03:28:52.091776 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:52.091726 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-qzdmv" May 21 03:28:52.223458 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:52.223427 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-qzdmv"] May 21 03:28:52.224892 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:28:52.224866 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda39f3ad5_c0e4_46fa_ac08_967b79df17b2.slice/crio-e8bfec4f7825083edf47353dedb96680282cf4a9957434460e11884ca9ce033d WatchSource:0}: Error finding container e8bfec4f7825083edf47353dedb96680282cf4a9957434460e11884ca9ce033d: Status 404 returned error can't find the container with id e8bfec4f7825083edf47353dedb96680282cf4a9957434460e11884ca9ce033d May 21 03:28:52.274208 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:52.274162 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-qzdmv" event={"ID":"a39f3ad5-c0e4-46fa-ac08-967b79df17b2","Type":"ContainerStarted","Data":"e8bfec4f7825083edf47353dedb96680282cf4a9957434460e11884ca9ce033d"} May 21 03:28:52.275424 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:52.275338 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6b87f59566-9krh9" event={"ID":"d6a7018f-1636-48f6-924b-45ea7c890db0","Type":"ContainerStarted","Data":"112ad6fef4a886a76994043899f1c535566063f1f0fb9d79bae46b39302cdc39"} May 21 03:28:54.289395 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:54.289342 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6b87f59566-9krh9" event={"ID":"d6a7018f-1636-48f6-924b-45ea7c890db0","Type":"ContainerStarted","Data":"9b9c7b22e388ff227790119b1e185dd770de995bf22b6316d6b6b9e9dbc2af48"} May 21 03:28:54.289844 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:54.289408 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6b87f59566-9krh9" May 21 03:28:54.304726 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:54.304646 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-6b87f59566-9krh9" podStartSLOduration=1.536034931 podStartE2EDuration="3.304627075s" podCreationTimestamp="2026-05-21 03:28:51 +0000 UTC" firstStartedPulling="2026-05-21 03:28:51.89932536 +0000 UTC m=+556.265545730" lastFinishedPulling="2026-05-21 03:28:53.667917489 +0000 UTC m=+558.034137874" observedRunningTime="2026-05-21 03:28:54.304035268 +0000 UTC m=+558.670255682" watchObservedRunningTime="2026-05-21 03:28:54.304627075 +0000 UTC m=+558.670847469" May 21 03:28:56.298592 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:56.298552 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-qzdmv" event={"ID":"a39f3ad5-c0e4-46fa-ac08-967b79df17b2","Type":"ContainerStarted","Data":"02afe6e41411aff5e7c82ffebdea6b0e59cbdcdc246f15a30a66fd8ce93fc4f3"} May 21 03:28:56.299022 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:56.298650 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-qzdmv" May 21 03:28:56.315826 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:28:56.315774 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-qzdmv" podStartSLOduration=2.019567992 podStartE2EDuration="5.31576001s" podCreationTimestamp="2026-05-21 03:28:51 +0000 UTC" firstStartedPulling="2026-05-21 03:28:52.22685502 +0000 UTC m=+556.593075400" lastFinishedPulling="2026-05-21 03:28:55.523047043 +0000 UTC m=+559.889267418" observedRunningTime="2026-05-21 03:28:56.313684946 +0000 UTC m=+560.679905380" watchObservedRunningTime="2026-05-21 03:28:56.31576001 +0000 UTC m=+560.681980402" May 21 03:29:00.299973 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:29:00.299948 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6b87f59566-9krh9" May 21 03:29:07.305038 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:29:07.304999 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-qzdmv" May 21 03:30:36.907215 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:36.907178 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-647d6b57c6-znz7q"] May 21 03:30:36.910196 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:36.910177 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-647d6b57c6-znz7q" May 21 03:30:36.918344 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:36.918314 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-647d6b57c6-znz7q"] May 21 03:30:37.027988 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:37.027946 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2gsw\" (UniqueName: \"kubernetes.io/projected/58b8fc36-9908-4c7f-afc7-05eecef12009-kube-api-access-n2gsw\") pod \"authorino-647d6b57c6-znz7q\" (UID: \"58b8fc36-9908-4c7f-afc7-05eecef12009\") " pod="kuadrant-system/authorino-647d6b57c6-znz7q" May 21 03:30:37.027988 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:37.027984 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/58b8fc36-9908-4c7f-afc7-05eecef12009-tls-cert\") pod \"authorino-647d6b57c6-znz7q\" (UID: \"58b8fc36-9908-4c7f-afc7-05eecef12009\") " pod="kuadrant-system/authorino-647d6b57c6-znz7q" May 21 03:30:37.128502 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:37.128463 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2gsw\" (UniqueName: \"kubernetes.io/projected/58b8fc36-9908-4c7f-afc7-05eecef12009-kube-api-access-n2gsw\") pod \"authorino-647d6b57c6-znz7q\" (UID: \"58b8fc36-9908-4c7f-afc7-05eecef12009\") " pod="kuadrant-system/authorino-647d6b57c6-znz7q" May 21 03:30:37.128723 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:37.128520 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/58b8fc36-9908-4c7f-afc7-05eecef12009-tls-cert\") pod \"authorino-647d6b57c6-znz7q\" (UID: \"58b8fc36-9908-4c7f-afc7-05eecef12009\") " pod="kuadrant-system/authorino-647d6b57c6-znz7q" May 21 03:30:37.131594 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:37.131558 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/58b8fc36-9908-4c7f-afc7-05eecef12009-tls-cert\") pod \"authorino-647d6b57c6-znz7q\" (UID: \"58b8fc36-9908-4c7f-afc7-05eecef12009\") " pod="kuadrant-system/authorino-647d6b57c6-znz7q" May 21 03:30:37.137147 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:37.137103 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2gsw\" (UniqueName: \"kubernetes.io/projected/58b8fc36-9908-4c7f-afc7-05eecef12009-kube-api-access-n2gsw\") pod \"authorino-647d6b57c6-znz7q\" (UID: \"58b8fc36-9908-4c7f-afc7-05eecef12009\") " pod="kuadrant-system/authorino-647d6b57c6-znz7q" May 21 03:30:37.220765 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:37.220674 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-647d6b57c6-znz7q" May 21 03:30:37.359791 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:37.359762 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-647d6b57c6-znz7q"] May 21 03:30:37.361889 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:30:37.361856 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58b8fc36_9908_4c7f_afc7_05eecef12009.slice/crio-fe72c30275e864cc313b2e6da0d6ad3a706bd9ba78564b72a408ba8461091051 WatchSource:0}: Error finding container fe72c30275e864cc313b2e6da0d6ad3a706bd9ba78564b72a408ba8461091051: Status 404 returned error can't find the container with id fe72c30275e864cc313b2e6da0d6ad3a706bd9ba78564b72a408ba8461091051 May 21 03:30:37.363130 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:37.363110 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 03:30:37.695971 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:37.695931 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-647d6b57c6-znz7q" event={"ID":"58b8fc36-9908-4c7f-afc7-05eecef12009","Type":"ContainerStarted","Data":"fe72c30275e864cc313b2e6da0d6ad3a706bd9ba78564b72a408ba8461091051"} May 21 03:30:38.702285 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:38.702248 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-647d6b57c6-znz7q" event={"ID":"58b8fc36-9908-4c7f-afc7-05eecef12009","Type":"ContainerStarted","Data":"1cf65446414dbf19ed9088d1c3c318329124627e2ef85c675996c51f9052222f"} May 21 03:30:38.719581 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:38.719529 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-647d6b57c6-znz7q" podStartSLOduration=2.28788423 podStartE2EDuration="2.719510031s" podCreationTimestamp="2026-05-21 03:30:36 +0000 UTC" firstStartedPulling="2026-05-21 03:30:37.363225606 +0000 UTC m=+661.729445976" lastFinishedPulling="2026-05-21 03:30:37.794851392 +0000 UTC m=+662.161071777" observedRunningTime="2026-05-21 03:30:38.715913868 +0000 UTC m=+663.082134260" watchObservedRunningTime="2026-05-21 03:30:38.719510031 +0000 UTC m=+663.085730423" May 21 03:30:38.740154 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:38.740114 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69fdd45b69-l5bl8"] May 21 03:30:38.740420 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:38.740394 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-69fdd45b69-l5bl8" podUID="fb550ca8-caae-4119-8455-285640091ab4" containerName="authorino" containerID="cri-o://e9455b4d2422cd491d588996994156418e123efaf69aec40aae8bb4daf6fb361" gracePeriod=30 May 21 03:30:38.994488 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:38.994463 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69fdd45b69-l5bl8" May 21 03:30:39.149797 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:39.149765 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb550ca8-caae-4119-8455-285640091ab4-tls-cert\") pod \"fb550ca8-caae-4119-8455-285640091ab4\" (UID: \"fb550ca8-caae-4119-8455-285640091ab4\") " May 21 03:30:39.149981 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:39.149915 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wj896\" (UniqueName: \"kubernetes.io/projected/fb550ca8-caae-4119-8455-285640091ab4-kube-api-access-wj896\") pod \"fb550ca8-caae-4119-8455-285640091ab4\" (UID: \"fb550ca8-caae-4119-8455-285640091ab4\") " May 21 03:30:39.152244 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:39.152209 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb550ca8-caae-4119-8455-285640091ab4-kube-api-access-wj896" (OuterVolumeSpecName: "kube-api-access-wj896") pod "fb550ca8-caae-4119-8455-285640091ab4" (UID: "fb550ca8-caae-4119-8455-285640091ab4"). InnerVolumeSpecName "kube-api-access-wj896". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:30:39.159928 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:39.159897 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb550ca8-caae-4119-8455-285640091ab4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "fb550ca8-caae-4119-8455-285640091ab4" (UID: "fb550ca8-caae-4119-8455-285640091ab4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 03:30:39.250677 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:39.250587 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wj896\" (UniqueName: \"kubernetes.io/projected/fb550ca8-caae-4119-8455-285640091ab4-kube-api-access-wj896\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:30:39.250677 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:39.250621 2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb550ca8-caae-4119-8455-285640091ab4-tls-cert\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:30:39.707185 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:39.707145 2575 generic.go:358] "Generic (PLEG): container finished" podID="fb550ca8-caae-4119-8455-285640091ab4" containerID="e9455b4d2422cd491d588996994156418e123efaf69aec40aae8bb4daf6fb361" exitCode=0 May 21 03:30:39.707624 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:39.707199 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69fdd45b69-l5bl8" May 21 03:30:39.707624 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:39.707224 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69fdd45b69-l5bl8" event={"ID":"fb550ca8-caae-4119-8455-285640091ab4","Type":"ContainerDied","Data":"e9455b4d2422cd491d588996994156418e123efaf69aec40aae8bb4daf6fb361"} May 21 03:30:39.707624 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:39.707263 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69fdd45b69-l5bl8" event={"ID":"fb550ca8-caae-4119-8455-285640091ab4","Type":"ContainerDied","Data":"dbfa79bc3deb6595bade4fc83863ec95addc5c3d0adc1da961dc499c5f308f7b"} May 21 03:30:39.707624 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:39.707278 2575 scope.go:117] "RemoveContainer" containerID="e9455b4d2422cd491d588996994156418e123efaf69aec40aae8bb4daf6fb361" May 21 03:30:39.716304 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:39.716286 2575 scope.go:117] "RemoveContainer" containerID="e9455b4d2422cd491d588996994156418e123efaf69aec40aae8bb4daf6fb361" May 21 03:30:39.716607 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:30:39.716589 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9455b4d2422cd491d588996994156418e123efaf69aec40aae8bb4daf6fb361\": container with ID starting with e9455b4d2422cd491d588996994156418e123efaf69aec40aae8bb4daf6fb361 not found: ID does not exist" containerID="e9455b4d2422cd491d588996994156418e123efaf69aec40aae8bb4daf6fb361" May 21 03:30:39.716685 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:39.716623 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9455b4d2422cd491d588996994156418e123efaf69aec40aae8bb4daf6fb361"} err="failed to get container status \"e9455b4d2422cd491d588996994156418e123efaf69aec40aae8bb4daf6fb361\": rpc error: code = NotFound desc = could not find container \"e9455b4d2422cd491d588996994156418e123efaf69aec40aae8bb4daf6fb361\": container with ID starting with e9455b4d2422cd491d588996994156418e123efaf69aec40aae8bb4daf6fb361 not found: ID does not exist" May 21 03:30:39.729241 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:39.729208 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69fdd45b69-l5bl8"] May 21 03:30:39.732757 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:39.732728 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-69fdd45b69-l5bl8"] May 21 03:30:40.206085 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:30:40.206048 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb550ca8-caae-4119-8455-285640091ab4" path="/var/lib/kubelet/pods/fb550ca8-caae-4119-8455-285640091ab4/volumes" May 21 03:32:03.791686 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:32:03.791596 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54b789f958-5kfg7"] May 21 03:32:03.792158 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:32:03.791956 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb550ca8-caae-4119-8455-285640091ab4" containerName="authorino" May 21 03:32:03.792158 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:32:03.791968 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb550ca8-caae-4119-8455-285640091ab4" containerName="authorino" May 21 03:32:03.792158 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:32:03.792021 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb550ca8-caae-4119-8455-285640091ab4" containerName="authorino" May 21 03:32:03.794796 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:32:03.794779 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54b789f958-5kfg7" May 21 03:32:03.796905 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:32:03.796883 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-h48fc\"" May 21 03:32:03.801532 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:32:03.801505 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54b789f958-5kfg7"] May 21 03:32:03.882403 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:32:03.882324 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpncb\" (UniqueName: \"kubernetes.io/projected/b25bdc12-121d-4280-b924-f2d1aca1627c-kube-api-access-bpncb\") pod \"maas-controller-54b789f958-5kfg7\" (UID: \"b25bdc12-121d-4280-b924-f2d1aca1627c\") " pod="opendatahub/maas-controller-54b789f958-5kfg7" May 21 03:32:03.982943 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:32:03.982895 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bpncb\" (UniqueName: \"kubernetes.io/projected/b25bdc12-121d-4280-b924-f2d1aca1627c-kube-api-access-bpncb\") pod \"maas-controller-54b789f958-5kfg7\" (UID: \"b25bdc12-121d-4280-b924-f2d1aca1627c\") " pod="opendatahub/maas-controller-54b789f958-5kfg7" May 21 03:32:03.990483 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:32:03.990454 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpncb\" (UniqueName: \"kubernetes.io/projected/b25bdc12-121d-4280-b924-f2d1aca1627c-kube-api-access-bpncb\") pod \"maas-controller-54b789f958-5kfg7\" (UID: \"b25bdc12-121d-4280-b924-f2d1aca1627c\") " pod="opendatahub/maas-controller-54b789f958-5kfg7" May 21 03:32:04.105724 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:32:04.105622 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54b789f958-5kfg7" May 21 03:32:04.239755 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:32:04.239729 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54b789f958-5kfg7"] May 21 03:32:04.241656 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:32:04.241627 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb25bdc12_121d_4280_b924_f2d1aca1627c.slice/crio-445c7d2d86fb54726e306d668e7078eb49a892295aea446d7e1d14e1ccfd9a0e WatchSource:0}: Error finding container 445c7d2d86fb54726e306d668e7078eb49a892295aea446d7e1d14e1ccfd9a0e: Status 404 returned error can't find the container with id 445c7d2d86fb54726e306d668e7078eb49a892295aea446d7e1d14e1ccfd9a0e May 21 03:32:05.048772 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:32:05.048731 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54b789f958-5kfg7" event={"ID":"b25bdc12-121d-4280-b924-f2d1aca1627c","Type":"ContainerStarted","Data":"9eed532cd4bf008bf81f43102fb9f9d401f51b3a033c268e12c211d027037545"} May 21 03:32:05.048772 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:32:05.048772 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54b789f958-5kfg7" event={"ID":"b25bdc12-121d-4280-b924-f2d1aca1627c","Type":"ContainerStarted","Data":"445c7d2d86fb54726e306d668e7078eb49a892295aea446d7e1d14e1ccfd9a0e"} May 21 03:32:05.049291 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:32:05.048815 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54b789f958-5kfg7" May 21 03:32:05.064065 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:32:05.064015 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-54b789f958-5kfg7" podStartSLOduration=1.676845881 podStartE2EDuration="2.064001142s" podCreationTimestamp="2026-05-21 03:32:03 +0000 UTC" firstStartedPulling="2026-05-21 03:32:04.243294236 +0000 UTC m=+748.609514606" lastFinishedPulling="2026-05-21 03:32:04.630449497 +0000 UTC m=+748.996669867" observedRunningTime="2026-05-21 03:32:05.06369625 +0000 UTC m=+749.429916725" watchObservedRunningTime="2026-05-21 03:32:05.064001142 +0000 UTC m=+749.430221533" May 21 03:32:16.058307 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:32:16.058273 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54b789f958-5kfg7" May 21 03:42:24.198176 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:42:24.198137 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wdhf"] May 21 03:42:24.198639 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:42:24.198403 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wdhf" podUID="01385ffd-4c45-41a7-8dd9-be14d41afd72" containerName="manager" containerID="cri-o://113a3bb5ae97779adf21c27c64c455dbbdfff251cb4173cb8b1cb369ea382f43" gracePeriod=10 May 21 03:42:25.348243 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:42:25.348219 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wdhf" May 21 03:42:25.387612 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:42:25.387581 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01385ffd-4c45-41a7-8dd9-be14d41afd72-extensions-socket-volume\") pod \"01385ffd-4c45-41a7-8dd9-be14d41afd72\" (UID: \"01385ffd-4c45-41a7-8dd9-be14d41afd72\") " May 21 03:42:25.387810 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:42:25.387671 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77rrg\" (UniqueName: \"kubernetes.io/projected/01385ffd-4c45-41a7-8dd9-be14d41afd72-kube-api-access-77rrg\") pod \"01385ffd-4c45-41a7-8dd9-be14d41afd72\" (UID: \"01385ffd-4c45-41a7-8dd9-be14d41afd72\") " May 21 03:42:25.387954 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:42:25.387929 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01385ffd-4c45-41a7-8dd9-be14d41afd72-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "01385ffd-4c45-41a7-8dd9-be14d41afd72" (UID: "01385ffd-4c45-41a7-8dd9-be14d41afd72"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 03:42:25.389811 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:42:25.389780 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01385ffd-4c45-41a7-8dd9-be14d41afd72-kube-api-access-77rrg" (OuterVolumeSpecName: "kube-api-access-77rrg") pod "01385ffd-4c45-41a7-8dd9-be14d41afd72" (UID: "01385ffd-4c45-41a7-8dd9-be14d41afd72"). InnerVolumeSpecName "kube-api-access-77rrg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 03:42:25.440781 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:42:25.440747 2575 generic.go:358] "Generic (PLEG): container finished" podID="01385ffd-4c45-41a7-8dd9-be14d41afd72" containerID="113a3bb5ae97779adf21c27c64c455dbbdfff251cb4173cb8b1cb369ea382f43" exitCode=0 May 21 03:42:25.440974 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:42:25.440832 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wdhf" May 21 03:42:25.440974 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:42:25.440832 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wdhf" event={"ID":"01385ffd-4c45-41a7-8dd9-be14d41afd72","Type":"ContainerDied","Data":"113a3bb5ae97779adf21c27c64c455dbbdfff251cb4173cb8b1cb369ea382f43"} May 21 03:42:25.440974 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:42:25.440877 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wdhf" event={"ID":"01385ffd-4c45-41a7-8dd9-be14d41afd72","Type":"ContainerDied","Data":"c3402b215b21bcc7613c04e490930a3d75cad5c5543e92ebd0f2d71fe6ebbc46"} May 21 03:42:25.440974 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:42:25.440898 2575 scope.go:117] "RemoveContainer" containerID="113a3bb5ae97779adf21c27c64c455dbbdfff251cb4173cb8b1cb369ea382f43" May 21 03:42:25.450281 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:42:25.450266 2575 scope.go:117] "RemoveContainer" containerID="113a3bb5ae97779adf21c27c64c455dbbdfff251cb4173cb8b1cb369ea382f43" May 21 03:42:25.450553 ip-10-0-137-251 kubenswrapper[2575]: E0521 03:42:25.450533 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"113a3bb5ae97779adf21c27c64c455dbbdfff251cb4173cb8b1cb369ea382f43\": container with ID starting with 113a3bb5ae97779adf21c27c64c455dbbdfff251cb4173cb8b1cb369ea382f43 not found: ID does not exist" containerID="113a3bb5ae97779adf21c27c64c455dbbdfff251cb4173cb8b1cb369ea382f43" May 21 03:42:25.450620 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:42:25.450561 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"113a3bb5ae97779adf21c27c64c455dbbdfff251cb4173cb8b1cb369ea382f43"} err="failed to get container status \"113a3bb5ae97779adf21c27c64c455dbbdfff251cb4173cb8b1cb369ea382f43\": rpc error: code = NotFound desc = could not find container \"113a3bb5ae97779adf21c27c64c455dbbdfff251cb4173cb8b1cb369ea382f43\": container with ID starting with 113a3bb5ae97779adf21c27c64c455dbbdfff251cb4173cb8b1cb369ea382f43 not found: ID does not exist" May 21 03:42:25.464999 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:42:25.464938 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wdhf"] May 21 03:42:25.470370 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:42:25.470335 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wdhf"] May 21 03:42:25.488599 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:42:25.488572 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77rrg\" (UniqueName: \"kubernetes.io/projected/01385ffd-4c45-41a7-8dd9-be14d41afd72-kube-api-access-77rrg\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:42:25.488729 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:42:25.488602 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01385ffd-4c45-41a7-8dd9-be14d41afd72-extensions-socket-volume\") on node \"ip-10-0-137-251.ec2.internal\" DevicePath \"\"" May 21 03:42:26.205115 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:42:26.205073 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01385ffd-4c45-41a7-8dd9-be14d41afd72" path="/var/lib/kubelet/pods/01385ffd-4c45-41a7-8dd9-be14d41afd72/volumes" May 21 03:43:30.251382 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:43:30.251279 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9xznd"] May 21 03:43:30.251858 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:43:30.251632 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01385ffd-4c45-41a7-8dd9-be14d41afd72" containerName="manager" May 21 03:43:30.251858 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:43:30.251646 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="01385ffd-4c45-41a7-8dd9-be14d41afd72" containerName="manager" May 21 03:43:30.251858 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:43:30.251723 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="01385ffd-4c45-41a7-8dd9-be14d41afd72" containerName="manager" May 21 03:43:30.254538 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:43:30.254520 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9xznd" May 21 03:43:30.256858 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:43:30.256826 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hwxq5\"" May 21 03:43:30.269453 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:43:30.269412 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9xznd"] May 21 03:43:30.332658 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:43:30.332603 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdsjl\" (UniqueName: \"kubernetes.io/projected/ddaa97f3-78f3-452d-a227-af0c9dc408fa-kube-api-access-pdsjl\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9xznd\" (UID: \"ddaa97f3-78f3-452d-a227-af0c9dc408fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9xznd" May 21 03:43:30.332658 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:43:30.332659 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddaa97f3-78f3-452d-a227-af0c9dc408fa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9xznd\" (UID: \"ddaa97f3-78f3-452d-a227-af0c9dc408fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9xznd" May 21 03:43:30.433321 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:43:30.433275 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdsjl\" (UniqueName: \"kubernetes.io/projected/ddaa97f3-78f3-452d-a227-af0c9dc408fa-kube-api-access-pdsjl\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9xznd\" (UID: \"ddaa97f3-78f3-452d-a227-af0c9dc408fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9xznd" May 21 03:43:30.433321 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:43:30.433327 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddaa97f3-78f3-452d-a227-af0c9dc408fa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9xznd\" (UID: \"ddaa97f3-78f3-452d-a227-af0c9dc408fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9xznd" May 21 03:43:30.433729 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:43:30.433708 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddaa97f3-78f3-452d-a227-af0c9dc408fa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9xznd\" (UID: \"ddaa97f3-78f3-452d-a227-af0c9dc408fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9xznd" May 21 03:43:30.441881 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:43:30.441845 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdsjl\" (UniqueName: \"kubernetes.io/projected/ddaa97f3-78f3-452d-a227-af0c9dc408fa-kube-api-access-pdsjl\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9xznd\" (UID: \"ddaa97f3-78f3-452d-a227-af0c9dc408fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9xznd" May 21 03:43:30.565988 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:43:30.565953 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9xznd" May 21 03:43:30.703119 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:43:30.703084 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9xznd"] May 21 03:43:30.705272 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:43:30.705248 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddaa97f3_78f3_452d_a227_af0c9dc408fa.slice/crio-b9d78f59e5090c71fb0e8f7f2972da9fdd41dee883fc6e92d69611a9d5f1ab3a WatchSource:0}: Error finding container b9d78f59e5090c71fb0e8f7f2972da9fdd41dee883fc6e92d69611a9d5f1ab3a: Status 404 returned error can't find the container with id b9d78f59e5090c71fb0e8f7f2972da9fdd41dee883fc6e92d69611a9d5f1ab3a May 21 03:43:30.708222 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:43:30.708206 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 03:43:31.697315 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:43:31.697277 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9xznd" event={"ID":"ddaa97f3-78f3-452d-a227-af0c9dc408fa","Type":"ContainerStarted","Data":"66a6c933dc1a3b9f84ae0819ad2d3a75b7eaa97a4cfc653cfa04cc23c1f8c8fd"} May 21 03:43:31.697315 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:43:31.697316 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9xznd" event={"ID":"ddaa97f3-78f3-452d-a227-af0c9dc408fa","Type":"ContainerStarted","Data":"b9d78f59e5090c71fb0e8f7f2972da9fdd41dee883fc6e92d69611a9d5f1ab3a"} May 21 03:43:31.697788 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:43:31.697339 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9xznd" May 21 03:43:31.717925 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:43:31.717872 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9xznd" podStartSLOduration=1.717856971 podStartE2EDuration="1.717856971s" podCreationTimestamp="2026-05-21 03:43:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:43:31.714065492 +0000 UTC m=+1436.080285884" watchObservedRunningTime="2026-05-21 03:43:31.717856971 +0000 UTC m=+1436.084077363" May 21 03:43:42.704216 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:43:42.704185 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9xznd" May 21 03:53:11.301654 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:11.301618 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-647d6b57c6-znz7q_58b8fc36-9908-4c7f-afc7-05eecef12009/authorino/0.log" May 21 03:53:15.685739 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:15.685701 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6b87f59566-9krh9_d6a7018f-1636-48f6-924b-45ea7c890db0/maas-api/0.log" May 21 03:53:16.013483 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:16.013398 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54b789f958-5kfg7_b25bdc12-121d-4280-b924-f2d1aca1627c/manager/0.log" May 21 03:53:16.475701 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:16.475665 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fcf489fb9-xrmps_f1f242c0-4c42-447a-9092-955adf578651/manager/0.log" May 21 03:53:17.314655 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:17.314625 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24_e98ac779-339f-4be7-9e16-71018f21d7e4/util/0.log" May 21 03:53:17.320044 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:17.320020 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24_e98ac779-339f-4be7-9e16-71018f21d7e4/pull/0.log" May 21 03:53:17.325056 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:17.325036 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24_e98ac779-339f-4be7-9e16-71018f21d7e4/extract/0.log" May 21 03:53:17.433402 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:17.433375 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd_514003f1-3abe-42fc-9367-7ff3a74b0d7b/util/0.log" May 21 03:53:17.438952 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:17.438923 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd_514003f1-3abe-42fc-9367-7ff3a74b0d7b/pull/0.log" May 21 03:53:17.443860 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:17.443840 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd_514003f1-3abe-42fc-9367-7ff3a74b0d7b/extract/0.log" May 21 03:53:17.548013 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:17.547982 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6_270b1265-4a50-4d19-9c0a-fb334622b2e8/extract/0.log" May 21 03:53:17.553147 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:17.553127 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6_270b1265-4a50-4d19-9c0a-fb334622b2e8/util/0.log" May 21 03:53:17.558481 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:17.558460 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6_270b1265-4a50-4d19-9c0a-fb334622b2e8/pull/0.log" May 21 03:53:17.664703 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:17.664614 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk_a57742d5-c427-4885-93b1-a933a4938c61/util/0.log" May 21 03:53:17.670989 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:17.670959 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk_a57742d5-c427-4885-93b1-a933a4938c61/pull/0.log" May 21 03:53:17.676973 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:17.676933 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk_a57742d5-c427-4885-93b1-a933a4938c61/extract/0.log" May 21 03:53:17.795459 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:17.795426 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-647d6b57c6-znz7q_58b8fc36-9908-4c7f-afc7-05eecef12009/authorino/0.log" May 21 03:53:18.121039 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:18.121005 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-vsnxq_6dfba232-1fd9-4775-8e72-6a3e33d8047c/kuadrant-console-plugin/0.log" May 21 03:53:18.234248 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:18.234200 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-g7vp6_03e0ec74-368e-45e5-8c04-b98fb2def8bf/registry-server/0.log" May 21 03:53:18.365888 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:18.365859 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-9xznd_ddaa97f3-78f3-452d-a227-af0c9dc408fa/manager/0.log" May 21 03:53:18.945559 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:18.945526 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bgctzq_8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4/istio-proxy/0.log" May 21 03:53:19.415797 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:19.415764 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-nmsln_12134405-014b-447a-a952-76681ca3850c/istio-proxy/0.log" May 21 03:53:19.536703 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:19.536670 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-qzdmv_a39f3ad5-c0e4-46fa-ac08-967b79df17b2/payload-processing/0.log" May 21 03:53:24.813392 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:24.813333 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p57vb/must-gather-5jm2c"] May 21 03:53:24.816925 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:24.816895 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p57vb/must-gather-5jm2c" May 21 03:53:24.819297 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:24.819275 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p57vb\"/\"kube-root-ca.crt\"" May 21 03:53:24.819455 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:24.819324 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p57vb\"/\"openshift-service-ca.crt\"" May 21 03:53:24.820331 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:24.820307 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p57vb\"/\"default-dockercfg-zvfx6\"" May 21 03:53:24.832953 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:24.832925 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p57vb/must-gather-5jm2c"] May 21 03:53:24.903623 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:24.903581 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxtmf\" (UniqueName: \"kubernetes.io/projected/7a4a2384-04a5-4996-83bf-a877faf98132-kube-api-access-pxtmf\") pod \"must-gather-5jm2c\" (UID: \"7a4a2384-04a5-4996-83bf-a877faf98132\") " pod="openshift-must-gather-p57vb/must-gather-5jm2c" May 21 03:53:24.903812 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:24.903641 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7a4a2384-04a5-4996-83bf-a877faf98132-must-gather-output\") pod \"must-gather-5jm2c\" (UID: \"7a4a2384-04a5-4996-83bf-a877faf98132\") " pod="openshift-must-gather-p57vb/must-gather-5jm2c" May 21 03:53:25.004219 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:25.004181 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pxtmf\" (UniqueName: \"kubernetes.io/projected/7a4a2384-04a5-4996-83bf-a877faf98132-kube-api-access-pxtmf\") pod \"must-gather-5jm2c\" (UID: \"7a4a2384-04a5-4996-83bf-a877faf98132\") " pod="openshift-must-gather-p57vb/must-gather-5jm2c" May 21 03:53:25.004457 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:25.004242 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7a4a2384-04a5-4996-83bf-a877faf98132-must-gather-output\") pod \"must-gather-5jm2c\" (UID: \"7a4a2384-04a5-4996-83bf-a877faf98132\") " pod="openshift-must-gather-p57vb/must-gather-5jm2c" May 21 03:53:25.004636 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:25.004614 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7a4a2384-04a5-4996-83bf-a877faf98132-must-gather-output\") pod \"must-gather-5jm2c\" (UID: \"7a4a2384-04a5-4996-83bf-a877faf98132\") " pod="openshift-must-gather-p57vb/must-gather-5jm2c" May 21 03:53:25.011557 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:25.011535 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxtmf\" (UniqueName: \"kubernetes.io/projected/7a4a2384-04a5-4996-83bf-a877faf98132-kube-api-access-pxtmf\") pod \"must-gather-5jm2c\" (UID: \"7a4a2384-04a5-4996-83bf-a877faf98132\") " pod="openshift-must-gather-p57vb/must-gather-5jm2c" May 21 03:53:25.125975 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:25.125884 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p57vb/must-gather-5jm2c" May 21 03:53:25.256912 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:25.256884 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p57vb/must-gather-5jm2c"] May 21 03:53:25.258820 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:53:25.258794 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a4a2384_04a5_4996_83bf_a877faf98132.slice/crio-1cdc279d97cc5eca9f684dfcbe0565cc4c5ab834dca38cf49e69de649a43a132 WatchSource:0}: Error finding container 1cdc279d97cc5eca9f684dfcbe0565cc4c5ab834dca38cf49e69de649a43a132: Status 404 returned error can't find the container with id 1cdc279d97cc5eca9f684dfcbe0565cc4c5ab834dca38cf49e69de649a43a132 May 21 03:53:25.260514 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:25.260490 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 03:53:26.004551 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:26.004523 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p57vb/must-gather-5jm2c" event={"ID":"7a4a2384-04a5-4996-83bf-a877faf98132","Type":"ContainerStarted","Data":"1cdc279d97cc5eca9f684dfcbe0565cc4c5ab834dca38cf49e69de649a43a132"} May 21 03:53:27.012064 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:27.012020 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p57vb/must-gather-5jm2c" event={"ID":"7a4a2384-04a5-4996-83bf-a877faf98132","Type":"ContainerStarted","Data":"17bc2f975556c8e9bd511a9e20a65172bb8d0b6942ba08a2b7e78eb3385042b7"} May 21 03:53:27.012655 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:27.012629 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p57vb/must-gather-5jm2c" event={"ID":"7a4a2384-04a5-4996-83bf-a877faf98132","Type":"ContainerStarted","Data":"5281184218a2e267cabc4ffeef478568545447ca328d70f05d83e24cfbfd9322"} May 21 03:53:27.029587 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:27.029522 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-p57vb/must-gather-5jm2c" podStartSLOduration=2.380056881 podStartE2EDuration="3.02950295s" podCreationTimestamp="2026-05-21 03:53:24 +0000 UTC" firstStartedPulling="2026-05-21 03:53:25.260617249 +0000 UTC m=+2029.626837620" lastFinishedPulling="2026-05-21 03:53:25.910063317 +0000 UTC m=+2030.276283689" observedRunningTime="2026-05-21 03:53:27.026947255 +0000 UTC m=+2031.393167647" watchObservedRunningTime="2026-05-21 03:53:27.02950295 +0000 UTC m=+2031.395723342" May 21 03:53:27.582258 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:27.582220 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kszz4_1b21c5a4-9321-44f7-b455-ffadcfea53bc/global-pull-secret-syncer/0.log" May 21 03:53:27.665069 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:27.665028 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7wn9q_5c127909-772f-4e17-8b3f-f221290a6efb/konnectivity-agent/0.log" May 21 03:53:27.802616 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:27.802578 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-251.ec2.internal_d2d7b9af40cbe531b6adc203c8d4859b/haproxy/0.log" May 21 03:53:31.856340 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:31.856311 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24_e98ac779-339f-4be7-9e16-71018f21d7e4/extract/0.log" May 21 03:53:31.880939 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:31.880910 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24_e98ac779-339f-4be7-9e16-71018f21d7e4/util/0.log" May 21 03:53:31.904560 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:31.904398 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dpq24_e98ac779-339f-4be7-9e16-71018f21d7e4/pull/0.log" May 21 03:53:31.930189 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:31.930150 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd_514003f1-3abe-42fc-9367-7ff3a74b0d7b/extract/0.log" May 21 03:53:31.957124 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:31.957089 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd_514003f1-3abe-42fc-9367-7ff3a74b0d7b/util/0.log" May 21 03:53:31.989131 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:31.989099 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xwnmd_514003f1-3abe-42fc-9367-7ff3a74b0d7b/pull/0.log" May 21 03:53:32.022867 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:32.022832 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6_270b1265-4a50-4d19-9c0a-fb334622b2e8/extract/0.log" May 21 03:53:32.049742 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:32.049708 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6_270b1265-4a50-4d19-9c0a-fb334622b2e8/util/0.log" May 21 03:53:32.072730 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:32.072692 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qmpb6_270b1265-4a50-4d19-9c0a-fb334622b2e8/pull/0.log" May 21 03:53:32.099331 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:32.099290 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk_a57742d5-c427-4885-93b1-a933a4938c61/extract/0.log" May 21 03:53:32.120605 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:32.120513 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk_a57742d5-c427-4885-93b1-a933a4938c61/util/0.log" May 21 03:53:32.146600 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:32.146572 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18xbnk_a57742d5-c427-4885-93b1-a933a4938c61/pull/0.log" May 21 03:53:32.477857 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:32.475148 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-647d6b57c6-znz7q_58b8fc36-9908-4c7f-afc7-05eecef12009/authorino/0.log" May 21 03:53:32.564868 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:32.564836 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-vsnxq_6dfba232-1fd9-4775-8e72-6a3e33d8047c/kuadrant-console-plugin/0.log" May 21 03:53:32.607940 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:32.607901 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-g7vp6_03e0ec74-368e-45e5-8c04-b98fb2def8bf/registry-server/0.log" May 21 03:53:32.692037 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:32.692000 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-9xznd_ddaa97f3-78f3-452d-a227-af0c9dc408fa/manager/0.log" May 21 03:53:34.551229 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:34.551198 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6dc697b889-pvnqw_381d1c4a-a099-44e1-95a4-b8a984f53cef/metrics-server/0.log" May 21 03:53:34.579583 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:34.579545 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-kkg5w_2eb98867-cbfc-4f5a-8bdd-5e0e54b89441/monitoring-plugin/0.log" May 21 03:53:34.608736 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:34.608705 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-krjvk_de94910b-8774-4863-a570-d77fbaec7663/node-exporter/0.log" May 21 03:53:34.630423 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:34.630386 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-krjvk_de94910b-8774-4863-a570-d77fbaec7663/kube-rbac-proxy/0.log" May 21 03:53:34.649469 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:34.649432 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-krjvk_de94910b-8774-4863-a570-d77fbaec7663/init-textfile/0.log" May 21 03:53:34.814104 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:34.814018 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-x46t7_0895b22b-98f7-4ff6-9959-3d798c15c051/kube-rbac-proxy-main/0.log" May 21 03:53:34.834290 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:34.834259 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-x46t7_0895b22b-98f7-4ff6-9959-3d798c15c051/kube-rbac-proxy-self/0.log" May 21 03:53:34.854699 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:34.854667 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-x46t7_0895b22b-98f7-4ff6-9959-3d798c15c051/openshift-state-metrics/0.log" May 21 03:53:36.038747 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:36.038695 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g"] May 21 03:53:36.043827 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:36.043801 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g" May 21 03:53:36.053526 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:36.053473 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g"] May 21 03:53:36.118407 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:36.118370 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/070c239d-b9fc-4235-b3e6-a74e27fa46ee-proc\") pod \"perf-node-gather-daemonset-xdw2g\" (UID: \"070c239d-b9fc-4235-b3e6-a74e27fa46ee\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g" May 21 03:53:36.118597 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:36.118448 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppw5r\" (UniqueName: \"kubernetes.io/projected/070c239d-b9fc-4235-b3e6-a74e27fa46ee-kube-api-access-ppw5r\") pod \"perf-node-gather-daemonset-xdw2g\" (UID: \"070c239d-b9fc-4235-b3e6-a74e27fa46ee\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g" May 21 03:53:36.118597 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:36.118477 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/070c239d-b9fc-4235-b3e6-a74e27fa46ee-lib-modules\") pod \"perf-node-gather-daemonset-xdw2g\" (UID: \"070c239d-b9fc-4235-b3e6-a74e27fa46ee\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g" May 21 03:53:36.118597 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:36.118529 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/070c239d-b9fc-4235-b3e6-a74e27fa46ee-sys\") pod \"perf-node-gather-daemonset-xdw2g\" (UID: \"070c239d-b9fc-4235-b3e6-a74e27fa46ee\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g" May 21 03:53:36.118597 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:36.118557 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/070c239d-b9fc-4235-b3e6-a74e27fa46ee-podres\") pod \"perf-node-gather-daemonset-xdw2g\" (UID: \"070c239d-b9fc-4235-b3e6-a74e27fa46ee\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g" May 21 03:53:36.219845 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:36.219800 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/070c239d-b9fc-4235-b3e6-a74e27fa46ee-sys\") pod \"perf-node-gather-daemonset-xdw2g\" (UID: \"070c239d-b9fc-4235-b3e6-a74e27fa46ee\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g" May 21 03:53:36.220044 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:36.219845 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/070c239d-b9fc-4235-b3e6-a74e27fa46ee-podres\") pod \"perf-node-gather-daemonset-xdw2g\" (UID: \"070c239d-b9fc-4235-b3e6-a74e27fa46ee\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g" May 21 03:53:36.220044 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:36.219904 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/070c239d-b9fc-4235-b3e6-a74e27fa46ee-proc\") pod \"perf-node-gather-daemonset-xdw2g\" (UID: \"070c239d-b9fc-4235-b3e6-a74e27fa46ee\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g" May 21 03:53:36.220044 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:36.219922 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/070c239d-b9fc-4235-b3e6-a74e27fa46ee-sys\") pod \"perf-node-gather-daemonset-xdw2g\" (UID: \"070c239d-b9fc-4235-b3e6-a74e27fa46ee\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g" May 21 03:53:36.220044 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:36.219995 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ppw5r\" (UniqueName: \"kubernetes.io/projected/070c239d-b9fc-4235-b3e6-a74e27fa46ee-kube-api-access-ppw5r\") pod \"perf-node-gather-daemonset-xdw2g\" (UID: \"070c239d-b9fc-4235-b3e6-a74e27fa46ee\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g" May 21 03:53:36.220044 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:36.220016 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/070c239d-b9fc-4235-b3e6-a74e27fa46ee-proc\") pod \"perf-node-gather-daemonset-xdw2g\" (UID: \"070c239d-b9fc-4235-b3e6-a74e27fa46ee\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g" May 21 03:53:36.220044 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:36.220026 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/070c239d-b9fc-4235-b3e6-a74e27fa46ee-lib-modules\") pod \"perf-node-gather-daemonset-xdw2g\" (UID: \"070c239d-b9fc-4235-b3e6-a74e27fa46ee\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g" May 21 03:53:36.220044 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:36.220034 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/070c239d-b9fc-4235-b3e6-a74e27fa46ee-podres\") pod \"perf-node-gather-daemonset-xdw2g\" (UID: \"070c239d-b9fc-4235-b3e6-a74e27fa46ee\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g" May 21 03:53:36.220467 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:36.220131 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/070c239d-b9fc-4235-b3e6-a74e27fa46ee-lib-modules\") pod \"perf-node-gather-daemonset-xdw2g\" (UID: \"070c239d-b9fc-4235-b3e6-a74e27fa46ee\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g" May 21 03:53:36.227297 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:36.227271 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppw5r\" (UniqueName: \"kubernetes.io/projected/070c239d-b9fc-4235-b3e6-a74e27fa46ee-kube-api-access-ppw5r\") pod \"perf-node-gather-daemonset-xdw2g\" (UID: \"070c239d-b9fc-4235-b3e6-a74e27fa46ee\") " pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g" May 21 03:53:36.358045 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:36.357950 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g" May 21 03:53:36.537991 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:36.537964 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g"] May 21 03:53:36.540001 ip-10-0-137-251 kubenswrapper[2575]: W0521 03:53:36.539965 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod070c239d_b9fc_4235_b3e6_a74e27fa46ee.slice/crio-c54e675d04b431a7c368d9b2d5e19ec3d9ad25caa44ab75e6d8b767887ea6435 WatchSource:0}: Error finding container c54e675d04b431a7c368d9b2d5e19ec3d9ad25caa44ab75e6d8b767887ea6435: Status 404 returned error can't find the container with id c54e675d04b431a7c368d9b2d5e19ec3d9ad25caa44ab75e6d8b767887ea6435 May 21 03:53:37.073541 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:37.073497 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g" event={"ID":"070c239d-b9fc-4235-b3e6-a74e27fa46ee","Type":"ContainerStarted","Data":"2721d9cff4690b4791e5a4fd4282399f517251cecc51629ebb820c9decf8f67f"} May 21 03:53:37.073541 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:37.073547 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g" event={"ID":"070c239d-b9fc-4235-b3e6-a74e27fa46ee","Type":"ContainerStarted","Data":"c54e675d04b431a7c368d9b2d5e19ec3d9ad25caa44ab75e6d8b767887ea6435"} May 21 03:53:37.074417 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:37.074390 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g" May 21 03:53:37.090048 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:37.090000 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g" podStartSLOduration=1.089983468 podStartE2EDuration="1.089983468s" podCreationTimestamp="2026-05-21 03:53:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 03:53:37.088078142 +0000 UTC m=+2041.454298535" watchObservedRunningTime="2026-05-21 03:53:37.089983468 +0000 UTC m=+2041.456203860" May 21 03:53:38.673886 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:38.673855 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s77fp_9fa912a9-75a7-4abb-9e27-33cb4f27918d/dns/0.log" May 21 03:53:38.691845 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:38.691817 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s77fp_9fa912a9-75a7-4abb-9e27-33cb4f27918d/kube-rbac-proxy/0.log" May 21 03:53:38.732105 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:38.732077 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nm86d_48fa57f3-8bf4-4643-8fda-195ac1776d3c/dns-node-resolver/0.log" May 21 03:53:39.221273 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:39.221232 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4jxvp_cb7a5cdb-9dde-424b-ac12-d08fbe5e86b6/node-ca/0.log" May 21 03:53:40.060063 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:40.060032 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bgctzq_8879e460-8d8e-4c5f-8761-3ed4b1e4d3f4/istio-proxy/0.log" May 21 03:53:40.341795 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:40.341713 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-nmsln_12134405-014b-447a-a952-76681ca3850c/istio-proxy/0.log" May 21 03:53:40.439612 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:40.439575 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-qzdmv_a39f3ad5-c0e4-46fa-ac08-967b79df17b2/payload-processing/0.log" May 21 03:53:41.026201 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:41.026173 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zgc2v_7104e42b-14d4-4928-aba1-83a0361e7a5d/serve-healthcheck-canary/0.log" May 21 03:53:41.477166 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:41.477134 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l92vd_4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e/kube-rbac-proxy/0.log" May 21 03:53:41.496040 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:41.496004 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l92vd_4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e/exporter/0.log" May 21 03:53:41.516509 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:41.516478 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l92vd_4aa1617e-7d0b-4603-a0c1-9f96bbd3bd2e/extractor/0.log" May 21 03:53:43.700282 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:43.700250 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6b87f59566-9krh9_d6a7018f-1636-48f6-924b-45ea7c890db0/maas-api/0.log" May 21 03:53:43.860944 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:43.860908 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54b789f958-5kfg7_b25bdc12-121d-4280-b924-f2d1aca1627c/manager/0.log" May 21 03:53:44.007597 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:44.007508 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fcf489fb9-xrmps_f1f242c0-4c42-447a-9092-955adf578651/manager/0.log" May 21 03:53:44.097234 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:44.097202 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p57vb/perf-node-gather-daemonset-xdw2g" May 21 03:53:45.178014 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:45.177985 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-79478bfc9c-bjvjk_b3fa544c-91c1-4f17-9b65-31230cb12b26/manager/0.log" May 21 03:53:45.200675 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:45.200642 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-lccwd_a61d4912-daec-41b3-8b8d-480fe152f096/openshift-lws-operator/0.log" May 21 03:53:51.402765 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:51.402736 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-svx44_dc4295eb-090f-4bcb-9429-fb127fd63fa8/kube-multus-additional-cni-plugins/0.log" May 21 03:53:51.422325 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:51.422291 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-svx44_dc4295eb-090f-4bcb-9429-fb127fd63fa8/egress-router-binary-copy/0.log" May 21 03:53:51.441797 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:51.441761 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-svx44_dc4295eb-090f-4bcb-9429-fb127fd63fa8/cni-plugins/0.log" May 21 03:53:51.460839 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:51.460810 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-svx44_dc4295eb-090f-4bcb-9429-fb127fd63fa8/bond-cni-plugin/0.log" May 21 03:53:51.480899 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:51.480874 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-svx44_dc4295eb-090f-4bcb-9429-fb127fd63fa8/routeoverride-cni/0.log" May 21 03:53:51.500268 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:51.500241 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-svx44_dc4295eb-090f-4bcb-9429-fb127fd63fa8/whereabouts-cni-bincopy/0.log" May 21 03:53:51.519016 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:51.518992 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-svx44_dc4295eb-090f-4bcb-9429-fb127fd63fa8/whereabouts-cni/0.log" May 21 03:53:51.558284 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:51.558237 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ds6kj_21b85f67-5cbb-4544-b7c9-6bfe4a28b54e/kube-multus/0.log" May 21 03:53:51.604990 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:51.604961 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6qc5c_ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad/network-metrics-daemon/0.log" May 21 03:53:51.620455 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:51.620424 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6qc5c_ee4cf14f-1a8d-4e34-9530-8d8e5654f0ad/kube-rbac-proxy/0.log" May 21 03:53:52.749362 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:52.749319 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hkgwf_3b16d171-5803-4a52-8faa-b6290af8b5dc/ovn-controller/0.log" May 21 03:53:52.785966 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:52.785924 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hkgwf_3b16d171-5803-4a52-8faa-b6290af8b5dc/ovn-acl-logging/0.log" May 21 03:53:52.805994 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:52.805963 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hkgwf_3b16d171-5803-4a52-8faa-b6290af8b5dc/kube-rbac-proxy-node/0.log" May 21 03:53:52.827749 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:52.827717 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hkgwf_3b16d171-5803-4a52-8faa-b6290af8b5dc/kube-rbac-proxy-ovn-metrics/0.log" May 21 03:53:52.863403 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:52.863374 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hkgwf_3b16d171-5803-4a52-8faa-b6290af8b5dc/northd/0.log" May 21 03:53:52.881439 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:52.881411 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hkgwf_3b16d171-5803-4a52-8faa-b6290af8b5dc/nbdb/0.log" May 21 03:53:52.900062 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:52.900029 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hkgwf_3b16d171-5803-4a52-8faa-b6290af8b5dc/sbdb/0.log" May 21 03:53:53.079552 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:53.079518 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hkgwf_3b16d171-5803-4a52-8faa-b6290af8b5dc/ovnkube-controller/0.log" May 21 03:53:54.478487 ip-10-0-137-251 kubenswrapper[2575]: I0521 03:53:54.478449 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-fqzfs_6b69a092-73c1-4098-b3af-3d38cce0cdb5/network-check-target-container/0.log"