May 21 20:20:53.881370 ip-10-0-134-40 systemd[1]: Starting Kubernetes Kubelet... May 21 20:20:54.332022 ip-10-0-134-40 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 20:20:54.332022 ip-10-0-134-40 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 20:20:54.332022 ip-10-0-134-40 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 20:20:54.332022 ip-10-0-134-40 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 20:20:54.332022 ip-10-0-134-40 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 20:20:54.333840 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.333686 2559 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 20:20:54.337504 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337487 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:20:54.337504 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337503 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:20:54.337569 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337509 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:20:54.337569 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337514 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:20:54.337569 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337517 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:20:54.337569 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337520 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:20:54.337569 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337523 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:20:54.337569 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337526 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:20:54.337569 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337529 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:20:54.337569 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337532 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:20:54.337569 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337535 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:20:54.337569 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337538 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:20:54.337569 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337542 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:20:54.337569 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337545 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:20:54.337569 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337547 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:20:54.337569 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337550 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:20:54.337569 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337552 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:20:54.337569 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337555 2559 feature_gate.go:328] unrecognized feature gate: Example May 21 20:20:54.337569 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337557 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:20:54.337569 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337560 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:20:54.337569 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337563 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:20:54.337569 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337565 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:20:54.338071 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337568 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:20:54.338071 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337571 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:20:54.338071 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337573 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:20:54.338071 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337576 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:20:54.338071 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337579 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:20:54.338071 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337581 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:20:54.338071 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337584 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:20:54.338071 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337586 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:20:54.338071 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337590 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:20:54.338071 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337592 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:20:54.338071 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337595 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:20:54.338071 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337597 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:20:54.338071 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337600 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:20:54.338071 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337603 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:20:54.338071 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337605 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:20:54.338071 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337608 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:20:54.338071 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337610 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:20:54.338071 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337612 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:20:54.338071 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337615 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:20:54.338555 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337617 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:20:54.338555 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337620 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:20:54.338555 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337622 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:20:54.338555 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337624 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:20:54.338555 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337627 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:20:54.338555 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337629 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:20:54.338555 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337632 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:20:54.338555 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337634 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:20:54.338555 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337637 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:20:54.338555 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337639 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:20:54.338555 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337641 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:20:54.338555 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337644 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:20:54.338555 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337646 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:20:54.338555 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337649 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:20:54.338555 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337652 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:20:54.338555 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337655 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:20:54.338555 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337658 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:20:54.338555 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337660 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:20:54.338555 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337663 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:20:54.338555 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337665 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:20:54.339044 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337668 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:20:54.339044 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337670 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:20:54.339044 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337673 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:20:54.339044 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337676 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:20:54.339044 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337679 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:20:54.339044 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337682 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:20:54.339044 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337685 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:20:54.339044 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337687 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:20:54.339044 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337691 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:20:54.339044 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337695 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:20:54.339044 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337698 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:20:54.339044 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337701 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:20:54.339044 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337704 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:20:54.339044 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337706 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:20:54.339044 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337709 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:20:54.339044 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337711 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:20:54.339044 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337713 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:20:54.339044 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337716 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:20:54.339044 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337719 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:20:54.339532 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337721 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:20:54.339532 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337723 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:20:54.339532 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337726 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:20:54.339532 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337729 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:20:54.339532 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337731 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:20:54.339532 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.337734 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:20:54.339532 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338129 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:20:54.339532 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338136 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:20:54.339532 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338139 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:20:54.339532 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338142 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:20:54.339532 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338145 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:20:54.339532 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338147 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:20:54.339532 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338150 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:20:54.339532 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338152 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:20:54.339532 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338155 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:20:54.339532 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338158 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:20:54.339532 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338161 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:20:54.339532 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338163 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:20:54.339532 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338167 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:20:54.340000 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338170 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:20:54.340000 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338172 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:20:54.340000 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338175 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:20:54.340000 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338177 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:20:54.340000 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338180 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:20:54.340000 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338182 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:20:54.340000 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338185 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:20:54.340000 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338188 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:20:54.340000 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338190 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:20:54.340000 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338192 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:20:54.340000 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338195 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:20:54.340000 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338198 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:20:54.340000 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338201 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:20:54.340000 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338204 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:20:54.340000 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338206 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:20:54.340000 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338209 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:20:54.340000 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338211 2559 feature_gate.go:328] unrecognized feature gate: Example May 21 20:20:54.340000 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338214 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:20:54.340000 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338216 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:20:54.340000 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338219 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:20:54.340642 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338221 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:20:54.340642 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338223 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:20:54.340642 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338226 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:20:54.340642 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338228 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:20:54.340642 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338230 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:20:54.340642 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338233 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:20:54.340642 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338235 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:20:54.340642 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338238 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:20:54.340642 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338241 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:20:54.340642 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338243 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:20:54.340642 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338245 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:20:54.340642 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338248 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:20:54.340642 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338251 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:20:54.340642 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338253 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:20:54.340642 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338255 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:20:54.340642 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338258 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:20:54.340642 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338261 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:20:54.340642 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338264 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:20:54.340642 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338267 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:20:54.340642 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338269 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:20:54.341164 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338272 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:20:54.341164 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338274 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:20:54.341164 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338277 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:20:54.341164 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338280 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:20:54.341164 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338284 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:20:54.341164 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338286 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:20:54.341164 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338289 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:20:54.341164 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338291 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:20:54.341164 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338293 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:20:54.341164 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338297 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:20:54.341164 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338301 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:20:54.341164 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338304 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:20:54.341164 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338306 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:20:54.341164 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338309 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:20:54.341164 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338312 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:20:54.341164 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338314 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:20:54.341164 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338317 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:20:54.341164 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338319 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:20:54.341164 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338322 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:20:54.341164 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338325 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:20:54.341657 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338327 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:20:54.341657 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338329 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:20:54.341657 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338332 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:20:54.341657 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338335 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:20:54.341657 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338338 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:20:54.341657 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338340 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:20:54.341657 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338343 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:20:54.341657 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338346 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:20:54.341657 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338350 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:20:54.341657 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338353 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:20:54.341657 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338355 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:20:54.341657 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338358 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:20:54.341657 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.338360 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:20:54.341657 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339124 2559 flags.go:64] FLAG: --address="0.0.0.0" May 21 20:20:54.341657 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339134 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 20:20:54.341657 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339141 2559 flags.go:64] FLAG: --anonymous-auth="true" May 21 20:20:54.341657 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339146 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 20:20:54.341657 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339150 2559 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 20:20:54.341657 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339153 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 20:20:54.341657 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339157 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 20:20:54.341657 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339161 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339165 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339168 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339171 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339175 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339178 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339180 2559 flags.go:64] FLAG: --cgroup-root="" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339183 2559 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339186 2559 flags.go:64] FLAG: --client-ca-file="" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339189 2559 flags.go:64] FLAG: --cloud-config="" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339192 2559 flags.go:64] FLAG: --cloud-provider="external" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339195 2559 flags.go:64] FLAG: --cluster-dns="[]" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339198 2559 flags.go:64] FLAG: --cluster-domain="" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339201 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339204 2559 flags.go:64] FLAG: --config-dir="" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339207 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339210 2559 flags.go:64] FLAG: --container-log-max-files="5" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339214 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339217 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339221 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339225 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339228 2559 flags.go:64] FLAG: --contention-profiling="false" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339231 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339233 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339236 2559 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 20:20:54.342201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339239 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339243 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339247 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339250 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339252 2559 flags.go:64] FLAG: --enable-load-reader="false" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339255 2559 flags.go:64] FLAG: --enable-server="true" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339258 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339263 2559 flags.go:64] FLAG: --event-burst="100" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339266 2559 flags.go:64] FLAG: --event-qps="50" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339283 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339287 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339290 2559 flags.go:64] FLAG: --eviction-hard="" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339294 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339297 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339300 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339304 2559 flags.go:64] FLAG: --eviction-soft="" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339307 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339309 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339312 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339315 2559 flags.go:64] FLAG: --experimental-mounter-path="" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339318 2559 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339321 2559 flags.go:64] FLAG: --fail-swap-on="true" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339324 2559 flags.go:64] FLAG: --feature-gates="" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339331 2559 flags.go:64] FLAG: --file-check-frequency="20s" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339335 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 20:20:54.342801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339338 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 20:20:54.343435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339343 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 20:20:54.343435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339346 2559 flags.go:64] FLAG: --healthz-port="10248" May 21 20:20:54.343435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339349 2559 flags.go:64] FLAG: --help="false" May 21 20:20:54.343435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339352 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-134-40.ec2.internal" May 21 20:20:54.343435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339355 2559 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 20:20:54.343435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339358 2559 flags.go:64] FLAG: --http-check-frequency="20s" May 21 20:20:54.343435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339361 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 20:20:54.343435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339364 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 20:20:54.343435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339368 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 20:20:54.343435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339371 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 20:20:54.343435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339374 2559 flags.go:64] FLAG: --image-service-endpoint="" May 21 20:20:54.343435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339377 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 20:20:54.343435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339380 2559 flags.go:64] FLAG: --kube-api-burst="100" May 21 20:20:54.343435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339382 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 20:20:54.343435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339385 2559 flags.go:64] FLAG: --kube-api-qps="50" May 21 20:20:54.343435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339388 2559 flags.go:64] FLAG: --kube-reserved="" May 21 20:20:54.343435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339392 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 20:20:54.343435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339394 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 20:20:54.343435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339397 2559 flags.go:64] FLAG: --kubelet-cgroups="" May 21 20:20:54.343435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339400 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 20:20:54.343435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339403 2559 flags.go:64] FLAG: --lock-file="" May 21 20:20:54.343435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339406 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 20:20:54.343435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339409 2559 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 20:20:54.343435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339412 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 20:20:54.344069 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339417 2559 flags.go:64] FLAG: --log-json-split-stream="false" May 21 20:20:54.344069 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339420 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 20:20:54.344069 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339423 2559 flags.go:64] FLAG: --log-text-split-stream="false" May 21 20:20:54.344069 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339430 2559 flags.go:64] FLAG: --logging-format="text" May 21 20:20:54.344069 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339433 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 20:20:54.344069 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339436 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 20:20:54.344069 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339439 2559 flags.go:64] FLAG: --manifest-url="" May 21 20:20:54.344069 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339444 2559 flags.go:64] FLAG: --manifest-url-header="" May 21 20:20:54.344069 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339448 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 20:20:54.344069 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339452 2559 flags.go:64] FLAG: --max-open-files="1000000" May 21 20:20:54.344069 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339456 2559 flags.go:64] FLAG: --max-pods="110" May 21 20:20:54.344069 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339460 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 20:20:54.344069 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339463 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 20:20:54.344069 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339465 2559 flags.go:64] FLAG: --memory-manager-policy="None" May 21 20:20:54.344069 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339468 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 20:20:54.344069 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339471 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 20:20:54.344069 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339474 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 20:20:54.344069 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339477 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 20:20:54.344069 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339484 2559 flags.go:64] FLAG: --node-status-max-images="50" May 21 20:20:54.344069 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339487 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 20:20:54.344069 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339489 2559 flags.go:64] FLAG: --oom-score-adj="-999" May 21 20:20:54.344069 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339492 2559 flags.go:64] FLAG: --pod-cidr="" May 21 20:20:54.344069 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339495 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339508 2559 flags.go:64] FLAG: --pod-manifest-path="" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339511 2559 flags.go:64] FLAG: --pod-max-pids="-1" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339514 2559 flags.go:64] FLAG: --pods-per-core="0" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339517 2559 flags.go:64] FLAG: --port="10250" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339520 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339523 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a4175538a86544d0" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339526 2559 flags.go:64] FLAG: --qos-reserved="" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339529 2559 flags.go:64] FLAG: --read-only-port="10255" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339532 2559 flags.go:64] FLAG: --register-node="true" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339535 2559 flags.go:64] FLAG: --register-schedulable="true" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339538 2559 flags.go:64] FLAG: --register-with-taints="" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339542 2559 flags.go:64] FLAG: --registry-burst="10" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339544 2559 flags.go:64] FLAG: --registry-qps="5" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339549 2559 flags.go:64] FLAG: --reserved-cpus="" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339552 2559 flags.go:64] FLAG: --reserved-memory="" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339556 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339561 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339564 2559 flags.go:64] FLAG: --rotate-certificates="false" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339567 2559 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339571 2559 flags.go:64] FLAG: --runonce="false" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339574 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339577 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339579 2559 flags.go:64] FLAG: --seccomp-default="false" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339582 2559 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339585 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 20:20:54.344643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339588 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339591 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339594 2559 flags.go:64] FLAG: --storage-driver-password="root" May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339597 2559 flags.go:64] FLAG: --storage-driver-secure="false" May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339600 2559 flags.go:64] FLAG: --storage-driver-table="stats" May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339602 2559 flags.go:64] FLAG: --storage-driver-user="root" May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339605 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339608 2559 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339611 2559 flags.go:64] FLAG: --system-cgroups="" May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339613 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339619 2559 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339622 2559 flags.go:64] FLAG: --tls-cert-file="" May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339624 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339628 2559 flags.go:64] FLAG: --tls-min-version="" May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339631 2559 flags.go:64] FLAG: --tls-private-key-file="" May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339633 2559 flags.go:64] FLAG: --topology-manager-policy="none" May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339636 2559 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339639 2559 flags.go:64] FLAG: --topology-manager-scope="container" May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339642 2559 flags.go:64] FLAG: --v="2" May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339646 2559 flags.go:64] FLAG: --version="false" May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339651 2559 flags.go:64] FLAG: --vmodule="" May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339656 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.339659 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339769 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339773 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:20:54.345328 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339777 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:20:54.346073 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339780 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:20:54.346073 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339783 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:20:54.346073 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339786 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:20:54.346073 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339789 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:20:54.346073 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339791 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:20:54.346073 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339794 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:20:54.346073 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339797 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:20:54.346073 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339800 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:20:54.346073 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339803 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:20:54.346073 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339806 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:20:54.346073 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339809 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:20:54.346073 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339812 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:20:54.346073 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339814 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:20:54.346073 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339817 2559 feature_gate.go:328] unrecognized feature gate: Example May 21 20:20:54.346073 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339820 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:20:54.346073 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339823 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:20:54.346073 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339826 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:20:54.346073 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339828 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:20:54.346073 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339830 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:20:54.346073 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339833 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:20:54.346655 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339835 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:20:54.346655 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339837 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:20:54.346655 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339840 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:20:54.346655 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339843 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:20:54.346655 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339845 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:20:54.346655 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339847 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:20:54.346655 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339852 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:20:54.346655 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339855 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:20:54.346655 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339857 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:20:54.346655 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339864 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:20:54.346655 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339868 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:20:54.346655 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339873 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:20:54.346655 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339876 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:20:54.346655 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339878 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:20:54.346655 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339882 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:20:54.346655 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339885 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:20:54.346655 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339887 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:20:54.346655 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339890 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:20:54.346655 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339893 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:20:54.347214 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339895 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:20:54.347214 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339898 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:20:54.347214 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339900 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:20:54.347214 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339902 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:20:54.347214 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339905 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:20:54.347214 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339907 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:20:54.347214 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339910 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:20:54.347214 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339912 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:20:54.347214 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339915 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:20:54.347214 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339918 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:20:54.347214 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339921 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:20:54.347214 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339923 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:20:54.347214 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339926 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:20:54.347214 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339928 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:20:54.347214 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339931 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:20:54.347214 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339933 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:20:54.347214 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339936 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:20:54.347214 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339938 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:20:54.347214 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339941 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:20:54.347214 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339944 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:20:54.347794 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339946 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:20:54.347794 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339949 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:20:54.347794 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339953 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:20:54.347794 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339955 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:20:54.347794 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339958 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:20:54.347794 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339960 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:20:54.347794 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339963 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:20:54.347794 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339965 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:20:54.347794 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339970 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:20:54.347794 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339973 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:20:54.347794 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339976 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:20:54.347794 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339978 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:20:54.347794 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339981 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:20:54.347794 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339983 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:20:54.347794 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339986 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:20:54.347794 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339988 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:20:54.347794 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339990 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:20:54.347794 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339993 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:20:54.347794 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339995 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:20:54.347794 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.339998 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:20:54.348365 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.340000 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:20:54.348365 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.340003 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:20:54.348365 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.340005 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:20:54.348365 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.340008 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:20:54.348365 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.340013 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 20:20:54.348365 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.346662 2559 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 20:20:54.348365 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.346678 2559 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 20:20:54.348365 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346728 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:20:54.348365 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346733 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:20:54.348365 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346737 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:20:54.348365 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346740 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:20:54.348365 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346743 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:20:54.348365 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346746 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:20:54.348365 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346749 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:20:54.348365 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346753 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:20:54.348365 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346756 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:20:54.348831 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346759 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:20:54.348831 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346761 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:20:54.348831 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346764 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:20:54.348831 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346767 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:20:54.348831 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346770 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:20:54.348831 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346773 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:20:54.348831 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346776 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:20:54.348831 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346779 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:20:54.348831 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346782 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:20:54.348831 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346785 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:20:54.348831 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346787 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:20:54.348831 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346790 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:20:54.348831 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346792 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:20:54.348831 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346795 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:20:54.348831 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346797 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:20:54.348831 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346800 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:20:54.348831 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346802 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:20:54.348831 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346805 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:20:54.348831 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346807 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:20:54.348831 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346810 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:20:54.349408 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346812 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:20:54.349408 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346815 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:20:54.349408 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346818 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:20:54.349408 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346821 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:20:54.349408 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346824 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:20:54.349408 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346826 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:20:54.349408 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346829 2559 feature_gate.go:328] unrecognized feature gate: Example May 21 20:20:54.349408 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346831 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:20:54.349408 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346834 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:20:54.349408 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346836 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:20:54.349408 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346839 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:20:54.349408 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346841 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:20:54.349408 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346844 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:20:54.349408 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346846 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:20:54.349408 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346848 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:20:54.349408 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346851 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:20:54.349408 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346854 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:20:54.349408 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346857 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:20:54.349408 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346859 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:20:54.349408 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346862 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:20:54.349946 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346864 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:20:54.349946 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346867 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:20:54.349946 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346869 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:20:54.349946 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346872 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:20:54.349946 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346874 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:20:54.349946 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346877 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:20:54.349946 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346880 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:20:54.349946 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346883 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:20:54.349946 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346885 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:20:54.349946 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346888 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:20:54.349946 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346890 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:20:54.349946 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346892 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:20:54.349946 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346895 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:20:54.349946 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346897 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:20:54.349946 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346900 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:20:54.349946 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346903 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:20:54.349946 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346905 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:20:54.349946 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346908 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:20:54.349946 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346910 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:20:54.349946 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346912 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:20:54.350471 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346917 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:20:54.350471 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346921 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:20:54.350471 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346924 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:20:54.350471 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346926 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:20:54.350471 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346930 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:20:54.350471 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346934 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:20:54.350471 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346936 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:20:54.350471 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346939 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:20:54.350471 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346942 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:20:54.350471 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346944 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:20:54.350471 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346947 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:20:54.350471 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346950 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:20:54.350471 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346953 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:20:54.350471 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346955 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:20:54.350471 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346958 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:20:54.350471 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346960 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:20:54.350471 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.346963 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:20:54.350900 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.346968 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 20:20:54.350900 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347084 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:20:54.350900 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347090 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:20:54.350900 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347094 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:20:54.350900 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347098 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:20:54.350900 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347101 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:20:54.350900 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347104 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:20:54.350900 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347107 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:20:54.350900 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347110 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:20:54.350900 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347113 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:20:54.350900 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347116 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:20:54.350900 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347119 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:20:54.350900 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347121 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:20:54.350900 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347124 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:20:54.350900 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347126 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:20:54.351336 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347129 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:20:54.351336 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347131 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:20:54.351336 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347134 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:20:54.351336 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347136 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:20:54.351336 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347138 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:20:54.351336 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347141 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:20:54.351336 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347143 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:20:54.351336 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347146 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:20:54.351336 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347148 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:20:54.351336 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347150 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:20:54.351336 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347153 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:20:54.351336 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347157 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:20:54.351336 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347159 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:20:54.351336 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347162 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:20:54.351336 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347164 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:20:54.351336 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347167 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:20:54.351336 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347169 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:20:54.351336 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347172 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:20:54.351336 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347175 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:20:54.351336 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347177 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:20:54.351836 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347180 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:20:54.351836 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347182 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:20:54.351836 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347185 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:20:54.351836 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347187 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:20:54.351836 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347190 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:20:54.351836 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347192 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:20:54.351836 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347194 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:20:54.351836 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347197 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:20:54.351836 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347200 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:20:54.351836 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347202 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:20:54.351836 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347205 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:20:54.351836 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347207 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:20:54.351836 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347210 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:20:54.351836 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347212 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:20:54.351836 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347214 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:20:54.351836 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347217 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:20:54.351836 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347220 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:20:54.351836 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347222 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:20:54.351836 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347225 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:20:54.351836 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347227 2559 feature_gate.go:328] unrecognized feature gate: Example May 21 20:20:54.352353 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347230 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:20:54.352353 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347232 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:20:54.352353 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347234 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:20:54.352353 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347237 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:20:54.352353 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347240 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:20:54.352353 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347242 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:20:54.352353 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347245 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:20:54.352353 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347247 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:20:54.352353 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347250 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:20:54.352353 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347252 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:20:54.352353 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347255 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:20:54.352353 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347257 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:20:54.352353 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347260 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:20:54.352353 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347262 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:20:54.352353 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347264 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:20:54.352353 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347267 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:20:54.352353 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347269 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:20:54.352353 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347272 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:20:54.352353 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347274 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:20:54.352353 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347276 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:20:54.352844 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347279 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:20:54.352844 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347281 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:20:54.352844 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347284 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:20:54.352844 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347286 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:20:54.352844 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347288 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:20:54.352844 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347291 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:20:54.352844 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347293 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:20:54.352844 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347295 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:20:54.352844 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347299 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:20:54.352844 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347302 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:20:54.352844 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347305 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:20:54.352844 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:54.347308 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:20:54.352844 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.347313 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 20:20:54.352844 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.348177 2559 server.go:962] "Client rotation is on, will bootstrap in background" May 21 20:20:54.352844 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.350286 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 20:20:54.353237 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.351280 2559 server.go:1019] "Starting client certificate rotation" May 21 20:20:54.353237 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.351375 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 20:20:54.353237 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.352038 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 20:20:54.376102 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.376084 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 20:20:54.379599 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.378556 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 20:20:54.393431 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.393410 2559 log.go:25] "Validated CRI v1 runtime API" May 21 20:20:54.399024 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.399008 2559 log.go:25] "Validated CRI v1 image API" May 21 20:20:54.400459 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.400444 2559 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 20:20:54.405884 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.405862 2559 fs.go:135] Filesystem UUIDs: map[2c357cd5-f9d7-487b-bd15-57913463d73e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b775eb3c-b730-4457-8d1e-1ee55e0c0661:/dev/nvme0n1p4] May 21 20:20:54.405967 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.405885 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 20:20:54.405967 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.405865 2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 20:20:54.410246 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.410120 2559 manager.go:217] Machine: {Timestamp:2026-05-21 20:20:54.409610804 +0000 UTC m=+0.407999778 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098688 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25885c16c46024f3ac2d3cb45e4bc5 SystemUUID:ec25885c-16c4-6024-f3ac-2d3cb45e4bc5 BootID:5073557e-d805-47f4-97c3-34d113e1f9d5 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b6:ce:b8:4c:3f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b6:ce:b8:4c:3f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:10:d7:67:21:8f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 20:20:54.411082 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.411048 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 20:20:54.411192 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.411176 2559 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 20:20:54.413710 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.413681 2559 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 20:20:54.413839 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.413713 2559 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-40.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 20:20:54.413884 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.413850 2559 topology_manager.go:138] "Creating topology manager with none policy" May 21 20:20:54.413884 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.413859 2559 container_manager_linux.go:306] "Creating device plugin manager" May 21 20:20:54.413884 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.413867 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 20:20:54.414657 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.414647 2559 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 20:20:54.416000 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.415989 2559 state_mem.go:36] "Initialized new in-memory state store" May 21 20:20:54.416124 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.416115 2559 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 20:20:54.418538 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.418528 2559 kubelet.go:491] "Attempting to sync node with API server" May 21 20:20:54.418571 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.418542 2559 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 20:20:54.418571 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.418553 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 20:20:54.418571 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.418564 2559 kubelet.go:397] "Adding apiserver pod source" May 21 20:20:54.418688 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.418572 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 20:20:54.419714 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.419703 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 20:20:54.419754 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.419723 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 20:20:54.422887 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.422869 2559 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 20:20:54.424374 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.424357 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-psx74" May 21 20:20:54.426955 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.426930 2559 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 20:20:54.427964 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.427937 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 20:20:54.428079 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.427973 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 20:20:54.428079 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.427983 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 20:20:54.428079 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.427991 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 20:20:54.428079 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.428003 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 20:20:54.428079 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.428012 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 20:20:54.428079 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.428021 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 20:20:54.428079 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.428029 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 20:20:54.428079 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.428040 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 20:20:54.428079 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.428070 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 20:20:54.428441 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.428089 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 20:20:54.430097 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.430080 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 20:20:54.430175 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.430141 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 20:20:54.430175 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.430152 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 20:20:54.430495 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:54.430463 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 20:20:54.430559 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:54.430546 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-40.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 20:20:54.430900 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.430885 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-psx74" May 21 20:20:54.432605 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.432590 2559 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-40.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 20:20:54.433769 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.433756 2559 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 20:20:54.433822 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.433799 2559 server.go:1295] "Started kubelet" May 21 20:20:54.433890 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.433866 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 20:20:54.433977 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.433896 2559 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 20:20:54.434023 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.434000 2559 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 20:20:54.434731 ip-10-0-134-40 systemd[1]: Started Kubernetes Kubelet. May 21 20:20:54.435269 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.434999 2559 server.go:317] "Adding debug handlers to kubelet server" May 21 20:20:54.435755 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.435741 2559 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 20:20:54.441476 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.441458 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 20:20:54.442037 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.442022 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 20:20:54.442208 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.442191 2559 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 20:20:54.442208 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.442206 2559 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 20:20:54.442323 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.442317 2559 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 20:20:54.442381 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.442350 2559 reconstruct.go:97] "Volume reconstruction finished" May 21 20:20:54.442381 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.442355 2559 reconciler.go:26] "Reconciler: start to sync state" May 21 20:20:54.443013 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:54.442937 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-40.ec2.internal\" not found" May 21 20:20:54.443213 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.443045 2559 factory.go:55] Registering systemd factory May 21 20:20:54.443213 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.443101 2559 factory.go:223] Registration of the systemd container factory successfully May 21 20:20:54.443394 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.443375 2559 factory.go:153] Registering CRI-O factory May 21 20:20:54.443468 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.443398 2559 factory.go:223] Registration of the crio container factory successfully May 21 20:20:54.443468 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.443462 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 20:20:54.443571 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.443481 2559 factory.go:103] Registering Raw factory May 21 20:20:54.443571 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.443496 2559 manager.go:1196] Started watching for new ooms in manager May 21 20:20:54.444673 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:54.444649 2559 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 20:20:54.444752 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.444707 2559 manager.go:319] Starting recovery of all containers May 21 20:20:54.449570 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.449547 2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:20:54.451907 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:54.451886 2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-40.ec2.internal\" not found" node="ip-10-0-134-40.ec2.internal" May 21 20:20:54.452608 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.452593 2559 manager.go:324] Recovery completed May 21 20:20:54.458023 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.457880 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:20:54.460159 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.460131 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-40.ec2.internal" event="NodeHasSufficientMemory" May 21 20:20:54.460238 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.460176 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-40.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:20:54.460238 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.460200 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-40.ec2.internal" event="NodeHasSufficientPID" May 21 20:20:54.461032 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.461004 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 20:20:54.461032 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.461018 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 20:20:54.461032 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.461035 2559 state_mem.go:36] "Initialized new in-memory state store" May 21 20:20:54.463193 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.463179 2559 policy_none.go:49] "None policy: Start" May 21 20:20:54.463252 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.463198 2559 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 20:20:54.463252 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.463208 2559 state_mem.go:35] "Initializing new in-memory state store" May 21 20:20:54.500620 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.500600 2559 manager.go:341] "Starting Device Plugin manager" May 21 20:20:54.512426 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:54.500630 2559 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 20:20:54.512426 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.500641 2559 server.go:85] "Starting device plugin registration server" May 21 20:20:54.512426 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.500876 2559 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 20:20:54.512426 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.500888 2559 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 20:20:54.512426 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.500991 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 20:20:54.512426 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.501130 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 20:20:54.512426 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.501142 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 20:20:54.512426 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:54.501611 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 20:20:54.512426 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:54.501640 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-40.ec2.internal\" not found" May 21 20:20:54.569653 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.569618 2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 20:20:54.570952 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.570936 2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 20:20:54.571001 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.570963 2559 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 20:20:54.571001 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.570983 2559 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 20:20:54.571001 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.570992 2559 kubelet.go:2451] "Starting kubelet main sync loop" May 21 20:20:54.571130 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:54.571037 2559 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 20:20:54.574272 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.574250 2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:20:54.601128 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.601084 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:20:54.601841 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.601826 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-40.ec2.internal" event="NodeHasSufficientMemory" May 21 20:20:54.601890 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.601855 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-40.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:20:54.601890 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.601866 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-40.ec2.internal" event="NodeHasSufficientPID" May 21 20:20:54.601890 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.601889 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-40.ec2.internal" May 21 20:20:54.609879 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.609863 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-40.ec2.internal" May 21 20:20:54.609933 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:54.609880 2559 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-40.ec2.internal\": node \"ip-10-0-134-40.ec2.internal\" not found" May 21 20:20:54.621041 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:54.621016 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-40.ec2.internal\" not found" May 21 20:20:54.672004 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.671972 2559 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-40.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-40.ec2.internal"] May 21 20:20:54.672108 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.672039 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:20:54.673594 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.673579 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-40.ec2.internal" event="NodeHasSufficientMemory" May 21 20:20:54.673677 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.673609 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-40.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:20:54.673677 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.673622 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-40.ec2.internal" event="NodeHasSufficientPID" May 21 20:20:54.674731 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.674716 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:20:54.674899 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.674885 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-40.ec2.internal" May 21 20:20:54.674950 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.674916 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:20:54.675429 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.675409 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-40.ec2.internal" event="NodeHasSufficientMemory" May 21 20:20:54.675515 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.675441 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-40.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:20:54.675515 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.675460 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-40.ec2.internal" event="NodeHasSufficientPID" May 21 20:20:54.675515 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.675413 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-40.ec2.internal" event="NodeHasSufficientMemory" May 21 20:20:54.675515 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.675515 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-40.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:20:54.675652 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.675525 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-40.ec2.internal" event="NodeHasSufficientPID" May 21 20:20:54.676608 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.676594 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-40.ec2.internal" May 21 20:20:54.676696 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.676647 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:20:54.677353 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.677338 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-40.ec2.internal" event="NodeHasSufficientMemory" May 21 20:20:54.677429 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.677368 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-40.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:20:54.677429 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.677382 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-40.ec2.internal" event="NodeHasSufficientPID" May 21 20:20:54.706650 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:54.706628 2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-40.ec2.internal\" not found" node="ip-10-0-134-40.ec2.internal" May 21 20:20:54.710907 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:54.710893 2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-40.ec2.internal\" not found" node="ip-10-0-134-40.ec2.internal" May 21 20:20:54.721694 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:54.721679 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-40.ec2.internal\" not found" May 21 20:20:54.743987 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.743967 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2b239f9058f74be02d04b5869d9c34b4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-40.ec2.internal\" (UID: \"2b239f9058f74be02d04b5869d9c34b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-40.ec2.internal" May 21 20:20:54.744037 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.743992 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b239f9058f74be02d04b5869d9c34b4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-40.ec2.internal\" (UID: \"2b239f9058f74be02d04b5869d9c34b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-40.ec2.internal" May 21 20:20:54.744037 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.744008 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/737f2ee8a38127b7d0bda2823f387f82-config\") pod \"kube-apiserver-proxy-ip-10-0-134-40.ec2.internal\" (UID: \"737f2ee8a38127b7d0bda2823f387f82\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-40.ec2.internal" May 21 20:20:54.821966 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:54.821942 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-40.ec2.internal\" not found" May 21 20:20:54.844245 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.844223 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/737f2ee8a38127b7d0bda2823f387f82-config\") pod \"kube-apiserver-proxy-ip-10-0-134-40.ec2.internal\" (UID: \"737f2ee8a38127b7d0bda2823f387f82\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-40.ec2.internal" May 21 20:20:54.844303 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.844250 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2b239f9058f74be02d04b5869d9c34b4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-40.ec2.internal\" (UID: \"2b239f9058f74be02d04b5869d9c34b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-40.ec2.internal" May 21 20:20:54.844303 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.844268 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b239f9058f74be02d04b5869d9c34b4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-40.ec2.internal\" (UID: \"2b239f9058f74be02d04b5869d9c34b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-40.ec2.internal" May 21 20:20:54.844370 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.844304 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b239f9058f74be02d04b5869d9c34b4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-40.ec2.internal\" (UID: \"2b239f9058f74be02d04b5869d9c34b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-40.ec2.internal" May 21 20:20:54.844370 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.844324 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/737f2ee8a38127b7d0bda2823f387f82-config\") pod \"kube-apiserver-proxy-ip-10-0-134-40.ec2.internal\" (UID: \"737f2ee8a38127b7d0bda2823f387f82\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-40.ec2.internal" May 21 20:20:54.844370 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:54.844340 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2b239f9058f74be02d04b5869d9c34b4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-40.ec2.internal\" (UID: \"2b239f9058f74be02d04b5869d9c34b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-40.ec2.internal" May 21 20:20:54.922648 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:54.922568 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-40.ec2.internal\" not found" May 21 20:20:55.009041 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.009014 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-40.ec2.internal" May 21 20:20:55.013848 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.013822 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-40.ec2.internal" May 21 20:20:55.023464 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:55.023437 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-40.ec2.internal\" not found" May 21 20:20:55.123969 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:55.123939 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-40.ec2.internal\" not found" May 21 20:20:55.224482 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:55.224409 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-40.ec2.internal\" not found" May 21 20:20:55.312156 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.312130 2559 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:20:55.342986 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.342960 2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-40.ec2.internal" May 21 20:20:55.351932 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.351912 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 20:20:55.352079 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.352043 2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 20:20:55.352139 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.352044 2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 20:20:55.352139 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.352097 2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 20:20:55.352139 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:55.352079 2559 kubelet.go:3342] "Failed creating a mirror pod" err="Post \"https://ae3642468c3e24d36990187c83bd083c-628b1c7255412805.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.134.40:45760->32.194.42.86:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-40.ec2.internal" May 21 20:20:55.352139 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.352131 2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-40.ec2.internal" May 21 20:20:55.369533 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.369510 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 20:20:55.419432 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.419176 2559 apiserver.go:52] "Watching apiserver" May 21 20:20:55.428257 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.428237 2559 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 20:20:55.428572 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.428551 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-6tkgs","kube-system/konnectivity-agent-jfg8z","kube-system/kube-apiserver-proxy-ip-10-0-134-40.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5","openshift-cluster-node-tuning-operator/tuned-drlv6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-40.ec2.internal","openshift-multus/multus-additional-cni-plugins-6q9zf","openshift-multus/multus-j7565","openshift-multus/network-metrics-daemon-5nnzg","openshift-image-registry/node-ca-ttlgr","openshift-network-diagnostics/network-check-target-h9lxq","openshift-network-operator/iptables-alerter-tzlp4"] May 21 20:20:55.430834 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.430813 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.430928 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.430844 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jfg8z" May 21 20:20:55.431899 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.431881 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" May 21 20:20:55.432927 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.432875 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 20:15:54 +0000 UTC" deadline="2027-11-10 17:40:46.155795713 +0000 UTC" May 21 20:20:55.432927 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.432903 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12909h19m50.722896768s" May 21 20:20:55.433078 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.432926 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.434000 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.433978 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 20:20:55.434207 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.434189 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 20:20:55.434279 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.434243 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 20:20:55.434349 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.434329 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nbnsx\"" May 21 20:20:55.434398 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.434383 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-t7b47\"" May 21 20:20:55.434450 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.434412 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 20:20:55.434519 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.434503 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 20:20:55.434575 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.434558 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 20:20:55.434624 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.434612 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 20:20:55.434689 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.434674 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 20:20:55.435507 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.435423 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.436097 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.435912 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-n7k96\"" May 21 20:20:55.436566 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.436330 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 20:20:55.436566 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.436354 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 20:20:55.436566 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.436364 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 20:20:55.436566 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.436427 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x79pt\"" May 21 20:20:55.436566 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.436447 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 20:20:55.436886 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.436867 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 20:20:55.437429 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.437410 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j7565" May 21 20:20:55.437539 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.437517 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 20:20:55.437800 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.437768 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 20:20:55.437800 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.437787 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b7s88\"" May 21 20:20:55.438110 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.438088 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 20:20:55.438216 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.438120 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 20:20:55.438360 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.438338 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 20:20:55.438730 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.438718 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:20:55.438806 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:55.438786 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nnzg" podUID="f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2" May 21 20:20:55.439321 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.439303 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 20:20:55.439420 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.439370 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vw85f\"" May 21 20:20:55.439781 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.439765 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ttlgr" May 21 20:20:55.441278 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.441264 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:20:55.441349 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:55.441321 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9lxq" podUID="ecaedb39-3cf7-450d-8e42-f508c68a92b8" May 21 20:20:55.441572 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.441553 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 20:20:55.441694 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.441599 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 20:20:55.441694 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.441666 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 20:20:55.441848 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.441836 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-45ght\"" May 21 20:20:55.442169 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.442155 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 20:20:55.442560 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.442540 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tzlp4" May 21 20:20:55.444676 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.444653 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xbxdg\"" May 21 20:20:55.444676 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.444667 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 20:20:55.444676 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.444657 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 20:20:55.444853 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.444696 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 20:20:55.447531 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.447510 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b6243830-7e3d-49a1-bf9b-4ea34049b583-iptables-alerter-script\") pod \"iptables-alerter-tzlp4\" (UID: \"b6243830-7e3d-49a1-bf9b-4ea34049b583\") " pod="openshift-network-operator/iptables-alerter-tzlp4" May 21 20:20:55.447622 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.447540 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-os-release\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.447622 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.447557 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6mds\" (UniqueName: \"kubernetes.io/projected/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-kube-api-access-w6mds\") pod \"network-metrics-daemon-5nnzg\" (UID: \"f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2\") " pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:20:55.447622 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.447574 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7kxh\" (UniqueName: \"kubernetes.io/projected/9cfae7f5-193d-448f-91d1-e9992e31ea60-kube-api-access-z7kxh\") pod \"node-ca-ttlgr\" (UID: \"9cfae7f5-193d-448f-91d1-e9992e31ea60\") " pod="openshift-image-registry/node-ca-ttlgr" May 21 20:20:55.447622 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.447596 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rxvn\" (UniqueName: \"kubernetes.io/projected/ecaedb39-3cf7-450d-8e42-f508c68a92b8-kube-api-access-7rxvn\") pod \"network-check-target-h9lxq\" (UID: \"ecaedb39-3cf7-450d-8e42-f508c68a92b8\") " pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:20:55.447751 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.447625 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-host\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.447751 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.447656 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1df76140-3e4f-445a-b48c-c6bc241b8a58-konnectivity-ca\") pod \"konnectivity-agent-jfg8z\" (UID: \"1df76140-3e4f-445a-b48c-c6bc241b8a58\") " pod="kube-system/konnectivity-agent-jfg8z" May 21 20:20:55.447751 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.447681 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-systemd-units\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.447751 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.447697 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-var-lib-openvswitch\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.447751 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.447715 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-etc-modprobe-d\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.447751 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.447739 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/90550377-b48a-478e-a7fd-ad307fd58da9-etc-tuned\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.447917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.447754 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-system-cni-dir\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.447917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.447769 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-multus-daemon-config\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.447917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.447784 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-run-systemd\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.447917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.447798 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-etc-openvswitch\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.447917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.447819 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.447917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.447840 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e91dc6e1-fda3-49e9-a972-392fad3bf1c4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8fbn5\" (UID: \"e91dc6e1-fda3-49e9-a972-392fad3bf1c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" May 21 20:20:55.447917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.447854 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-etc-sysctl-d\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.447917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.447868 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-etc-sysctl-conf\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.447917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.447901 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-cni-binary-copy\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.448220 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.447929 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-multus-socket-dir-parent\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.448220 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.447949 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-run-openvswitch\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.448220 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.447977 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/61df691b-d720-4813-9647-631228bc7521-ovnkube-script-lib\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.448220 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.447998 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e91dc6e1-fda3-49e9-a972-392fad3bf1c4-sys-fs\") pod \"aws-ebs-csi-driver-node-8fbn5\" (UID: \"e91dc6e1-fda3-49e9-a972-392fad3bf1c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" May 21 20:20:55.448220 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448029 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-etc-systemd\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.448220 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448073 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-cnibin\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.448220 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448113 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-host-var-lib-cni-bin\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.448220 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448133 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-etc-kubernetes\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.448220 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448149 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2203055e-7913-47ff-8c77-bed42b5caf84-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6q9zf\" (UID: \"2203055e-7913-47ff-8c77-bed42b5caf84\") " pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.448220 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448167 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/61df691b-d720-4813-9647-631228bc7521-env-overrides\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.448220 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448185 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e91dc6e1-fda3-49e9-a972-392fad3bf1c4-device-dir\") pod \"aws-ebs-csi-driver-node-8fbn5\" (UID: \"e91dc6e1-fda3-49e9-a972-392fad3bf1c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" May 21 20:20:55.448220 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448199 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-host-var-lib-kubelet\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.448220 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448212 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9cfae7f5-193d-448f-91d1-e9992e31ea60-host\") pod \"node-ca-ttlgr\" (UID: \"9cfae7f5-193d-448f-91d1-e9992e31ea60\") " pod="openshift-image-registry/node-ca-ttlgr" May 21 20:20:55.448732 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448229 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6243830-7e3d-49a1-bf9b-4ea34049b583-host-slash\") pod \"iptables-alerter-tzlp4\" (UID: \"b6243830-7e3d-49a1-bf9b-4ea34049b583\") " pod="openshift-network-operator/iptables-alerter-tzlp4" May 21 20:20:55.448732 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448247 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-host-run-netns\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.448732 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448260 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-host-run-k8s-cni-cncf-io\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.448732 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448274 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-host-var-lib-cni-multus\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.448732 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448291 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-multus-conf-dir\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.448732 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448312 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2203055e-7913-47ff-8c77-bed42b5caf84-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6q9zf\" (UID: \"2203055e-7913-47ff-8c77-bed42b5caf84\") " pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.448732 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448327 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9cfae7f5-193d-448f-91d1-e9992e31ea60-serviceca\") pod \"node-ca-ttlgr\" (UID: \"9cfae7f5-193d-448f-91d1-e9992e31ea60\") " pod="openshift-image-registry/node-ca-ttlgr" May 21 20:20:55.448732 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448341 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgjkt\" (UniqueName: \"kubernetes.io/projected/b6243830-7e3d-49a1-bf9b-4ea34049b583-kube-api-access-rgjkt\") pod \"iptables-alerter-tzlp4\" (UID: \"b6243830-7e3d-49a1-bf9b-4ea34049b583\") " pod="openshift-network-operator/iptables-alerter-tzlp4" May 21 20:20:55.448732 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448361 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-run-ovn\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.448732 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448387 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-node-log\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.448732 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448410 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-host-run-ovn-kubernetes\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.448732 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448434 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/61df691b-d720-4813-9647-631228bc7521-ovn-node-metrics-cert\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.448732 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448460 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-etc-sysconfig\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.448732 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448526 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2203055e-7913-47ff-8c77-bed42b5caf84-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6q9zf\" (UID: \"2203055e-7913-47ff-8c77-bed42b5caf84\") " pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.448732 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448562 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-host-cni-netd\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.448732 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448588 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-run\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.449362 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448622 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4tgp\" (UniqueName: \"kubernetes.io/projected/90550377-b48a-478e-a7fd-ad307fd58da9-kube-api-access-m4tgp\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.449362 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448676 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-host-slash\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.449362 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448699 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-multus-cni-dir\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.449362 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448722 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-metrics-certs\") pod \"network-metrics-daemon-5nnzg\" (UID: \"f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2\") " pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:20:55.449362 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448746 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2203055e-7913-47ff-8c77-bed42b5caf84-system-cni-dir\") pod \"multus-additional-cni-plugins-6q9zf\" (UID: \"2203055e-7913-47ff-8c77-bed42b5caf84\") " pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.449362 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448768 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2203055e-7913-47ff-8c77-bed42b5caf84-cnibin\") pod \"multus-additional-cni-plugins-6q9zf\" (UID: \"2203055e-7913-47ff-8c77-bed42b5caf84\") " pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.449362 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448790 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-host-cni-bin\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.449362 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448815 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-host-run-multus-certs\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.449362 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448846 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxh8n\" (UniqueName: \"kubernetes.io/projected/2203055e-7913-47ff-8c77-bed42b5caf84-kube-api-access-qxh8n\") pod \"multus-additional-cni-plugins-6q9zf\" (UID: \"2203055e-7913-47ff-8c77-bed42b5caf84\") " pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.449362 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448864 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90550377-b48a-478e-a7fd-ad307fd58da9-tmp\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.449362 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448907 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdhsg\" (UniqueName: \"kubernetes.io/projected/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-kube-api-access-vdhsg\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.449362 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448940 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1df76140-3e4f-445a-b48c-c6bc241b8a58-agent-certs\") pod \"konnectivity-agent-jfg8z\" (UID: \"1df76140-3e4f-445a-b48c-c6bc241b8a58\") " pod="kube-system/konnectivity-agent-jfg8z" May 21 20:20:55.449362 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448968 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2203055e-7913-47ff-8c77-bed42b5caf84-os-release\") pod \"multus-additional-cni-plugins-6q9zf\" (UID: \"2203055e-7913-47ff-8c77-bed42b5caf84\") " pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.449362 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.448991 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-log-socket\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.449362 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.449006 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/61df691b-d720-4813-9647-631228bc7521-ovnkube-config\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.449362 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.449022 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plhbh\" (UniqueName: \"kubernetes.io/projected/e91dc6e1-fda3-49e9-a972-392fad3bf1c4-kube-api-access-plhbh\") pod \"aws-ebs-csi-driver-node-8fbn5\" (UID: \"e91dc6e1-fda3-49e9-a972-392fad3bf1c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" May 21 20:20:55.449793 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.449044 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-lib-modules\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.449793 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.449088 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-var-lib-kubelet\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.449793 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.449107 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2203055e-7913-47ff-8c77-bed42b5caf84-cni-binary-copy\") pod \"multus-additional-cni-plugins-6q9zf\" (UID: \"2203055e-7913-47ff-8c77-bed42b5caf84\") " pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.449793 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.449122 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g9dv\" (UniqueName: \"kubernetes.io/projected/61df691b-d720-4813-9647-631228bc7521-kube-api-access-4g9dv\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.449793 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.449135 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e91dc6e1-fda3-49e9-a972-392fad3bf1c4-socket-dir\") pod \"aws-ebs-csi-driver-node-8fbn5\" (UID: \"e91dc6e1-fda3-49e9-a972-392fad3bf1c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" May 21 20:20:55.449793 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.449148 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e91dc6e1-fda3-49e9-a972-392fad3bf1c4-etc-selinux\") pod \"aws-ebs-csi-driver-node-8fbn5\" (UID: \"e91dc6e1-fda3-49e9-a972-392fad3bf1c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" May 21 20:20:55.449793 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.449167 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-sys\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.449793 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.449186 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-hostroot\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.449793 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.449199 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-host-kubelet\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.449793 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.449249 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e91dc6e1-fda3-49e9-a972-392fad3bf1c4-registration-dir\") pod \"aws-ebs-csi-driver-node-8fbn5\" (UID: \"e91dc6e1-fda3-49e9-a972-392fad3bf1c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" May 21 20:20:55.449793 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.449264 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-etc-kubernetes\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.449793 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.449278 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-host-run-netns\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.453624 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.453606 2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 20:20:55.475145 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.475102 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lwrf6" May 21 20:20:55.480153 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.480139 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lwrf6" May 21 20:20:55.482221 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:55.482190 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b239f9058f74be02d04b5869d9c34b4.slice/crio-67a65f9865a82e90645eede97530361c9d22736a00aeb73de90e2ffd43461747 WatchSource:0}: Error finding container 67a65f9865a82e90645eede97530361c9d22736a00aeb73de90e2ffd43461747: Status 404 returned error can't find the container with id 67a65f9865a82e90645eede97530361c9d22736a00aeb73de90e2ffd43461747 May 21 20:20:55.482419 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:55.482403 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod737f2ee8a38127b7d0bda2823f387f82.slice/crio-a9cad9f432bb0530ce2ab89f84296a269ee1cff38e1aca6f14b0dcd61cd12106 WatchSource:0}: Error finding container a9cad9f432bb0530ce2ab89f84296a269ee1cff38e1aca6f14b0dcd61cd12106: Status 404 returned error can't find the container with id a9cad9f432bb0530ce2ab89f84296a269ee1cff38e1aca6f14b0dcd61cd12106 May 21 20:20:55.486137 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.486123 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 20:20:55.543436 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.543411 2559 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 20:20:55.549685 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.549665 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-etc-modprobe-d\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.549747 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.549697 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/90550377-b48a-478e-a7fd-ad307fd58da9-etc-tuned\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.549747 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.549725 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-system-cni-dir\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.549830 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.549749 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-multus-daemon-config\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.549830 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.549771 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-run-systemd\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.549830 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.549791 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-etc-openvswitch\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.549830 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.549814 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.550018 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.549825 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-system-cni-dir\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.550018 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.549843 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e91dc6e1-fda3-49e9-a972-392fad3bf1c4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8fbn5\" (UID: \"e91dc6e1-fda3-49e9-a972-392fad3bf1c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" May 21 20:20:55.550018 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.549858 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-etc-modprobe-d\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.550018 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.549860 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-run-systemd\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.550018 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.549872 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-etc-openvswitch\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.550018 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.549884 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.550018 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.549869 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-etc-sysctl-d\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.550018 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.549937 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-etc-sysctl-conf\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.550018 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.549939 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e91dc6e1-fda3-49e9-a972-392fad3bf1c4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8fbn5\" (UID: \"e91dc6e1-fda3-49e9-a972-392fad3bf1c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" May 21 20:20:55.550018 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.549961 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-etc-sysctl-d\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.550018 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.549968 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-cni-binary-copy\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.550018 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.549998 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-multus-socket-dir-parent\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.550018 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550025 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-run-openvswitch\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.550018 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550048 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/61df691b-d720-4813-9647-631228bc7521-ovnkube-script-lib\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.550834 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550072 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-etc-sysctl-conf\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.550834 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550095 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e91dc6e1-fda3-49e9-a972-392fad3bf1c4-sys-fs\") pod \"aws-ebs-csi-driver-node-8fbn5\" (UID: \"e91dc6e1-fda3-49e9-a972-392fad3bf1c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" May 21 20:20:55.550834 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550098 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-run-openvswitch\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.550834 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550109 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-multus-socket-dir-parent\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.550834 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550121 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-etc-systemd\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.550834 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550155 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 20:20:55.550834 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550164 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-cnibin\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.550834 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550176 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-etc-systemd\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.550834 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550193 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-host-var-lib-cni-bin\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.550834 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550221 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-etc-kubernetes\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.550834 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550229 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e91dc6e1-fda3-49e9-a972-392fad3bf1c4-sys-fs\") pod \"aws-ebs-csi-driver-node-8fbn5\" (UID: \"e91dc6e1-fda3-49e9-a972-392fad3bf1c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" May 21 20:20:55.550834 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550250 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2203055e-7913-47ff-8c77-bed42b5caf84-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6q9zf\" (UID: \"2203055e-7913-47ff-8c77-bed42b5caf84\") " pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.550834 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550277 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/61df691b-d720-4813-9647-631228bc7521-env-overrides\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.550834 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550301 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e91dc6e1-fda3-49e9-a972-392fad3bf1c4-device-dir\") pod \"aws-ebs-csi-driver-node-8fbn5\" (UID: \"e91dc6e1-fda3-49e9-a972-392fad3bf1c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" May 21 20:20:55.550834 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550325 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-host-var-lib-kubelet\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.550834 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550349 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9cfae7f5-193d-448f-91d1-e9992e31ea60-host\") pod \"node-ca-ttlgr\" (UID: \"9cfae7f5-193d-448f-91d1-e9992e31ea60\") " pod="openshift-image-registry/node-ca-ttlgr" May 21 20:20:55.550834 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550363 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-multus-daemon-config\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.550834 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550372 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6243830-7e3d-49a1-bf9b-4ea34049b583-host-slash\") pod \"iptables-alerter-tzlp4\" (UID: \"b6243830-7e3d-49a1-bf9b-4ea34049b583\") " pod="openshift-network-operator/iptables-alerter-tzlp4" May 21 20:20:55.551776 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550425 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6243830-7e3d-49a1-bf9b-4ea34049b583-host-slash\") pod \"iptables-alerter-tzlp4\" (UID: \"b6243830-7e3d-49a1-bf9b-4ea34049b583\") " pod="openshift-network-operator/iptables-alerter-tzlp4" May 21 20:20:55.551776 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550467 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-cni-binary-copy\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.551776 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550473 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-host-var-lib-cni-bin\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.551776 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550521 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-host-var-lib-kubelet\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.551776 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550521 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-cnibin\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.551776 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550554 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9cfae7f5-193d-448f-91d1-e9992e31ea60-host\") pod \"node-ca-ttlgr\" (UID: \"9cfae7f5-193d-448f-91d1-e9992e31ea60\") " pod="openshift-image-registry/node-ca-ttlgr" May 21 20:20:55.551776 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550579 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e91dc6e1-fda3-49e9-a972-392fad3bf1c4-device-dir\") pod \"aws-ebs-csi-driver-node-8fbn5\" (UID: \"e91dc6e1-fda3-49e9-a972-392fad3bf1c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" May 21 20:20:55.551776 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550595 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-etc-kubernetes\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.551776 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550625 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-host-run-netns\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.551776 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550654 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-host-run-k8s-cni-cncf-io\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.551776 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550688 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/61df691b-d720-4813-9647-631228bc7521-ovnkube-script-lib\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.551776 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550712 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-host-var-lib-cni-multus\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.551776 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550750 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-host-var-lib-cni-multus\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.551776 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550691 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-host-run-k8s-cni-cncf-io\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.551776 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550740 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-multus-conf-dir\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.551776 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550792 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/61df691b-d720-4813-9647-631228bc7521-env-overrides\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.551776 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550796 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2203055e-7913-47ff-8c77-bed42b5caf84-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6q9zf\" (UID: \"2203055e-7913-47ff-8c77-bed42b5caf84\") " pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.551776 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550692 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-host-run-netns\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.552985 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550834 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-multus-conf-dir\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.552985 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550927 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2203055e-7913-47ff-8c77-bed42b5caf84-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6q9zf\" (UID: \"2203055e-7913-47ff-8c77-bed42b5caf84\") " pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.552985 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550834 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9cfae7f5-193d-448f-91d1-e9992e31ea60-serviceca\") pod \"node-ca-ttlgr\" (UID: \"9cfae7f5-193d-448f-91d1-e9992e31ea60\") " pod="openshift-image-registry/node-ca-ttlgr" May 21 20:20:55.552985 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550966 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rgjkt\" (UniqueName: \"kubernetes.io/projected/b6243830-7e3d-49a1-bf9b-4ea34049b583-kube-api-access-rgjkt\") pod \"iptables-alerter-tzlp4\" (UID: \"b6243830-7e3d-49a1-bf9b-4ea34049b583\") " pod="openshift-network-operator/iptables-alerter-tzlp4" May 21 20:20:55.552985 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550845 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2203055e-7913-47ff-8c77-bed42b5caf84-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6q9zf\" (UID: \"2203055e-7913-47ff-8c77-bed42b5caf84\") " pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.552985 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.550991 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-run-ovn\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.552985 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551017 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-node-log\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.552985 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551105 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-host-run-ovn-kubernetes\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.552985 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551109 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-run-ovn\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.552985 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551132 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/61df691b-d720-4813-9647-631228bc7521-ovn-node-metrics-cert\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.552985 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551135 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-node-log\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.552985 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551149 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-host-run-ovn-kubernetes\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.552985 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551156 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-etc-sysconfig\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.552985 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551182 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2203055e-7913-47ff-8c77-bed42b5caf84-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6q9zf\" (UID: \"2203055e-7913-47ff-8c77-bed42b5caf84\") " pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.552985 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551187 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9cfae7f5-193d-448f-91d1-e9992e31ea60-serviceca\") pod \"node-ca-ttlgr\" (UID: \"9cfae7f5-193d-448f-91d1-e9992e31ea60\") " pod="openshift-image-registry/node-ca-ttlgr" May 21 20:20:55.552985 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551193 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-etc-sysconfig\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.552985 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551208 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-host-cni-netd\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.553864 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551232 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-run\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.553864 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551247 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m4tgp\" (UniqueName: \"kubernetes.io/projected/90550377-b48a-478e-a7fd-ad307fd58da9-kube-api-access-m4tgp\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.553864 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551262 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-host-slash\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.553864 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551285 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-multus-cni-dir\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.553864 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551307 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-metrics-certs\") pod \"network-metrics-daemon-5nnzg\" (UID: \"f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2\") " pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:20:55.553864 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551310 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-run\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.553864 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551318 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-host-slash\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.553864 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551333 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2203055e-7913-47ff-8c77-bed42b5caf84-system-cni-dir\") pod \"multus-additional-cni-plugins-6q9zf\" (UID: \"2203055e-7913-47ff-8c77-bed42b5caf84\") " pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.553864 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551362 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2203055e-7913-47ff-8c77-bed42b5caf84-cnibin\") pod \"multus-additional-cni-plugins-6q9zf\" (UID: \"2203055e-7913-47ff-8c77-bed42b5caf84\") " pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.553864 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551371 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-host-cni-netd\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.553864 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551382 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-multus-cni-dir\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.553864 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551386 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-host-cni-bin\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.553864 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551417 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-host-run-multus-certs\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.553864 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551419 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2203055e-7913-47ff-8c77-bed42b5caf84-cnibin\") pod \"multus-additional-cni-plugins-6q9zf\" (UID: \"2203055e-7913-47ff-8c77-bed42b5caf84\") " pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.553864 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551451 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qxh8n\" (UniqueName: \"kubernetes.io/projected/2203055e-7913-47ff-8c77-bed42b5caf84-kube-api-access-qxh8n\") pod \"multus-additional-cni-plugins-6q9zf\" (UID: \"2203055e-7913-47ff-8c77-bed42b5caf84\") " pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.553864 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551415 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2203055e-7913-47ff-8c77-bed42b5caf84-system-cni-dir\") pod \"multus-additional-cni-plugins-6q9zf\" (UID: \"2203055e-7913-47ff-8c77-bed42b5caf84\") " pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.553864 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551468 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-host-cni-bin\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.553864 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551479 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90550377-b48a-478e-a7fd-ad307fd58da9-tmp\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.554469 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551499 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-host-run-multus-certs\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.554469 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551553 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vdhsg\" (UniqueName: \"kubernetes.io/projected/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-kube-api-access-vdhsg\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.554469 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551594 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1df76140-3e4f-445a-b48c-c6bc241b8a58-agent-certs\") pod \"konnectivity-agent-jfg8z\" (UID: \"1df76140-3e4f-445a-b48c-c6bc241b8a58\") " pod="kube-system/konnectivity-agent-jfg8z" May 21 20:20:55.554469 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551596 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2203055e-7913-47ff-8c77-bed42b5caf84-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6q9zf\" (UID: \"2203055e-7913-47ff-8c77-bed42b5caf84\") " pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.554469 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551619 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2203055e-7913-47ff-8c77-bed42b5caf84-os-release\") pod \"multus-additional-cni-plugins-6q9zf\" (UID: \"2203055e-7913-47ff-8c77-bed42b5caf84\") " pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.554469 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:55.551626 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:20:55.554469 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551642 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-log-socket\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.554469 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551668 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/61df691b-d720-4813-9647-631228bc7521-ovnkube-config\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.554469 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551695 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-plhbh\" (UniqueName: \"kubernetes.io/projected/e91dc6e1-fda3-49e9-a972-392fad3bf1c4-kube-api-access-plhbh\") pod \"aws-ebs-csi-driver-node-8fbn5\" (UID: \"e91dc6e1-fda3-49e9-a972-392fad3bf1c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" May 21 20:20:55.554469 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551726 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-lib-modules\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.554469 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551751 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-var-lib-kubelet\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.554469 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.551776 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2203055e-7913-47ff-8c77-bed42b5caf84-cni-binary-copy\") pod \"multus-additional-cni-plugins-6q9zf\" (UID: \"2203055e-7913-47ff-8c77-bed42b5caf84\") " pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.554469 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:55.551803 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-metrics-certs podName:f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2 nodeName:}" failed. No retries permitted until 2026-05-21 20:20:56.051771627 +0000 UTC m=+2.050160588 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-metrics-certs") pod "network-metrics-daemon-5nnzg" (UID: "f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:20:55.554469 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552114 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2203055e-7913-47ff-8c77-bed42b5caf84-os-release\") pod \"multus-additional-cni-plugins-6q9zf\" (UID: \"2203055e-7913-47ff-8c77-bed42b5caf84\") " pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.554469 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552201 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/61df691b-d720-4813-9647-631228bc7521-ovnkube-config\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.554469 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552201 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2203055e-7913-47ff-8c77-bed42b5caf84-cni-binary-copy\") pod \"multus-additional-cni-plugins-6q9zf\" (UID: \"2203055e-7913-47ff-8c77-bed42b5caf84\") " pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.554469 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552245 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-var-lib-kubelet\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.554969 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552265 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-log-socket\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.554969 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552215 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-lib-modules\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.554969 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552362 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4g9dv\" (UniqueName: \"kubernetes.io/projected/61df691b-d720-4813-9647-631228bc7521-kube-api-access-4g9dv\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.554969 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552431 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e91dc6e1-fda3-49e9-a972-392fad3bf1c4-socket-dir\") pod \"aws-ebs-csi-driver-node-8fbn5\" (UID: \"e91dc6e1-fda3-49e9-a972-392fad3bf1c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" May 21 20:20:55.554969 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552484 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e91dc6e1-fda3-49e9-a972-392fad3bf1c4-etc-selinux\") pod \"aws-ebs-csi-driver-node-8fbn5\" (UID: \"e91dc6e1-fda3-49e9-a972-392fad3bf1c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" May 21 20:20:55.554969 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552534 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-sys\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.554969 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552577 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-hostroot\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.554969 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552604 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-host-kubelet\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.554969 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552626 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-sys\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.554969 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552635 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-hostroot\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.554969 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552647 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e91dc6e1-fda3-49e9-a972-392fad3bf1c4-registration-dir\") pod \"aws-ebs-csi-driver-node-8fbn5\" (UID: \"e91dc6e1-fda3-49e9-a972-392fad3bf1c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" May 21 20:20:55.554969 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552672 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-host-kubelet\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.554969 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552673 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-etc-kubernetes\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.554969 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552703 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-host-run-netns\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.554969 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552732 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e91dc6e1-fda3-49e9-a972-392fad3bf1c4-registration-dir\") pod \"aws-ebs-csi-driver-node-8fbn5\" (UID: \"e91dc6e1-fda3-49e9-a972-392fad3bf1c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" May 21 20:20:55.554969 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552734 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-etc-kubernetes\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.554969 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552732 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b6243830-7e3d-49a1-bf9b-4ea34049b583-iptables-alerter-script\") pod \"iptables-alerter-tzlp4\" (UID: \"b6243830-7e3d-49a1-bf9b-4ea34049b583\") " pod="openshift-network-operator/iptables-alerter-tzlp4" May 21 20:20:55.554969 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552770 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-host-run-netns\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.555521 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552814 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-os-release\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.555521 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552850 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6mds\" (UniqueName: \"kubernetes.io/projected/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-kube-api-access-w6mds\") pod \"network-metrics-daemon-5nnzg\" (UID: \"f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2\") " pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:20:55.555521 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552870 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-os-release\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.555521 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552918 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z7kxh\" (UniqueName: \"kubernetes.io/projected/9cfae7f5-193d-448f-91d1-e9992e31ea60-kube-api-access-z7kxh\") pod \"node-ca-ttlgr\" (UID: \"9cfae7f5-193d-448f-91d1-e9992e31ea60\") " pod="openshift-image-registry/node-ca-ttlgr" May 21 20:20:55.555521 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552944 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rxvn\" (UniqueName: \"kubernetes.io/projected/ecaedb39-3cf7-450d-8e42-f508c68a92b8-kube-api-access-7rxvn\") pod \"network-check-target-h9lxq\" (UID: \"ecaedb39-3cf7-450d-8e42-f508c68a92b8\") " pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:20:55.555521 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552966 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-host\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.555521 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.552989 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1df76140-3e4f-445a-b48c-c6bc241b8a58-konnectivity-ca\") pod \"konnectivity-agent-jfg8z\" (UID: \"1df76140-3e4f-445a-b48c-c6bc241b8a58\") " pod="kube-system/konnectivity-agent-jfg8z" May 21 20:20:55.555521 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.553017 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-systemd-units\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.555521 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.553047 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-var-lib-openvswitch\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.555521 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.553127 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-var-lib-openvswitch\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.555521 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.553176 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90550377-b48a-478e-a7fd-ad307fd58da9-host\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.555521 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.553237 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/61df691b-d720-4813-9647-631228bc7521-systemd-units\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.555521 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.553295 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e91dc6e1-fda3-49e9-a972-392fad3bf1c4-etc-selinux\") pod \"aws-ebs-csi-driver-node-8fbn5\" (UID: \"e91dc6e1-fda3-49e9-a972-392fad3bf1c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" May 21 20:20:55.555521 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.553411 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b6243830-7e3d-49a1-bf9b-4ea34049b583-iptables-alerter-script\") pod \"iptables-alerter-tzlp4\" (UID: \"b6243830-7e3d-49a1-bf9b-4ea34049b583\") " pod="openshift-network-operator/iptables-alerter-tzlp4" May 21 20:20:55.555521 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.553441 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e91dc6e1-fda3-49e9-a972-392fad3bf1c4-socket-dir\") pod \"aws-ebs-csi-driver-node-8fbn5\" (UID: \"e91dc6e1-fda3-49e9-a972-392fad3bf1c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" May 21 20:20:55.555521 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.553571 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/90550377-b48a-478e-a7fd-ad307fd58da9-etc-tuned\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.555521 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.553678 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1df76140-3e4f-445a-b48c-c6bc241b8a58-konnectivity-ca\") pod \"konnectivity-agent-jfg8z\" (UID: \"1df76140-3e4f-445a-b48c-c6bc241b8a58\") " pod="kube-system/konnectivity-agent-jfg8z" May 21 20:20:55.555970 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.553907 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/61df691b-d720-4813-9647-631228bc7521-ovn-node-metrics-cert\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.555970 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.554117 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90550377-b48a-478e-a7fd-ad307fd58da9-tmp\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.555970 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.554270 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1df76140-3e4f-445a-b48c-c6bc241b8a58-agent-certs\") pod \"konnectivity-agent-jfg8z\" (UID: \"1df76140-3e4f-445a-b48c-c6bc241b8a58\") " pod="kube-system/konnectivity-agent-jfg8z" May 21 20:20:55.559949 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.559912 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxh8n\" (UniqueName: \"kubernetes.io/projected/2203055e-7913-47ff-8c77-bed42b5caf84-kube-api-access-qxh8n\") pod \"multus-additional-cni-plugins-6q9zf\" (UID: \"2203055e-7913-47ff-8c77-bed42b5caf84\") " pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.560792 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.560772 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgjkt\" (UniqueName: \"kubernetes.io/projected/b6243830-7e3d-49a1-bf9b-4ea34049b583-kube-api-access-rgjkt\") pod \"iptables-alerter-tzlp4\" (UID: \"b6243830-7e3d-49a1-bf9b-4ea34049b583\") " pod="openshift-network-operator/iptables-alerter-tzlp4" May 21 20:20:55.560869 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.560790 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdhsg\" (UniqueName: \"kubernetes.io/projected/54d14f03-ea58-4ea8-ade6-0bc0f72b254a-kube-api-access-vdhsg\") pod \"multus-j7565\" (UID: \"54d14f03-ea58-4ea8-ade6-0bc0f72b254a\") " pod="openshift-multus/multus-j7565" May 21 20:20:55.561617 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.561591 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4tgp\" (UniqueName: \"kubernetes.io/projected/90550377-b48a-478e-a7fd-ad307fd58da9-kube-api-access-m4tgp\") pod \"tuned-drlv6\" (UID: \"90550377-b48a-478e-a7fd-ad307fd58da9\") " pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.563711 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:55.563600 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:20:55.563711 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:55.563623 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:20:55.563711 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:55.563638 2559 projected.go:194] Error preparing data for projected volume kube-api-access-7rxvn for pod openshift-network-diagnostics/network-check-target-h9lxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:20:55.563711 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.563656 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plhbh\" (UniqueName: \"kubernetes.io/projected/e91dc6e1-fda3-49e9-a972-392fad3bf1c4-kube-api-access-plhbh\") pod \"aws-ebs-csi-driver-node-8fbn5\" (UID: \"e91dc6e1-fda3-49e9-a972-392fad3bf1c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" May 21 20:20:55.563711 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:55.563695 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecaedb39-3cf7-450d-8e42-f508c68a92b8-kube-api-access-7rxvn podName:ecaedb39-3cf7-450d-8e42-f508c68a92b8 nodeName:}" failed. No retries permitted until 2026-05-21 20:20:56.063675429 +0000 UTC m=+2.062064390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7rxvn" (UniqueName: "kubernetes.io/projected/ecaedb39-3cf7-450d-8e42-f508c68a92b8-kube-api-access-7rxvn") pod "network-check-target-h9lxq" (UID: "ecaedb39-3cf7-450d-8e42-f508c68a92b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:20:55.564807 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.564770 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g9dv\" (UniqueName: \"kubernetes.io/projected/61df691b-d720-4813-9647-631228bc7521-kube-api-access-4g9dv\") pod \"ovnkube-node-6tkgs\" (UID: \"61df691b-d720-4813-9647-631228bc7521\") " pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.565787 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.565771 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7kxh\" (UniqueName: \"kubernetes.io/projected/9cfae7f5-193d-448f-91d1-e9992e31ea60-kube-api-access-z7kxh\") pod \"node-ca-ttlgr\" (UID: \"9cfae7f5-193d-448f-91d1-e9992e31ea60\") " pod="openshift-image-registry/node-ca-ttlgr" May 21 20:20:55.566097 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.566034 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6mds\" (UniqueName: \"kubernetes.io/projected/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-kube-api-access-w6mds\") pod \"network-metrics-daemon-5nnzg\" (UID: \"f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2\") " pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:20:55.574945 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.574892 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-40.ec2.internal" event={"ID":"2b239f9058f74be02d04b5869d9c34b4","Type":"ContainerStarted","Data":"67a65f9865a82e90645eede97530361c9d22736a00aeb73de90e2ffd43461747"} May 21 20:20:55.575827 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.575809 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-40.ec2.internal" event={"ID":"737f2ee8a38127b7d0bda2823f387f82","Type":"ContainerStarted","Data":"a9cad9f432bb0530ce2ab89f84296a269ee1cff38e1aca6f14b0dcd61cd12106"} May 21 20:20:55.602671 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.602656 2559 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:20:55.766073 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.765983 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:20:55.773622 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:55.773600 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61df691b_d720_4813_9647_631228bc7521.slice/crio-a1b7f935f9baa1595aa5232700bf7b7cd70815e5fcb2db57924a42547a9d848a WatchSource:0}: Error finding container a1b7f935f9baa1595aa5232700bf7b7cd70815e5fcb2db57924a42547a9d848a: Status 404 returned error can't find the container with id a1b7f935f9baa1595aa5232700bf7b7cd70815e5fcb2db57924a42547a9d848a May 21 20:20:55.784092 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.784069 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jfg8z" May 21 20:20:55.790703 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:55.790680 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1df76140_3e4f_445a_b48c_c6bc241b8a58.slice/crio-a1dcf5aacd8c7bac36570ed778f49523b5a46934c74997e89b86b76895574d3e WatchSource:0}: Error finding container a1dcf5aacd8c7bac36570ed778f49523b5a46934c74997e89b86b76895574d3e: Status 404 returned error can't find the container with id a1dcf5aacd8c7bac36570ed778f49523b5a46934c74997e89b86b76895574d3e May 21 20:20:55.792972 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.792945 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" May 21 20:20:55.797970 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.797952 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-drlv6" May 21 20:20:55.798741 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:55.798720 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode91dc6e1_fda3_49e9_a972_392fad3bf1c4.slice/crio-476c24bcaae00916c15c30839ba5dd0c3c7b12942745c5687df8d708ddefcef1 WatchSource:0}: Error finding container 476c24bcaae00916c15c30839ba5dd0c3c7b12942745c5687df8d708ddefcef1: Status 404 returned error can't find the container with id 476c24bcaae00916c15c30839ba5dd0c3c7b12942745c5687df8d708ddefcef1 May 21 20:20:55.803804 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.803772 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6q9zf" May 21 20:20:55.807672 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:55.807654 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90550377_b48a_478e_a7fd_ad307fd58da9.slice/crio-192c20f013a319273eae59985763c0ec3c00f568762bd2f6b686d45c1eba97b7 WatchSource:0}: Error finding container 192c20f013a319273eae59985763c0ec3c00f568762bd2f6b686d45c1eba97b7: Status 404 returned error can't find the container with id 192c20f013a319273eae59985763c0ec3c00f568762bd2f6b686d45c1eba97b7 May 21 20:20:55.808795 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.808779 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j7565" May 21 20:20:55.810893 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:55.810879 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2203055e_7913_47ff_8c77_bed42b5caf84.slice/crio-b0267095bdc8c95917934d738976f5da1587a34bf8fdc5acdb334b430b682560 WatchSource:0}: Error finding container b0267095bdc8c95917934d738976f5da1587a34bf8fdc5acdb334b430b682560: Status 404 returned error can't find the container with id b0267095bdc8c95917934d738976f5da1587a34bf8fdc5acdb334b430b682560 May 21 20:20:55.814971 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.814951 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ttlgr" May 21 20:20:55.815758 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:55.815739 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d14f03_ea58_4ea8_ade6_0bc0f72b254a.slice/crio-307e930c9d6f360cbb8277ea181993268bf77e7624da87adda2dc5d22f100d16 WatchSource:0}: Error finding container 307e930c9d6f360cbb8277ea181993268bf77e7624da87adda2dc5d22f100d16: Status 404 returned error can't find the container with id 307e930c9d6f360cbb8277ea181993268bf77e7624da87adda2dc5d22f100d16 May 21 20:20:55.818972 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:55.818951 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tzlp4" May 21 20:20:55.821216 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:55.821189 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cfae7f5_193d_448f_91d1_e9992e31ea60.slice/crio-a5d81d8eafd560494a62790bae619143c25ad7b30517eb4a01cb7eefef069d56 WatchSource:0}: Error finding container a5d81d8eafd560494a62790bae619143c25ad7b30517eb4a01cb7eefef069d56: Status 404 returned error can't find the container with id a5d81d8eafd560494a62790bae619143c25ad7b30517eb4a01cb7eefef069d56 May 21 20:20:55.825725 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:20:55.825707 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6243830_7e3d_49a1_bf9b_4ea34049b583.slice/crio-fb550cc1ca94e4970acf1b60a0265b3dc55530f5057a807156f1c978c5818875 WatchSource:0}: Error finding container fb550cc1ca94e4970acf1b60a0265b3dc55530f5057a807156f1c978c5818875: Status 404 returned error can't find the container with id fb550cc1ca94e4970acf1b60a0265b3dc55530f5057a807156f1c978c5818875 May 21 20:20:56.057697 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:56.057604 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-metrics-certs\") pod \"network-metrics-daemon-5nnzg\" (UID: \"f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2\") " pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:20:56.057844 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:56.057727 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:20:56.057844 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:56.057805 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-metrics-certs podName:f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2 nodeName:}" failed. No retries permitted until 2026-05-21 20:20:57.057783555 +0000 UTC m=+3.056172531 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-metrics-certs") pod "network-metrics-daemon-5nnzg" (UID: "f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:20:56.158881 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:56.158845 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rxvn\" (UniqueName: \"kubernetes.io/projected/ecaedb39-3cf7-450d-8e42-f508c68a92b8-kube-api-access-7rxvn\") pod \"network-check-target-h9lxq\" (UID: \"ecaedb39-3cf7-450d-8e42-f508c68a92b8\") " pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:20:56.159085 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:56.158996 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:20:56.159085 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:56.159015 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:20:56.159085 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:56.159029 2559 projected.go:194] Error preparing data for projected volume kube-api-access-7rxvn for pod openshift-network-diagnostics/network-check-target-h9lxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:20:56.159250 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:56.159106 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecaedb39-3cf7-450d-8e42-f508c68a92b8-kube-api-access-7rxvn podName:ecaedb39-3cf7-450d-8e42-f508c68a92b8 nodeName:}" failed. No retries permitted until 2026-05-21 20:20:57.159086826 +0000 UTC m=+3.157475790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7rxvn" (UniqueName: "kubernetes.io/projected/ecaedb39-3cf7-450d-8e42-f508c68a92b8-kube-api-access-7rxvn") pod "network-check-target-h9lxq" (UID: "ecaedb39-3cf7-450d-8e42-f508c68a92b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:20:56.481592 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:56.481453 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 20:15:55 +0000 UTC" deadline="2028-01-17 04:37:46.92670539 +0000 UTC" May 21 20:20:56.481592 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:56.481496 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14528h16m50.445212799s" May 21 20:20:56.541294 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:56.541085 2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:20:56.587180 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:56.587142 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tzlp4" event={"ID":"b6243830-7e3d-49a1-bf9b-4ea34049b583","Type":"ContainerStarted","Data":"fb550cc1ca94e4970acf1b60a0265b3dc55530f5057a807156f1c978c5818875"} May 21 20:20:56.594547 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:56.594394 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j7565" event={"ID":"54d14f03-ea58-4ea8-ade6-0bc0f72b254a","Type":"ContainerStarted","Data":"307e930c9d6f360cbb8277ea181993268bf77e7624da87adda2dc5d22f100d16"} May 21 20:20:56.606283 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:56.606256 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-drlv6" event={"ID":"90550377-b48a-478e-a7fd-ad307fd58da9","Type":"ContainerStarted","Data":"192c20f013a319273eae59985763c0ec3c00f568762bd2f6b686d45c1eba97b7"} May 21 20:20:56.619830 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:56.619797 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" event={"ID":"61df691b-d720-4813-9647-631228bc7521","Type":"ContainerStarted","Data":"a1b7f935f9baa1595aa5232700bf7b7cd70815e5fcb2db57924a42547a9d848a"} May 21 20:20:56.630817 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:56.630786 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ttlgr" event={"ID":"9cfae7f5-193d-448f-91d1-e9992e31ea60","Type":"ContainerStarted","Data":"a5d81d8eafd560494a62790bae619143c25ad7b30517eb4a01cb7eefef069d56"} May 21 20:20:56.632379 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:56.632352 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q9zf" event={"ID":"2203055e-7913-47ff-8c77-bed42b5caf84","Type":"ContainerStarted","Data":"b0267095bdc8c95917934d738976f5da1587a34bf8fdc5acdb334b430b682560"} May 21 20:20:56.634948 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:56.634922 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" event={"ID":"e91dc6e1-fda3-49e9-a972-392fad3bf1c4","Type":"ContainerStarted","Data":"476c24bcaae00916c15c30839ba5dd0c3c7b12942745c5687df8d708ddefcef1"} May 21 20:20:56.641445 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:56.641421 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jfg8z" event={"ID":"1df76140-3e4f-445a-b48c-c6bc241b8a58","Type":"ContainerStarted","Data":"a1dcf5aacd8c7bac36570ed778f49523b5a46934c74997e89b86b76895574d3e"} May 21 20:20:56.827822 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:56.827744 2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:20:57.069154 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:57.069122 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-metrics-certs\") pod \"network-metrics-daemon-5nnzg\" (UID: \"f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2\") " pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:20:57.069320 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:57.069308 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:20:57.069395 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:57.069371 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-metrics-certs podName:f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2 nodeName:}" failed. No retries permitted until 2026-05-21 20:20:59.069353308 +0000 UTC m=+5.067742274 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-metrics-certs") pod "network-metrics-daemon-5nnzg" (UID: "f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:20:57.170829 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:57.170138 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rxvn\" (UniqueName: \"kubernetes.io/projected/ecaedb39-3cf7-450d-8e42-f508c68a92b8-kube-api-access-7rxvn\") pod \"network-check-target-h9lxq\" (UID: \"ecaedb39-3cf7-450d-8e42-f508c68a92b8\") " pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:20:57.170829 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:57.170327 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:20:57.170829 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:57.170360 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:20:57.170829 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:57.170384 2559 projected.go:194] Error preparing data for projected volume kube-api-access-7rxvn for pod openshift-network-diagnostics/network-check-target-h9lxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:20:57.170829 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:57.170442 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecaedb39-3cf7-450d-8e42-f508c68a92b8-kube-api-access-7rxvn podName:ecaedb39-3cf7-450d-8e42-f508c68a92b8 nodeName:}" failed. No retries permitted until 2026-05-21 20:20:59.170423994 +0000 UTC m=+5.168812968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7rxvn" (UniqueName: "kubernetes.io/projected/ecaedb39-3cf7-450d-8e42-f508c68a92b8-kube-api-access-7rxvn") pod "network-check-target-h9lxq" (UID: "ecaedb39-3cf7-450d-8e42-f508c68a92b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:20:57.482255 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:57.482121 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 20:15:55 +0000 UTC" deadline="2027-11-29 14:18:45.773238929 +0000 UTC" May 21 20:20:57.482255 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:57.482161 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13361h57m48.291081402s" May 21 20:20:57.572372 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:57.571628 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:20:57.572372 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:57.571750 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9lxq" podUID="ecaedb39-3cf7-450d-8e42-f508c68a92b8" May 21 20:20:57.572372 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:57.572218 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:20:57.572372 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:57.572314 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nnzg" podUID="f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2" May 21 20:20:58.058899 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:58.058844 2559 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:20:59.085739 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:59.085708 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-metrics-certs\") pod \"network-metrics-daemon-5nnzg\" (UID: \"f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2\") " pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:20:59.086254 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:59.085875 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:20:59.086254 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:59.085939 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-metrics-certs podName:f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:03.085919868 +0000 UTC m=+9.084308829 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-metrics-certs") pod "network-metrics-daemon-5nnzg" (UID: "f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:20:59.187064 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:59.187002 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rxvn\" (UniqueName: \"kubernetes.io/projected/ecaedb39-3cf7-450d-8e42-f508c68a92b8-kube-api-access-7rxvn\") pod \"network-check-target-h9lxq\" (UID: \"ecaedb39-3cf7-450d-8e42-f508c68a92b8\") " pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:20:59.187244 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:59.187226 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:20:59.187244 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:59.187243 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:20:59.187351 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:59.187252 2559 projected.go:194] Error preparing data for projected volume kube-api-access-7rxvn for pod openshift-network-diagnostics/network-check-target-h9lxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:20:59.187351 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:59.187313 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecaedb39-3cf7-450d-8e42-f508c68a92b8-kube-api-access-7rxvn podName:ecaedb39-3cf7-450d-8e42-f508c68a92b8 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:03.187293628 +0000 UTC m=+9.185682611 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7rxvn" (UniqueName: "kubernetes.io/projected/ecaedb39-3cf7-450d-8e42-f508c68a92b8-kube-api-access-7rxvn") pod "network-check-target-h9lxq" (UID: "ecaedb39-3cf7-450d-8e42-f508c68a92b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:20:59.571304 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:59.571224 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:20:59.571304 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:20:59.571257 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:20:59.571498 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:59.571379 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nnzg" podUID="f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2" May 21 20:20:59.571817 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:20:59.571788 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9lxq" podUID="ecaedb39-3cf7-450d-8e42-f508c68a92b8" May 21 20:21:01.572359 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:01.571801 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:21:01.572359 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:01.571932 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nnzg" podUID="f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2" May 21 20:21:01.572359 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:01.571802 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:21:01.572359 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:01.572319 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9lxq" podUID="ecaedb39-3cf7-450d-8e42-f508c68a92b8" May 21 20:21:03.119669 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:03.119630 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-metrics-certs\") pod \"network-metrics-daemon-5nnzg\" (UID: \"f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2\") " pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:21:03.120073 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:03.119776 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:21:03.120073 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:03.119865 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-metrics-certs podName:f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:11.1198423 +0000 UTC m=+17.118231282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-metrics-certs") pod "network-metrics-daemon-5nnzg" (UID: "f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:21:03.220234 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:03.220196 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rxvn\" (UniqueName: \"kubernetes.io/projected/ecaedb39-3cf7-450d-8e42-f508c68a92b8-kube-api-access-7rxvn\") pod \"network-check-target-h9lxq\" (UID: \"ecaedb39-3cf7-450d-8e42-f508c68a92b8\") " pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:21:03.220392 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:03.220370 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:21:03.220392 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:03.220392 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:21:03.220532 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:03.220405 2559 projected.go:194] Error preparing data for projected volume kube-api-access-7rxvn for pod openshift-network-diagnostics/network-check-target-h9lxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:21:03.220532 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:03.220470 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecaedb39-3cf7-450d-8e42-f508c68a92b8-kube-api-access-7rxvn podName:ecaedb39-3cf7-450d-8e42-f508c68a92b8 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:11.22044972 +0000 UTC m=+17.218838684 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7rxvn" (UniqueName: "kubernetes.io/projected/ecaedb39-3cf7-450d-8e42-f508c68a92b8-kube-api-access-7rxvn") pod "network-check-target-h9lxq" (UID: "ecaedb39-3cf7-450d-8e42-f508c68a92b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:21:03.571762 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:03.571672 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:21:03.571918 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:03.571796 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9lxq" podUID="ecaedb39-3cf7-450d-8e42-f508c68a92b8" May 21 20:21:03.572362 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:03.572220 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:21:03.572362 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:03.572321 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nnzg" podUID="f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2" May 21 20:21:05.571830 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:05.571639 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:21:05.572264 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:05.571639 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:21:05.572264 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:05.571940 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nnzg" podUID="f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2" May 21 20:21:05.572264 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:05.572006 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9lxq" podUID="ecaedb39-3cf7-450d-8e42-f508c68a92b8" May 21 20:21:07.571471 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:07.571425 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:21:07.571908 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:07.571426 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:21:07.571908 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:07.571584 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nnzg" podUID="f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2" May 21 20:21:07.571908 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:07.571648 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9lxq" podUID="ecaedb39-3cf7-450d-8e42-f508c68a92b8" May 21 20:21:08.057124 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:08.057024 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-vgg7n"] May 21 20:21:08.085395 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:08.085356 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:08.085580 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:08.085465 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgg7n" podUID="9187c183-92eb-4a4e-a8d0-09537d81400c" May 21 20:21:08.160545 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:08.160498 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9187c183-92eb-4a4e-a8d0-09537d81400c-original-pull-secret\") pod \"global-pull-secret-syncer-vgg7n\" (UID: \"9187c183-92eb-4a4e-a8d0-09537d81400c\") " pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:08.160709 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:08.160549 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9187c183-92eb-4a4e-a8d0-09537d81400c-kubelet-config\") pod \"global-pull-secret-syncer-vgg7n\" (UID: \"9187c183-92eb-4a4e-a8d0-09537d81400c\") " pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:08.160709 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:08.160670 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9187c183-92eb-4a4e-a8d0-09537d81400c-dbus\") pod \"global-pull-secret-syncer-vgg7n\" (UID: \"9187c183-92eb-4a4e-a8d0-09537d81400c\") " pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:08.261795 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:08.261758 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9187c183-92eb-4a4e-a8d0-09537d81400c-original-pull-secret\") pod \"global-pull-secret-syncer-vgg7n\" (UID: \"9187c183-92eb-4a4e-a8d0-09537d81400c\") " pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:08.261795 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:08.261796 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9187c183-92eb-4a4e-a8d0-09537d81400c-kubelet-config\") pod \"global-pull-secret-syncer-vgg7n\" (UID: \"9187c183-92eb-4a4e-a8d0-09537d81400c\") " pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:08.262029 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:08.261830 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9187c183-92eb-4a4e-a8d0-09537d81400c-dbus\") pod \"global-pull-secret-syncer-vgg7n\" (UID: \"9187c183-92eb-4a4e-a8d0-09537d81400c\") " pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:08.262029 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:08.261910 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9187c183-92eb-4a4e-a8d0-09537d81400c-kubelet-config\") pod \"global-pull-secret-syncer-vgg7n\" (UID: \"9187c183-92eb-4a4e-a8d0-09537d81400c\") " pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:08.262029 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:08.261938 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 20:21:08.262029 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:08.261960 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9187c183-92eb-4a4e-a8d0-09537d81400c-dbus\") pod \"global-pull-secret-syncer-vgg7n\" (UID: \"9187c183-92eb-4a4e-a8d0-09537d81400c\") " pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:08.262029 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:08.262013 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9187c183-92eb-4a4e-a8d0-09537d81400c-original-pull-secret podName:9187c183-92eb-4a4e-a8d0-09537d81400c nodeName:}" failed. No retries permitted until 2026-05-21 20:21:08.761993364 +0000 UTC m=+14.760382342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9187c183-92eb-4a4e-a8d0-09537d81400c-original-pull-secret") pod "global-pull-secret-syncer-vgg7n" (UID: "9187c183-92eb-4a4e-a8d0-09537d81400c") : object "kube-system"/"original-pull-secret" not registered May 21 20:21:08.764863 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:08.764825 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9187c183-92eb-4a4e-a8d0-09537d81400c-original-pull-secret\") pod \"global-pull-secret-syncer-vgg7n\" (UID: \"9187c183-92eb-4a4e-a8d0-09537d81400c\") " pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:08.765335 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:08.764985 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 20:21:08.765335 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:08.765070 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9187c183-92eb-4a4e-a8d0-09537d81400c-original-pull-secret podName:9187c183-92eb-4a4e-a8d0-09537d81400c nodeName:}" failed. No retries permitted until 2026-05-21 20:21:09.765029024 +0000 UTC m=+15.763417997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9187c183-92eb-4a4e-a8d0-09537d81400c-original-pull-secret") pod "global-pull-secret-syncer-vgg7n" (UID: "9187c183-92eb-4a4e-a8d0-09537d81400c") : object "kube-system"/"original-pull-secret" not registered May 21 20:21:09.571213 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:09.571179 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:09.571213 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:09.571207 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:21:09.571213 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:09.571179 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:21:09.571769 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:09.571716 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nnzg" podUID="f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2" May 21 20:21:09.571913 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:09.571895 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9lxq" podUID="ecaedb39-3cf7-450d-8e42-f508c68a92b8" May 21 20:21:09.572452 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:09.572093 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgg7n" podUID="9187c183-92eb-4a4e-a8d0-09537d81400c" May 21 20:21:09.773154 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:09.773125 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9187c183-92eb-4a4e-a8d0-09537d81400c-original-pull-secret\") pod \"global-pull-secret-syncer-vgg7n\" (UID: \"9187c183-92eb-4a4e-a8d0-09537d81400c\") " pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:09.773417 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:09.773233 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 20:21:09.773417 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:09.773277 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9187c183-92eb-4a4e-a8d0-09537d81400c-original-pull-secret podName:9187c183-92eb-4a4e-a8d0-09537d81400c nodeName:}" failed. No retries permitted until 2026-05-21 20:21:11.773264407 +0000 UTC m=+17.771653373 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9187c183-92eb-4a4e-a8d0-09537d81400c-original-pull-secret") pod "global-pull-secret-syncer-vgg7n" (UID: "9187c183-92eb-4a4e-a8d0-09537d81400c") : object "kube-system"/"original-pull-secret" not registered May 21 20:21:10.890857 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:10.890819 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-f9rbz"] May 21 20:21:10.904140 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:10.904115 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f9rbz" May 21 20:21:10.906467 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:10.906443 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 20:21:10.906467 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:10.906460 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kgfkv\"" May 21 20:21:10.906651 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:10.906443 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 20:21:10.982332 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:10.982303 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e971a16c-8d63-4b87-b028-72941ca4388f-tmp-dir\") pod \"node-resolver-f9rbz\" (UID: \"e971a16c-8d63-4b87-b028-72941ca4388f\") " pod="openshift-dns/node-resolver-f9rbz" May 21 20:21:10.982525 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:10.982353 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e971a16c-8d63-4b87-b028-72941ca4388f-hosts-file\") pod \"node-resolver-f9rbz\" (UID: \"e971a16c-8d63-4b87-b028-72941ca4388f\") " pod="openshift-dns/node-resolver-f9rbz" May 21 20:21:10.982525 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:10.982371 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bwtp\" (UniqueName: \"kubernetes.io/projected/e971a16c-8d63-4b87-b028-72941ca4388f-kube-api-access-7bwtp\") pod \"node-resolver-f9rbz\" (UID: \"e971a16c-8d63-4b87-b028-72941ca4388f\") " pod="openshift-dns/node-resolver-f9rbz" May 21 20:21:11.083812 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:11.083777 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e971a16c-8d63-4b87-b028-72941ca4388f-tmp-dir\") pod \"node-resolver-f9rbz\" (UID: \"e971a16c-8d63-4b87-b028-72941ca4388f\") " pod="openshift-dns/node-resolver-f9rbz" May 21 20:21:11.083951 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:11.083834 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e971a16c-8d63-4b87-b028-72941ca4388f-hosts-file\") pod \"node-resolver-f9rbz\" (UID: \"e971a16c-8d63-4b87-b028-72941ca4388f\") " pod="openshift-dns/node-resolver-f9rbz" May 21 20:21:11.083951 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:11.083863 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7bwtp\" (UniqueName: \"kubernetes.io/projected/e971a16c-8d63-4b87-b028-72941ca4388f-kube-api-access-7bwtp\") pod \"node-resolver-f9rbz\" (UID: \"e971a16c-8d63-4b87-b028-72941ca4388f\") " pod="openshift-dns/node-resolver-f9rbz" May 21 20:21:11.084081 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:11.083980 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e971a16c-8d63-4b87-b028-72941ca4388f-hosts-file\") pod \"node-resolver-f9rbz\" (UID: \"e971a16c-8d63-4b87-b028-72941ca4388f\") " pod="openshift-dns/node-resolver-f9rbz" May 21 20:21:11.084173 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:11.084158 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e971a16c-8d63-4b87-b028-72941ca4388f-tmp-dir\") pod \"node-resolver-f9rbz\" (UID: \"e971a16c-8d63-4b87-b028-72941ca4388f\") " pod="openshift-dns/node-resolver-f9rbz" May 21 20:21:11.092352 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:11.092326 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bwtp\" (UniqueName: \"kubernetes.io/projected/e971a16c-8d63-4b87-b028-72941ca4388f-kube-api-access-7bwtp\") pod \"node-resolver-f9rbz\" (UID: \"e971a16c-8d63-4b87-b028-72941ca4388f\") " pod="openshift-dns/node-resolver-f9rbz" May 21 20:21:11.184522 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:11.184446 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-metrics-certs\") pod \"network-metrics-daemon-5nnzg\" (UID: \"f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2\") " pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:21:11.184675 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:11.184618 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:21:11.184742 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:11.184690 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-metrics-certs podName:f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:27.184669849 +0000 UTC m=+33.183058824 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-metrics-certs") pod "network-metrics-daemon-5nnzg" (UID: "f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:21:11.214291 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:11.214265 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f9rbz" May 21 20:21:11.285495 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:11.285463 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rxvn\" (UniqueName: \"kubernetes.io/projected/ecaedb39-3cf7-450d-8e42-f508c68a92b8-kube-api-access-7rxvn\") pod \"network-check-target-h9lxq\" (UID: \"ecaedb39-3cf7-450d-8e42-f508c68a92b8\") " pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:21:11.285636 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:11.285586 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:21:11.285636 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:11.285604 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:21:11.285636 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:11.285612 2559 projected.go:194] Error preparing data for projected volume kube-api-access-7rxvn for pod openshift-network-diagnostics/network-check-target-h9lxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:21:11.285840 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:11.285671 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecaedb39-3cf7-450d-8e42-f508c68a92b8-kube-api-access-7rxvn podName:ecaedb39-3cf7-450d-8e42-f508c68a92b8 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:27.285652044 +0000 UTC m=+33.284041022 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7rxvn" (UniqueName: "kubernetes.io/projected/ecaedb39-3cf7-450d-8e42-f508c68a92b8-kube-api-access-7rxvn") pod "network-check-target-h9lxq" (UID: "ecaedb39-3cf7-450d-8e42-f508c68a92b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:21:11.571472 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:11.571382 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:11.571472 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:11.571425 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:21:11.571687 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:11.571507 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgg7n" podUID="9187c183-92eb-4a4e-a8d0-09537d81400c" May 21 20:21:11.571687 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:11.571576 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:21:11.571687 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:11.571663 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nnzg" podUID="f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2" May 21 20:21:11.571815 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:11.571710 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9lxq" podUID="ecaedb39-3cf7-450d-8e42-f508c68a92b8" May 21 20:21:11.789570 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:11.789536 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9187c183-92eb-4a4e-a8d0-09537d81400c-original-pull-secret\") pod \"global-pull-secret-syncer-vgg7n\" (UID: \"9187c183-92eb-4a4e-a8d0-09537d81400c\") " pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:11.789745 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:11.789643 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 20:21:11.789745 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:11.789703 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9187c183-92eb-4a4e-a8d0-09537d81400c-original-pull-secret podName:9187c183-92eb-4a4e-a8d0-09537d81400c nodeName:}" failed. No retries permitted until 2026-05-21 20:21:15.789683282 +0000 UTC m=+21.788072250 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9187c183-92eb-4a4e-a8d0-09537d81400c-original-pull-secret") pod "global-pull-secret-syncer-vgg7n" (UID: "9187c183-92eb-4a4e-a8d0-09537d81400c") : object "kube-system"/"original-pull-secret" not registered May 21 20:21:13.571316 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:13.571283 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:21:13.571699 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:13.571323 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:13.571699 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:13.571413 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9lxq" podUID="ecaedb39-3cf7-450d-8e42-f508c68a92b8" May 21 20:21:13.571699 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:13.571468 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:21:13.571699 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:13.571561 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nnzg" podUID="f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2" May 21 20:21:13.571699 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:13.571653 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgg7n" podUID="9187c183-92eb-4a4e-a8d0-09537d81400c" May 21 20:21:14.673266 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:14.673237 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f9rbz" event={"ID":"e971a16c-8d63-4b87-b028-72941ca4388f","Type":"ContainerStarted","Data":"c50868ee8f67516211663262f08ddd63240aaf6642ce34a5bd146f8e53ea745b"} May 21 20:21:14.674972 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:14.674622 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-40.ec2.internal" event={"ID":"737f2ee8a38127b7d0bda2823f387f82","Type":"ContainerStarted","Data":"22a926615593d44e5243e3d456d68dffef3560c18998ef516716d96a9ec24a6a"} May 21 20:21:14.676551 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:14.676530 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j7565" event={"ID":"54d14f03-ea58-4ea8-ade6-0bc0f72b254a","Type":"ContainerStarted","Data":"7e7ca49a862e3ce82ae037c5403e0176ed900b821b6b8d8f421960746bc20e50"} May 21 20:21:14.679030 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:14.678998 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-drlv6" event={"ID":"90550377-b48a-478e-a7fd-ad307fd58da9","Type":"ContainerStarted","Data":"8ab8165b9153543a6dcd33b9b52ebf8293151ca87ad1590d9a489c7e7ca91fb4"} May 21 20:21:14.702173 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:14.702046 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-40.ec2.internal" podStartSLOduration=19.702032956 podStartE2EDuration="19.702032956s" podCreationTimestamp="2026-05-21 20:20:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:21:14.687331601 +0000 UTC m=+20.685720587" watchObservedRunningTime="2026-05-21 20:21:14.702032956 +0000 UTC m=+20.700421968" May 21 20:21:14.702291 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:14.702252 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-drlv6" podStartSLOduration=2.119835348 podStartE2EDuration="20.702244579s" podCreationTimestamp="2026-05-21 20:20:54 +0000 UTC" firstStartedPulling="2026-05-21 20:20:55.809480151 +0000 UTC m=+1.807869112" lastFinishedPulling="2026-05-21 20:21:14.391889372 +0000 UTC m=+20.390278343" observedRunningTime="2026-05-21 20:21:14.702202307 +0000 UTC m=+20.700591291" watchObservedRunningTime="2026-05-21 20:21:14.702244579 +0000 UTC m=+20.700633561" May 21 20:21:14.722323 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:14.722122 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-j7565" podStartSLOduration=2.11420728 podStartE2EDuration="20.722106967s" podCreationTimestamp="2026-05-21 20:20:54 +0000 UTC" firstStartedPulling="2026-05-21 20:20:55.817986586 +0000 UTC m=+1.816375547" lastFinishedPulling="2026-05-21 20:21:14.425886261 +0000 UTC m=+20.424275234" observedRunningTime="2026-05-21 20:21:14.7216052 +0000 UTC m=+20.719994184" watchObservedRunningTime="2026-05-21 20:21:14.722106967 +0000 UTC m=+20.720495949" May 21 20:21:15.572065 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:15.571867 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:15.572065 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:15.571869 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:21:15.572226 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:15.571869 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:21:15.572226 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:15.572137 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgg7n" podUID="9187c183-92eb-4a4e-a8d0-09537d81400c" May 21 20:21:15.572304 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:15.572220 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nnzg" podUID="f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2" May 21 20:21:15.572304 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:15.572284 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9lxq" podUID="ecaedb39-3cf7-450d-8e42-f508c68a92b8" May 21 20:21:15.681771 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:15.681692 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jfg8z" event={"ID":"1df76140-3e4f-445a-b48c-c6bc241b8a58","Type":"ContainerStarted","Data":"acc7ce2402d55539e8bb74e949bdc1def4b749b49157315fafd2f22e0c1bdca9"} May 21 20:21:15.683260 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:15.683236 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f9rbz" event={"ID":"e971a16c-8d63-4b87-b028-72941ca4388f","Type":"ContainerStarted","Data":"df95686e50d06cdf3a9ac42ac869f6d9877fd12a984d683680cff0c31b693262"} May 21 20:21:15.685227 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:15.685125 2559 generic.go:358] "Generic (PLEG): container finished" podID="2b239f9058f74be02d04b5869d9c34b4" containerID="3818bf960cfa01a252160e3e3f13a93458d7dade38822a8c8f22f2139a1b8b9a" exitCode=0 May 21 20:21:15.685338 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:15.685216 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-40.ec2.internal" event={"ID":"2b239f9058f74be02d04b5869d9c34b4","Type":"ContainerDied","Data":"3818bf960cfa01a252160e3e3f13a93458d7dade38822a8c8f22f2139a1b8b9a"} May 21 20:21:15.688172 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:15.688147 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" event={"ID":"61df691b-d720-4813-9647-631228bc7521","Type":"ContainerStarted","Data":"f1021d967b4dc8d1805f02b621a6fde499b15290333b02bd4ca15d4a10e9b6f6"} May 21 20:21:15.688257 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:15.688181 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" event={"ID":"61df691b-d720-4813-9647-631228bc7521","Type":"ContainerStarted","Data":"7977ab704c122d0e4efbb912491f52d480a6f60dbdc26b4f6d6e1d87b8f866e4"} May 21 20:21:15.688257 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:15.688195 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" event={"ID":"61df691b-d720-4813-9647-631228bc7521","Type":"ContainerStarted","Data":"136fdbb3afe4823e10c20859ce9b812045c5cd36a4f6a1efc56ffdcd6ff7a3e2"} May 21 20:21:15.688257 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:15.688208 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" event={"ID":"61df691b-d720-4813-9647-631228bc7521","Type":"ContainerStarted","Data":"db8a4ced99167cb02cbf9a6008c2f2f04d93b8bda7f980f26dad8cddc0e2aeb6"} May 21 20:21:15.688257 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:15.688220 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" event={"ID":"61df691b-d720-4813-9647-631228bc7521","Type":"ContainerStarted","Data":"c5a9f5ac4e820c605f272982e6e8ddee0d465ec7b0b19e5895ca3293d1be614e"} May 21 20:21:15.688257 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:15.688231 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" event={"ID":"61df691b-d720-4813-9647-631228bc7521","Type":"ContainerStarted","Data":"3a0cc957e9285a619bb9f054e77615ef6518f9ddd17fa8dab9e86aa020408864"} May 21 20:21:15.689451 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:15.689427 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ttlgr" event={"ID":"9cfae7f5-193d-448f-91d1-e9992e31ea60","Type":"ContainerStarted","Data":"798911a72106281476b7acedbb02873dcc59ab38304a4adc8fdbcc59e761455a"} May 21 20:21:15.690846 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:15.690825 2559 generic.go:358] "Generic (PLEG): container finished" podID="2203055e-7913-47ff-8c77-bed42b5caf84" containerID="db21436f39b387367992a3b5105f2f9a79d3cda624b858ba47057b9e5dcef97c" exitCode=0 May 21 20:21:15.690955 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:15.690883 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q9zf" event={"ID":"2203055e-7913-47ff-8c77-bed42b5caf84","Type":"ContainerDied","Data":"db21436f39b387367992a3b5105f2f9a79d3cda624b858ba47057b9e5dcef97c"} May 21 20:21:15.692258 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:15.692233 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" event={"ID":"e91dc6e1-fda3-49e9-a972-392fad3bf1c4","Type":"ContainerStarted","Data":"4ada9dc145a687e6476b72a0720aff9c1283817a54878fba9be7b0efe7bc25b6"} May 21 20:21:15.695409 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:15.695373 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jfg8z" podStartSLOduration=7.414019827 podStartE2EDuration="21.695362922s" podCreationTimestamp="2026-05-21 20:20:54 +0000 UTC" firstStartedPulling="2026-05-21 20:20:55.792677236 +0000 UTC m=+1.791066196" lastFinishedPulling="2026-05-21 20:21:10.074020327 +0000 UTC m=+16.072409291" observedRunningTime="2026-05-21 20:21:15.695094965 +0000 UTC m=+21.693483948" watchObservedRunningTime="2026-05-21 20:21:15.695362922 +0000 UTC m=+21.693751905" May 21 20:21:15.707910 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:15.707875 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-f9rbz" podStartSLOduration=5.7078558489999995 podStartE2EDuration="5.707855849s" podCreationTimestamp="2026-05-21 20:21:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:21:15.707505957 +0000 UTC m=+21.705894942" watchObservedRunningTime="2026-05-21 20:21:15.707855849 +0000 UTC m=+21.706244831" May 21 20:21:15.735264 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:15.735202 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ttlgr" podStartSLOduration=3.178696722 podStartE2EDuration="21.735188823s" podCreationTimestamp="2026-05-21 20:20:54 +0000 UTC" firstStartedPulling="2026-05-21 20:20:55.822541093 +0000 UTC m=+1.820930055" lastFinishedPulling="2026-05-21 20:21:14.379033189 +0000 UTC m=+20.377422156" observedRunningTime="2026-05-21 20:21:15.733433212 +0000 UTC m=+21.731822196" watchObservedRunningTime="2026-05-21 20:21:15.735188823 +0000 UTC m=+21.733577807" May 21 20:21:15.824997 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:15.824963 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9187c183-92eb-4a4e-a8d0-09537d81400c-original-pull-secret\") pod \"global-pull-secret-syncer-vgg7n\" (UID: \"9187c183-92eb-4a4e-a8d0-09537d81400c\") " pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:15.825344 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:15.825321 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 20:21:15.825444 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:15.825406 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9187c183-92eb-4a4e-a8d0-09537d81400c-original-pull-secret podName:9187c183-92eb-4a4e-a8d0-09537d81400c nodeName:}" failed. No retries permitted until 2026-05-21 20:21:23.825385728 +0000 UTC m=+29.823774705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9187c183-92eb-4a4e-a8d0-09537d81400c-original-pull-secret") pod "global-pull-secret-syncer-vgg7n" (UID: "9187c183-92eb-4a4e-a8d0-09537d81400c") : object "kube-system"/"original-pull-secret" not registered May 21 20:21:15.974605 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:15.974578 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 20:21:16.516758 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:16.516641 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T20:21:15.974600367Z","UUID":"c78b0c7f-82b3-4884-a438-a0ab574b0b56","Handler":null,"Name":"","Endpoint":""} May 21 20:21:16.518542 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:16.518519 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 20:21:16.518542 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:16.518546 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 20:21:16.696040 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:16.696003 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" event={"ID":"e91dc6e1-fda3-49e9-a972-392fad3bf1c4","Type":"ContainerStarted","Data":"feb270ea6d238e5152625c37b9a3f6a1ed4b5da0d9fabf2c0fd2c1cb9e24064c"} May 21 20:21:16.697889 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:16.697861 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-40.ec2.internal" event={"ID":"2b239f9058f74be02d04b5869d9c34b4","Type":"ContainerStarted","Data":"8bbb7902bbe8cd28d9cdb6f368e07f84c9ca9ac61165d61ce6654e2f1253aa98"} May 21 20:21:16.700211 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:16.699793 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tzlp4" event={"ID":"b6243830-7e3d-49a1-bf9b-4ea34049b583","Type":"ContainerStarted","Data":"558e443ec9fa4eda775f834fbec10a3c16fb103c0163777d2fbb835782e3c82b"} May 21 20:21:16.713244 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:16.713196 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-40.ec2.internal" podStartSLOduration=21.713179935 podStartE2EDuration="21.713179935s" podCreationTimestamp="2026-05-21 20:20:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:21:16.712835842 +0000 UTC m=+22.711224825" watchObservedRunningTime="2026-05-21 20:21:16.713179935 +0000 UTC m=+22.711568920" May 21 20:21:16.725825 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:16.725780 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tzlp4" podStartSLOduration=4.174135798 podStartE2EDuration="22.725767203s" podCreationTimestamp="2026-05-21 20:20:54 +0000 UTC" firstStartedPulling="2026-05-21 20:20:55.827400242 +0000 UTC m=+1.825789203" lastFinishedPulling="2026-05-21 20:21:14.379031633 +0000 UTC m=+20.377420608" observedRunningTime="2026-05-21 20:21:16.725284756 +0000 UTC m=+22.723673740" watchObservedRunningTime="2026-05-21 20:21:16.725767203 +0000 UTC m=+22.724156216" May 21 20:21:17.571553 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:17.571433 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:21:17.571709 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:17.571600 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nnzg" podUID="f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2" May 21 20:21:17.571709 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:17.571679 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:21:17.571868 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:17.571845 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9lxq" podUID="ecaedb39-3cf7-450d-8e42-f508c68a92b8" May 21 20:21:17.571927 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:17.571883 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:17.572036 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:17.571961 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgg7n" podUID="9187c183-92eb-4a4e-a8d0-09537d81400c" May 21 20:21:17.704977 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:17.704932 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" event={"ID":"61df691b-d720-4813-9647-631228bc7521","Type":"ContainerStarted","Data":"ca5e299b4b78f896f24679f32d74f5c5924ec1d83f3defd809e8d132fd0536b7"} May 21 20:21:17.706959 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:17.706919 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" event={"ID":"e91dc6e1-fda3-49e9-a972-392fad3bf1c4","Type":"ContainerStarted","Data":"ec21b2837f470ddda3656af913e9bb18b191fb664bd4f8ffa1d1a8a7a2618ac4"} May 21 20:21:17.722895 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:17.722849 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8fbn5" podStartSLOduration=2.752596003 podStartE2EDuration="23.722837402s" podCreationTimestamp="2026-05-21 20:20:54 +0000 UTC" firstStartedPulling="2026-05-21 20:20:55.804217264 +0000 UTC m=+1.802606226" lastFinishedPulling="2026-05-21 20:21:16.77445865 +0000 UTC m=+22.772847625" observedRunningTime="2026-05-21 20:21:17.722700571 +0000 UTC m=+23.721089555" watchObservedRunningTime="2026-05-21 20:21:17.722837402 +0000 UTC m=+23.721226384" May 21 20:21:19.040794 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:19.040762 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jfg8z" May 21 20:21:19.041471 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:19.041444 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jfg8z" May 21 20:21:19.572073 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:19.571871 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:21:19.572245 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:19.571931 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:19.572245 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:19.572167 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9lxq" podUID="ecaedb39-3cf7-450d-8e42-f508c68a92b8" May 21 20:21:19.572245 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:19.571953 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:21:19.572245 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:19.572220 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgg7n" podUID="9187c183-92eb-4a4e-a8d0-09537d81400c" May 21 20:21:19.572446 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:19.572286 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nnzg" podUID="f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2" May 21 20:21:19.711571 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:19.711493 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jfg8z" May 21 20:21:19.712039 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:19.712019 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jfg8z" May 21 20:21:20.715544 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:20.715317 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" event={"ID":"61df691b-d720-4813-9647-631228bc7521","Type":"ContainerStarted","Data":"895ccf78000e885c81ccaa258bba286ce350a91d9fd31de81cc3056205411040"} May 21 20:21:20.716377 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:20.716349 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:21:20.716489 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:20.716384 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:21:20.720597 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:20.720571 2559 generic.go:358] "Generic (PLEG): container finished" podID="2203055e-7913-47ff-8c77-bed42b5caf84" containerID="4202edebb07c41828341401533a211ae385eb524383d6495eec162a06388dc31" exitCode=0 May 21 20:21:20.720692 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:20.720650 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q9zf" event={"ID":"2203055e-7913-47ff-8c77-bed42b5caf84","Type":"ContainerDied","Data":"4202edebb07c41828341401533a211ae385eb524383d6495eec162a06388dc31"} May 21 20:21:20.733281 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:20.733263 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:21:20.741890 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:20.741853 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" podStartSLOduration=7.852908122 podStartE2EDuration="26.741843228s" podCreationTimestamp="2026-05-21 20:20:54 +0000 UTC" firstStartedPulling="2026-05-21 20:20:55.775217909 +0000 UTC m=+1.773606869" lastFinishedPulling="2026-05-21 20:21:14.664153009 +0000 UTC m=+20.662541975" observedRunningTime="2026-05-21 20:21:20.741481507 +0000 UTC m=+26.739870490" watchObservedRunningTime="2026-05-21 20:21:20.741843228 +0000 UTC m=+26.740232211" May 21 20:21:21.572280 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:21.572198 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:21:21.572422 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:21.572198 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:21.572422 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:21.572319 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9lxq" podUID="ecaedb39-3cf7-450d-8e42-f508c68a92b8" May 21 20:21:21.572422 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:21.572203 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:21:21.572574 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:21.572367 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgg7n" podUID="9187c183-92eb-4a4e-a8d0-09537d81400c" May 21 20:21:21.572574 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:21.572467 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nnzg" podUID="f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2" May 21 20:21:21.724814 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:21.724777 2559 generic.go:358] "Generic (PLEG): container finished" podID="2203055e-7913-47ff-8c77-bed42b5caf84" containerID="608361ac200dae5752174cd36d1f67b69fe572e59f2ed95b4f84d4f9adc63ece" exitCode=0 May 21 20:21:21.725282 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:21.724846 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q9zf" event={"ID":"2203055e-7913-47ff-8c77-bed42b5caf84","Type":"ContainerDied","Data":"608361ac200dae5752174cd36d1f67b69fe572e59f2ed95b4f84d4f9adc63ece"} May 21 20:21:21.726224 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:21.726168 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:21:21.743433 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:21.743414 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:21:21.979962 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:21.979916 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vgg7n"] May 21 20:21:21.980172 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:21.980094 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:21.980248 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:21.980179 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgg7n" podUID="9187c183-92eb-4a4e-a8d0-09537d81400c" May 21 20:21:21.980767 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:21.980739 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h9lxq"] May 21 20:21:21.980896 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:21.980845 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:21:21.980956 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:21.980935 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9lxq" podUID="ecaedb39-3cf7-450d-8e42-f508c68a92b8" May 21 20:21:21.981567 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:21.981541 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5nnzg"] May 21 20:21:21.981685 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:21.981651 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:21:21.981783 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:21.981761 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nnzg" podUID="f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2" May 21 20:21:22.728817 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:22.728780 2559 generic.go:358] "Generic (PLEG): container finished" podID="2203055e-7913-47ff-8c77-bed42b5caf84" containerID="843c29c1e7a97ff6ed2b398835a7f915c01d9b774a091a27001fe868bf9cd5a5" exitCode=0 May 21 20:21:22.729283 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:22.728859 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q9zf" event={"ID":"2203055e-7913-47ff-8c77-bed42b5caf84","Type":"ContainerDied","Data":"843c29c1e7a97ff6ed2b398835a7f915c01d9b774a091a27001fe868bf9cd5a5"} May 21 20:21:23.571609 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:23.571562 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:21:23.571609 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:23.571610 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:21:23.571811 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:23.571696 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9lxq" podUID="ecaedb39-3cf7-450d-8e42-f508c68a92b8" May 21 20:21:23.571811 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:23.571754 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nnzg" podUID="f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2" May 21 20:21:23.571811 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:23.571799 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:23.571944 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:23.571914 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgg7n" podUID="9187c183-92eb-4a4e-a8d0-09537d81400c" May 21 20:21:23.887872 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:23.887833 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9187c183-92eb-4a4e-a8d0-09537d81400c-original-pull-secret\") pod \"global-pull-secret-syncer-vgg7n\" (UID: \"9187c183-92eb-4a4e-a8d0-09537d81400c\") " pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:23.888341 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:23.887964 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 20:21:23.888341 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:23.888024 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9187c183-92eb-4a4e-a8d0-09537d81400c-original-pull-secret podName:9187c183-92eb-4a4e-a8d0-09537d81400c nodeName:}" failed. No retries permitted until 2026-05-21 20:21:39.888004327 +0000 UTC m=+45.886393300 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9187c183-92eb-4a4e-a8d0-09537d81400c-original-pull-secret") pod "global-pull-secret-syncer-vgg7n" (UID: "9187c183-92eb-4a4e-a8d0-09537d81400c") : object "kube-system"/"original-pull-secret" not registered May 21 20:21:25.571980 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:25.571941 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:21:25.571980 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:25.571967 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:25.571980 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:25.571982 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:21:25.572858 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:25.572097 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9lxq" podUID="ecaedb39-3cf7-450d-8e42-f508c68a92b8" May 21 20:21:25.572858 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:25.572209 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgg7n" podUID="9187c183-92eb-4a4e-a8d0-09537d81400c" May 21 20:21:25.572858 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:25.572289 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nnzg" podUID="f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2" May 21 20:21:27.215642 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.215405 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-metrics-certs\") pod \"network-metrics-daemon-5nnzg\" (UID: \"f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2\") " pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:21:27.216074 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:27.215571 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:21:27.216074 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:27.215772 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-metrics-certs podName:f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:59.215754944 +0000 UTC m=+65.214143908 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-metrics-certs") pod "network-metrics-daemon-5nnzg" (UID: "f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:21:27.316551 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.316511 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rxvn\" (UniqueName: \"kubernetes.io/projected/ecaedb39-3cf7-450d-8e42-f508c68a92b8-kube-api-access-7rxvn\") pod \"network-check-target-h9lxq\" (UID: \"ecaedb39-3cf7-450d-8e42-f508c68a92b8\") " pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:21:27.316746 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:27.316666 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:21:27.316746 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:27.316686 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:21:27.316746 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:27.316699 2559 projected.go:194] Error preparing data for projected volume kube-api-access-7rxvn for pod openshift-network-diagnostics/network-check-target-h9lxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:21:27.316910 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:27.316765 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecaedb39-3cf7-450d-8e42-f508c68a92b8-kube-api-access-7rxvn podName:ecaedb39-3cf7-450d-8e42-f508c68a92b8 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:59.316746523 +0000 UTC m=+65.315135491 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7rxvn" (UniqueName: "kubernetes.io/projected/ecaedb39-3cf7-450d-8e42-f508c68a92b8-kube-api-access-7rxvn") pod "network-check-target-h9lxq" (UID: "ecaedb39-3cf7-450d-8e42-f508c68a92b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:21:27.336211 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.336180 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-40.ec2.internal" event="NodeReady" May 21 20:21:27.336380 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.336342 2559 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 20:21:27.371508 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.371476 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5fb495b879-l5sq8"] May 21 20:21:27.401381 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.401270 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vrb96"] May 21 20:21:27.401569 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.401545 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:27.404084 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.403943 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rt4bw\"" May 21 20:21:27.404084 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.403944 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 20:21:27.404272 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.403947 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 20:21:27.409603 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.409578 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 20:21:27.413932 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.413909 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 20:21:27.418518 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.418488 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9ppsn"] May 21 20:21:27.419101 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.418676 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vrb96" May 21 20:21:27.420987 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.420968 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4t59k\"" May 21 20:21:27.420987 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.420983 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 20:21:27.421158 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.421015 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 20:21:27.421158 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.421045 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 20:21:27.435245 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.435216 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fb495b879-l5sq8"] May 21 20:21:27.435245 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.435244 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vrb96"] May 21 20:21:27.435410 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.435253 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9ppsn"] May 21 20:21:27.435410 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.435323 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9ppsn" May 21 20:21:27.437883 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.437863 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 20:21:27.438210 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.438197 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 20:21:27.438300 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.438209 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h49gp\"" May 21 20:21:27.517812 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.517771 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-certificates\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:27.517997 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.517827 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20ec65f6-efea-4276-8673-ccdec1229094-cert\") pod \"ingress-canary-vrb96\" (UID: \"20ec65f6-efea-4276-8673-ccdec1229094\") " pod="openshift-ingress-canary/ingress-canary-vrb96" May 21 20:21:27.517997 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.517899 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-image-registry-private-configuration\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:27.517997 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.517937 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-trusted-ca\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:27.517997 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.517962 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5n85\" (UniqueName: \"kubernetes.io/projected/20ec65f6-efea-4276-8673-ccdec1229094-kube-api-access-r5n85\") pod \"ingress-canary-vrb96\" (UID: \"20ec65f6-efea-4276-8673-ccdec1229094\") " pod="openshift-ingress-canary/ingress-canary-vrb96" May 21 20:21:27.517997 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.517992 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f451aeb-9e99-470f-9f53-635e5e4bea18-metrics-tls\") pod \"dns-default-9ppsn\" (UID: \"8f451aeb-9e99-470f-9f53-635e5e4bea18\") " pod="openshift-dns/dns-default-9ppsn" May 21 20:21:27.518225 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.518030 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-ca-trust-extracted\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:27.518225 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.518076 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-686xt\" (UniqueName: \"kubernetes.io/projected/8f451aeb-9e99-470f-9f53-635e5e4bea18-kube-api-access-686xt\") pod \"dns-default-9ppsn\" (UID: \"8f451aeb-9e99-470f-9f53-635e5e4bea18\") " pod="openshift-dns/dns-default-9ppsn" May 21 20:21:27.518225 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.518115 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-installation-pull-secrets\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:27.518225 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.518191 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-tls\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:27.518225 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.518216 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8f451aeb-9e99-470f-9f53-635e5e4bea18-config-volume\") pod \"dns-default-9ppsn\" (UID: \"8f451aeb-9e99-470f-9f53-635e5e4bea18\") " pod="openshift-dns/dns-default-9ppsn" May 21 20:21:27.518473 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.518258 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-bound-sa-token\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:27.518473 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.518284 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k29kn\" (UniqueName: \"kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-kube-api-access-k29kn\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:27.518473 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.518306 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f451aeb-9e99-470f-9f53-635e5e4bea18-tmp-dir\") pod \"dns-default-9ppsn\" (UID: \"8f451aeb-9e99-470f-9f53-635e5e4bea18\") " pod="openshift-dns/dns-default-9ppsn" May 21 20:21:27.572233 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.572198 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:27.572233 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.572219 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:21:27.572483 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.572309 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:21:27.575130 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.575038 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 20:21:27.575130 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.575124 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kwprk\"" May 21 20:21:27.575314 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.575136 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 20:21:27.575314 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.575075 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 20:21:27.575314 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.575213 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-stvkr\"" May 21 20:21:27.575464 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.575430 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 20:21:27.619636 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.619596 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-bound-sa-token\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:27.619636 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.619641 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k29kn\" (UniqueName: \"kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-kube-api-access-k29kn\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:27.619874 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.619666 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f451aeb-9e99-470f-9f53-635e5e4bea18-tmp-dir\") pod \"dns-default-9ppsn\" (UID: \"8f451aeb-9e99-470f-9f53-635e5e4bea18\") " pod="openshift-dns/dns-default-9ppsn" May 21 20:21:27.619874 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.619722 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-certificates\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:27.619874 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.619745 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20ec65f6-efea-4276-8673-ccdec1229094-cert\") pod \"ingress-canary-vrb96\" (UID: \"20ec65f6-efea-4276-8673-ccdec1229094\") " pod="openshift-ingress-canary/ingress-canary-vrb96" May 21 20:21:27.619874 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.619775 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-image-registry-private-configuration\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:27.619874 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.619810 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-trusted-ca\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:27.619874 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.619834 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5n85\" (UniqueName: \"kubernetes.io/projected/20ec65f6-efea-4276-8673-ccdec1229094-kube-api-access-r5n85\") pod \"ingress-canary-vrb96\" (UID: \"20ec65f6-efea-4276-8673-ccdec1229094\") " pod="openshift-ingress-canary/ingress-canary-vrb96" May 21 20:21:27.619874 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.619859 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f451aeb-9e99-470f-9f53-635e5e4bea18-metrics-tls\") pod \"dns-default-9ppsn\" (UID: \"8f451aeb-9e99-470f-9f53-635e5e4bea18\") " pod="openshift-dns/dns-default-9ppsn" May 21 20:21:27.620243 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.619900 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-ca-trust-extracted\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:27.620243 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.619931 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-686xt\" (UniqueName: \"kubernetes.io/projected/8f451aeb-9e99-470f-9f53-635e5e4bea18-kube-api-access-686xt\") pod \"dns-default-9ppsn\" (UID: \"8f451aeb-9e99-470f-9f53-635e5e4bea18\") " pod="openshift-dns/dns-default-9ppsn" May 21 20:21:27.620243 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:27.619943 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:21:27.620243 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.619972 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-installation-pull-secrets\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:27.620243 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.620004 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-tls\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:27.620243 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:27.620044 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20ec65f6-efea-4276-8673-ccdec1229094-cert podName:20ec65f6-efea-4276-8673-ccdec1229094 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:28.120017008 +0000 UTC m=+34.118405975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/20ec65f6-efea-4276-8673-ccdec1229094-cert") pod "ingress-canary-vrb96" (UID: "20ec65f6-efea-4276-8673-ccdec1229094") : secret "canary-serving-cert" not found May 21 20:21:27.620243 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:27.620098 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:21:27.620243 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:27.620126 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:21:27.620243 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:27.620141 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fb495b879-l5sq8: secret "image-registry-tls" not found May 21 20:21:27.620243 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:27.620174 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f451aeb-9e99-470f-9f53-635e5e4bea18-metrics-tls podName:8f451aeb-9e99-470f-9f53-635e5e4bea18 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:28.120154793 +0000 UTC m=+34.118543755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8f451aeb-9e99-470f-9f53-635e5e4bea18-metrics-tls") pod "dns-default-9ppsn" (UID: "8f451aeb-9e99-470f-9f53-635e5e4bea18") : secret "dns-default-metrics-tls" not found May 21 20:21:27.620243 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:27.620192 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-tls podName:5907ffb2-76c1-4579-8f6c-827c5ba1a39d nodeName:}" failed. No retries permitted until 2026-05-21 20:21:28.120183663 +0000 UTC m=+34.118572625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-tls") pod "image-registry-5fb495b879-l5sq8" (UID: "5907ffb2-76c1-4579-8f6c-827c5ba1a39d") : secret "image-registry-tls" not found May 21 20:21:27.620758 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.620566 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-ca-trust-extracted\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:27.620758 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.620568 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f451aeb-9e99-470f-9f53-635e5e4bea18-tmp-dir\") pod \"dns-default-9ppsn\" (UID: \"8f451aeb-9e99-470f-9f53-635e5e4bea18\") " pod="openshift-dns/dns-default-9ppsn" May 21 20:21:27.620758 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.620619 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8f451aeb-9e99-470f-9f53-635e5e4bea18-config-volume\") pod \"dns-default-9ppsn\" (UID: \"8f451aeb-9e99-470f-9f53-635e5e4bea18\") " pod="openshift-dns/dns-default-9ppsn" May 21 20:21:27.621118 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.621098 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8f451aeb-9e99-470f-9f53-635e5e4bea18-config-volume\") pod \"dns-default-9ppsn\" (UID: \"8f451aeb-9e99-470f-9f53-635e5e4bea18\") " pod="openshift-dns/dns-default-9ppsn" May 21 20:21:27.621118 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.621105 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-certificates\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:27.621403 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.621380 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-trusted-ca\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:27.624939 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.624917 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-installation-pull-secrets\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:27.625086 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.625003 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-image-registry-private-configuration\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:27.629204 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.629160 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k29kn\" (UniqueName: \"kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-kube-api-access-k29kn\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:27.629513 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.629488 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-bound-sa-token\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:27.629707 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.629683 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-686xt\" (UniqueName: \"kubernetes.io/projected/8f451aeb-9e99-470f-9f53-635e5e4bea18-kube-api-access-686xt\") pod \"dns-default-9ppsn\" (UID: \"8f451aeb-9e99-470f-9f53-635e5e4bea18\") " pod="openshift-dns/dns-default-9ppsn" May 21 20:21:27.630162 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:27.630124 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5n85\" (UniqueName: \"kubernetes.io/projected/20ec65f6-efea-4276-8673-ccdec1229094-kube-api-access-r5n85\") pod \"ingress-canary-vrb96\" (UID: \"20ec65f6-efea-4276-8673-ccdec1229094\") " pod="openshift-ingress-canary/ingress-canary-vrb96" May 21 20:21:28.124647 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:28.124305 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20ec65f6-efea-4276-8673-ccdec1229094-cert\") pod \"ingress-canary-vrb96\" (UID: \"20ec65f6-efea-4276-8673-ccdec1229094\") " pod="openshift-ingress-canary/ingress-canary-vrb96" May 21 20:21:28.124647 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:28.124383 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f451aeb-9e99-470f-9f53-635e5e4bea18-metrics-tls\") pod \"dns-default-9ppsn\" (UID: \"8f451aeb-9e99-470f-9f53-635e5e4bea18\") " pod="openshift-dns/dns-default-9ppsn" May 21 20:21:28.124647 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:28.124443 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-tls\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:28.124647 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:28.124486 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:21:28.124647 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:28.124548 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:21:28.124647 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:28.124561 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20ec65f6-efea-4276-8673-ccdec1229094-cert podName:20ec65f6-efea-4276-8673-ccdec1229094 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:29.124540381 +0000 UTC m=+35.122929346 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/20ec65f6-efea-4276-8673-ccdec1229094-cert") pod "ingress-canary-vrb96" (UID: "20ec65f6-efea-4276-8673-ccdec1229094") : secret "canary-serving-cert" not found May 21 20:21:28.124647 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:28.124563 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fb495b879-l5sq8: secret "image-registry-tls" not found May 21 20:21:28.124647 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:28.124492 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:21:28.124647 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:28.124617 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-tls podName:5907ffb2-76c1-4579-8f6c-827c5ba1a39d nodeName:}" failed. No retries permitted until 2026-05-21 20:21:29.124601958 +0000 UTC m=+35.122990919 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-tls") pod "image-registry-5fb495b879-l5sq8" (UID: "5907ffb2-76c1-4579-8f6c-827c5ba1a39d") : secret "image-registry-tls" not found May 21 20:21:28.124647 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:28.124642 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f451aeb-9e99-470f-9f53-635e5e4bea18-metrics-tls podName:8f451aeb-9e99-470f-9f53-635e5e4bea18 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:29.124624412 +0000 UTC m=+35.123013373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8f451aeb-9e99-470f-9f53-635e5e4bea18-metrics-tls") pod "dns-default-9ppsn" (UID: "8f451aeb-9e99-470f-9f53-635e5e4bea18") : secret "dns-default-metrics-tls" not found May 21 20:21:28.743279 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:28.743243 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q9zf" event={"ID":"2203055e-7913-47ff-8c77-bed42b5caf84","Type":"ContainerStarted","Data":"677bd156cd3ee12c5dc9213297ca2645fef90c59fef5f3a168294bcdd8923e67"} May 21 20:21:29.132157 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:29.132117 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20ec65f6-efea-4276-8673-ccdec1229094-cert\") pod \"ingress-canary-vrb96\" (UID: \"20ec65f6-efea-4276-8673-ccdec1229094\") " pod="openshift-ingress-canary/ingress-canary-vrb96" May 21 20:21:29.132356 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:29.132171 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f451aeb-9e99-470f-9f53-635e5e4bea18-metrics-tls\") pod \"dns-default-9ppsn\" (UID: \"8f451aeb-9e99-470f-9f53-635e5e4bea18\") " pod="openshift-dns/dns-default-9ppsn" May 21 20:21:29.132356 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:29.132212 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-tls\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:29.132356 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:29.132303 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:21:29.132356 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:29.132337 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:21:29.132480 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:29.132368 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20ec65f6-efea-4276-8673-ccdec1229094-cert podName:20ec65f6-efea-4276-8673-ccdec1229094 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:31.132351265 +0000 UTC m=+37.130740226 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/20ec65f6-efea-4276-8673-ccdec1229094-cert") pod "ingress-canary-vrb96" (UID: "20ec65f6-efea-4276-8673-ccdec1229094") : secret "canary-serving-cert" not found May 21 20:21:29.132480 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:29.132310 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:21:29.132480 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:29.132401 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fb495b879-l5sq8: secret "image-registry-tls" not found May 21 20:21:29.132480 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:29.132421 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f451aeb-9e99-470f-9f53-635e5e4bea18-metrics-tls podName:8f451aeb-9e99-470f-9f53-635e5e4bea18 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:31.132406811 +0000 UTC m=+37.130795772 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8f451aeb-9e99-470f-9f53-635e5e4bea18-metrics-tls") pod "dns-default-9ppsn" (UID: "8f451aeb-9e99-470f-9f53-635e5e4bea18") : secret "dns-default-metrics-tls" not found May 21 20:21:29.132480 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:29.132441 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-tls podName:5907ffb2-76c1-4579-8f6c-827c5ba1a39d nodeName:}" failed. No retries permitted until 2026-05-21 20:21:31.132428698 +0000 UTC m=+37.130817660 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-tls") pod "image-registry-5fb495b879-l5sq8" (UID: "5907ffb2-76c1-4579-8f6c-827c5ba1a39d") : secret "image-registry-tls" not found May 21 20:21:29.661231 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:29.661199 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-4p6rn"] May 21 20:21:29.682297 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:29.682264 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-4p6rn"] May 21 20:21:29.682455 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:29.682314 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-4p6rn" May 21 20:21:29.684624 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:29.684601 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 21 20:21:29.684744 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:29.684721 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 21 20:21:29.685735 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:29.685715 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-cvd6g\"" May 21 20:21:29.685830 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:29.685744 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 21 20:21:29.685830 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:29.685746 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 21 20:21:29.747563 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:29.747527 2559 generic.go:358] "Generic (PLEG): container finished" podID="2203055e-7913-47ff-8c77-bed42b5caf84" containerID="677bd156cd3ee12c5dc9213297ca2645fef90c59fef5f3a168294bcdd8923e67" exitCode=0 May 21 20:21:29.748013 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:29.747587 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q9zf" event={"ID":"2203055e-7913-47ff-8c77-bed42b5caf84","Type":"ContainerDied","Data":"677bd156cd3ee12c5dc9213297ca2645fef90c59fef5f3a168294bcdd8923e67"} May 21 20:21:29.839013 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:29.838982 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhz2d\" (UniqueName: \"kubernetes.io/projected/674b697f-a655-4c8d-9852-578e77984b56-kube-api-access-nhz2d\") pod \"service-ca-67d667c7d-4p6rn\" (UID: \"674b697f-a655-4c8d-9852-578e77984b56\") " pod="openshift-service-ca/service-ca-67d667c7d-4p6rn" May 21 20:21:29.839286 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:29.839267 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/674b697f-a655-4c8d-9852-578e77984b56-signing-cabundle\") pod \"service-ca-67d667c7d-4p6rn\" (UID: \"674b697f-a655-4c8d-9852-578e77984b56\") " pod="openshift-service-ca/service-ca-67d667c7d-4p6rn" May 21 20:21:29.839358 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:29.839304 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/674b697f-a655-4c8d-9852-578e77984b56-signing-key\") pod \"service-ca-67d667c7d-4p6rn\" (UID: \"674b697f-a655-4c8d-9852-578e77984b56\") " pod="openshift-service-ca/service-ca-67d667c7d-4p6rn" May 21 20:21:29.940716 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:29.940687 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhz2d\" (UniqueName: \"kubernetes.io/projected/674b697f-a655-4c8d-9852-578e77984b56-kube-api-access-nhz2d\") pod \"service-ca-67d667c7d-4p6rn\" (UID: \"674b697f-a655-4c8d-9852-578e77984b56\") " pod="openshift-service-ca/service-ca-67d667c7d-4p6rn" May 21 20:21:29.940831 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:29.940802 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/674b697f-a655-4c8d-9852-578e77984b56-signing-cabundle\") pod \"service-ca-67d667c7d-4p6rn\" (UID: \"674b697f-a655-4c8d-9852-578e77984b56\") " pod="openshift-service-ca/service-ca-67d667c7d-4p6rn" May 21 20:21:29.940870 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:29.940834 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/674b697f-a655-4c8d-9852-578e77984b56-signing-key\") pod \"service-ca-67d667c7d-4p6rn\" (UID: \"674b697f-a655-4c8d-9852-578e77984b56\") " pod="openshift-service-ca/service-ca-67d667c7d-4p6rn" May 21 20:21:29.941386 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:29.941366 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/674b697f-a655-4c8d-9852-578e77984b56-signing-cabundle\") pod \"service-ca-67d667c7d-4p6rn\" (UID: \"674b697f-a655-4c8d-9852-578e77984b56\") " pod="openshift-service-ca/service-ca-67d667c7d-4p6rn" May 21 20:21:29.943664 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:29.943644 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/674b697f-a655-4c8d-9852-578e77984b56-signing-key\") pod \"service-ca-67d667c7d-4p6rn\" (UID: \"674b697f-a655-4c8d-9852-578e77984b56\") " pod="openshift-service-ca/service-ca-67d667c7d-4p6rn" May 21 20:21:29.948673 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:29.948652 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhz2d\" (UniqueName: \"kubernetes.io/projected/674b697f-a655-4c8d-9852-578e77984b56-kube-api-access-nhz2d\") pod \"service-ca-67d667c7d-4p6rn\" (UID: \"674b697f-a655-4c8d-9852-578e77984b56\") " pod="openshift-service-ca/service-ca-67d667c7d-4p6rn" May 21 20:21:29.990754 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:29.990725 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-4p6rn" May 21 20:21:30.187672 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:30.187417 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-4p6rn"] May 21 20:21:30.191460 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:21:30.191426 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod674b697f_a655_4c8d_9852_578e77984b56.slice/crio-4e5c50e292534c4774cc165f2cee26b13bcd3880c153998fcaa129fcce678acc WatchSource:0}: Error finding container 4e5c50e292534c4774cc165f2cee26b13bcd3880c153998fcaa129fcce678acc: Status 404 returned error can't find the container with id 4e5c50e292534c4774cc165f2cee26b13bcd3880c153998fcaa129fcce678acc May 21 20:21:30.752883 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:30.752843 2559 generic.go:358] "Generic (PLEG): container finished" podID="2203055e-7913-47ff-8c77-bed42b5caf84" containerID="4fc158af50ab71a1681d8af50bc581558f84d30d4896edd024391adc124de0fd" exitCode=0 May 21 20:21:30.753427 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:30.752933 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q9zf" event={"ID":"2203055e-7913-47ff-8c77-bed42b5caf84","Type":"ContainerDied","Data":"4fc158af50ab71a1681d8af50bc581558f84d30d4896edd024391adc124de0fd"} May 21 20:21:30.754470 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:30.754448 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-4p6rn" event={"ID":"674b697f-a655-4c8d-9852-578e77984b56","Type":"ContainerStarted","Data":"4e5c50e292534c4774cc165f2cee26b13bcd3880c153998fcaa129fcce678acc"} May 21 20:21:31.149331 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:31.149300 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20ec65f6-efea-4276-8673-ccdec1229094-cert\") pod \"ingress-canary-vrb96\" (UID: \"20ec65f6-efea-4276-8673-ccdec1229094\") " pod="openshift-ingress-canary/ingress-canary-vrb96" May 21 20:21:31.149521 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:31.149356 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f451aeb-9e99-470f-9f53-635e5e4bea18-metrics-tls\") pod \"dns-default-9ppsn\" (UID: \"8f451aeb-9e99-470f-9f53-635e5e4bea18\") " pod="openshift-dns/dns-default-9ppsn" May 21 20:21:31.149521 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:31.149410 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-tls\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:31.149521 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:31.149480 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:21:31.149672 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:31.149531 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:21:31.149672 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:31.149545 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fb495b879-l5sq8: secret "image-registry-tls" not found May 21 20:21:31.149672 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:31.149566 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20ec65f6-efea-4276-8673-ccdec1229094-cert podName:20ec65f6-efea-4276-8673-ccdec1229094 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:35.14954359 +0000 UTC m=+41.147932554 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/20ec65f6-efea-4276-8673-ccdec1229094-cert") pod "ingress-canary-vrb96" (UID: "20ec65f6-efea-4276-8673-ccdec1229094") : secret "canary-serving-cert" not found May 21 20:21:31.149672 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:31.149483 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:21:31.149672 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:31.149594 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-tls podName:5907ffb2-76c1-4579-8f6c-827c5ba1a39d nodeName:}" failed. No retries permitted until 2026-05-21 20:21:35.149576687 +0000 UTC m=+41.147965662 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-tls") pod "image-registry-5fb495b879-l5sq8" (UID: "5907ffb2-76c1-4579-8f6c-827c5ba1a39d") : secret "image-registry-tls" not found May 21 20:21:31.149672 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:31.149654 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f451aeb-9e99-470f-9f53-635e5e4bea18-metrics-tls podName:8f451aeb-9e99-470f-9f53-635e5e4bea18 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:35.149633933 +0000 UTC m=+41.148022910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8f451aeb-9e99-470f-9f53-635e5e4bea18-metrics-tls") pod "dns-default-9ppsn" (UID: "8f451aeb-9e99-470f-9f53-635e5e4bea18") : secret "dns-default-metrics-tls" not found May 21 20:21:31.759885 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:31.759848 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q9zf" event={"ID":"2203055e-7913-47ff-8c77-bed42b5caf84","Type":"ContainerStarted","Data":"b2ecf261ab47125deb711125adb195e9af8bb7bc23ca3bcd0478f507910d50fb"} May 21 20:21:31.783727 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:31.783637 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6q9zf" podStartSLOduration=5.035869836 podStartE2EDuration="37.783624273s" podCreationTimestamp="2026-05-21 20:20:54 +0000 UTC" firstStartedPulling="2026-05-21 20:20:55.812616748 +0000 UTC m=+1.811005709" lastFinishedPulling="2026-05-21 20:21:28.560371176 +0000 UTC m=+34.558760146" observedRunningTime="2026-05-21 20:21:31.782334003 +0000 UTC m=+37.780723021" watchObservedRunningTime="2026-05-21 20:21:31.783624273 +0000 UTC m=+37.782013256" May 21 20:21:32.763710 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:32.763465 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-4p6rn" event={"ID":"674b697f-a655-4c8d-9852-578e77984b56","Type":"ContainerStarted","Data":"a40a975faf895c545273ec337e17e226f8e8f48823fa2be33b02db368b123eb5"} May 21 20:21:32.777949 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:32.777892 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-4p6rn" podStartSLOduration=1.536377206 podStartE2EDuration="3.77787363s" podCreationTimestamp="2026-05-21 20:21:29 +0000 UTC" firstStartedPulling="2026-05-21 20:21:30.193253022 +0000 UTC m=+36.191641988" lastFinishedPulling="2026-05-21 20:21:32.434749437 +0000 UTC m=+38.433138412" observedRunningTime="2026-05-21 20:21:32.777566187 +0000 UTC m=+38.775955165" watchObservedRunningTime="2026-05-21 20:21:32.77787363 +0000 UTC m=+38.776262616" May 21 20:21:35.181761 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:35.181716 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f451aeb-9e99-470f-9f53-635e5e4bea18-metrics-tls\") pod \"dns-default-9ppsn\" (UID: \"8f451aeb-9e99-470f-9f53-635e5e4bea18\") " pod="openshift-dns/dns-default-9ppsn" May 21 20:21:35.182215 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:35.181779 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-tls\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:35.182215 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:35.181827 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20ec65f6-efea-4276-8673-ccdec1229094-cert\") pod \"ingress-canary-vrb96\" (UID: \"20ec65f6-efea-4276-8673-ccdec1229094\") " pod="openshift-ingress-canary/ingress-canary-vrb96" May 21 20:21:35.182215 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:35.181876 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:21:35.182215 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:35.181912 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:21:35.182215 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:35.181933 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 20:21:35.182215 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:35.181944 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f451aeb-9e99-470f-9f53-635e5e4bea18-metrics-tls podName:8f451aeb-9e99-470f-9f53-635e5e4bea18 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:43.181928147 +0000 UTC m=+49.180317107 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8f451aeb-9e99-470f-9f53-635e5e4bea18-metrics-tls") pod "dns-default-9ppsn" (UID: "8f451aeb-9e99-470f-9f53-635e5e4bea18") : secret "dns-default-metrics-tls" not found May 21 20:21:35.182215 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:35.181955 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fb495b879-l5sq8: secret "image-registry-tls" not found May 21 20:21:35.182215 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:35.181961 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20ec65f6-efea-4276-8673-ccdec1229094-cert podName:20ec65f6-efea-4276-8673-ccdec1229094 nodeName:}" failed. No retries permitted until 2026-05-21 20:21:43.181954438 +0000 UTC m=+49.180343399 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/20ec65f6-efea-4276-8673-ccdec1229094-cert") pod "ingress-canary-vrb96" (UID: "20ec65f6-efea-4276-8673-ccdec1229094") : secret "canary-serving-cert" not found May 21 20:21:35.182215 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:21:35.182003 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-tls podName:5907ffb2-76c1-4579-8f6c-827c5ba1a39d nodeName:}" failed. No retries permitted until 2026-05-21 20:21:43.181984811 +0000 UTC m=+49.180373777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-tls") pod "image-registry-5fb495b879-l5sq8" (UID: "5907ffb2-76c1-4579-8f6c-827c5ba1a39d") : secret "image-registry-tls" not found May 21 20:21:39.920207 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:39.920176 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9187c183-92eb-4a4e-a8d0-09537d81400c-original-pull-secret\") pod \"global-pull-secret-syncer-vgg7n\" (UID: \"9187c183-92eb-4a4e-a8d0-09537d81400c\") " pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:39.924317 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:39.924291 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9187c183-92eb-4a4e-a8d0-09537d81400c-original-pull-secret\") pod \"global-pull-secret-syncer-vgg7n\" (UID: \"9187c183-92eb-4a4e-a8d0-09537d81400c\") " pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:40.184509 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:40.184425 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgg7n" May 21 20:21:40.304909 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:40.304880 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vgg7n"] May 21 20:21:40.307882 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:21:40.307851 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9187c183_92eb_4a4e_a8d0_09537d81400c.slice/crio-6cf29982ade0bc93b3cf6b5763efea3b0df4199eecef3b035a6e6e4b3da33ff5 WatchSource:0}: Error finding container 6cf29982ade0bc93b3cf6b5763efea3b0df4199eecef3b035a6e6e4b3da33ff5: Status 404 returned error can't find the container with id 6cf29982ade0bc93b3cf6b5763efea3b0df4199eecef3b035a6e6e4b3da33ff5 May 21 20:21:40.780595 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:40.780539 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vgg7n" event={"ID":"9187c183-92eb-4a4e-a8d0-09537d81400c","Type":"ContainerStarted","Data":"6cf29982ade0bc93b3cf6b5763efea3b0df4199eecef3b035a6e6e4b3da33ff5"} May 21 20:21:43.249561 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:43.249484 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20ec65f6-efea-4276-8673-ccdec1229094-cert\") pod \"ingress-canary-vrb96\" (UID: \"20ec65f6-efea-4276-8673-ccdec1229094\") " pod="openshift-ingress-canary/ingress-canary-vrb96" May 21 20:21:43.249561 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:43.249558 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f451aeb-9e99-470f-9f53-635e5e4bea18-metrics-tls\") pod \"dns-default-9ppsn\" (UID: \"8f451aeb-9e99-470f-9f53-635e5e4bea18\") " pod="openshift-dns/dns-default-9ppsn" May 21 20:21:43.250174 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:43.249613 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-tls\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:43.252559 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:43.252534 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-tls\") pod \"image-registry-5fb495b879-l5sq8\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:43.252668 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:43.252575 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f451aeb-9e99-470f-9f53-635e5e4bea18-metrics-tls\") pod \"dns-default-9ppsn\" (UID: \"8f451aeb-9e99-470f-9f53-635e5e4bea18\") " pod="openshift-dns/dns-default-9ppsn" May 21 20:21:43.252755 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:43.252730 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20ec65f6-efea-4276-8673-ccdec1229094-cert\") pod \"ingress-canary-vrb96\" (UID: \"20ec65f6-efea-4276-8673-ccdec1229094\") " pod="openshift-ingress-canary/ingress-canary-vrb96" May 21 20:21:43.319258 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:43.319225 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:43.329029 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:43.329000 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vrb96" May 21 20:21:43.344790 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:43.344762 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9ppsn" May 21 20:21:44.102572 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:44.102539 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9ppsn"] May 21 20:21:44.105763 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:21:44.105734 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f451aeb_9e99_470f_9f53_635e5e4bea18.slice/crio-05c8d4b3f71d36cdefa9296110de915dee9720cfdae5f99a0ef4a14c87d97e30 WatchSource:0}: Error finding container 05c8d4b3f71d36cdefa9296110de915dee9720cfdae5f99a0ef4a14c87d97e30: Status 404 returned error can't find the container with id 05c8d4b3f71d36cdefa9296110de915dee9720cfdae5f99a0ef4a14c87d97e30 May 21 20:21:44.327768 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:44.327740 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vrb96"] May 21 20:21:44.330948 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:44.330923 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fb495b879-l5sq8"] May 21 20:21:44.334152 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:21:44.334130 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ec65f6_efea_4276_8673_ccdec1229094.slice/crio-5dcb3cc96ab9a0c46ff93ecd8f06e8b9a713a4f0b77cbfe54ecdd7ff4be2b113 WatchSource:0}: Error finding container 5dcb3cc96ab9a0c46ff93ecd8f06e8b9a713a4f0b77cbfe54ecdd7ff4be2b113: Status 404 returned error can't find the container with id 5dcb3cc96ab9a0c46ff93ecd8f06e8b9a713a4f0b77cbfe54ecdd7ff4be2b113 May 21 20:21:44.334431 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:21:44.334404 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5907ffb2_76c1_4579_8f6c_827c5ba1a39d.slice/crio-3a67660549338aef6c410290d6e5b9731d949376722c99fd499d9c69942b521d WatchSource:0}: Error finding container 3a67660549338aef6c410290d6e5b9731d949376722c99fd499d9c69942b521d: Status 404 returned error can't find the container with id 3a67660549338aef6c410290d6e5b9731d949376722c99fd499d9c69942b521d May 21 20:21:44.792074 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:44.791371 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vrb96" event={"ID":"20ec65f6-efea-4276-8673-ccdec1229094","Type":"ContainerStarted","Data":"5dcb3cc96ab9a0c46ff93ecd8f06e8b9a713a4f0b77cbfe54ecdd7ff4be2b113"} May 21 20:21:44.793462 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:44.792982 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vgg7n" event={"ID":"9187c183-92eb-4a4e-a8d0-09537d81400c","Type":"ContainerStarted","Data":"16896258b279975d6526c736ff10809afa6252fabd822e580252dd19cd16f6f2"} May 21 20:21:44.794920 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:44.794890 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9ppsn" event={"ID":"8f451aeb-9e99-470f-9f53-635e5e4bea18","Type":"ContainerStarted","Data":"05c8d4b3f71d36cdefa9296110de915dee9720cfdae5f99a0ef4a14c87d97e30"} May 21 20:21:44.797162 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:44.797139 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" event={"ID":"5907ffb2-76c1-4579-8f6c-827c5ba1a39d","Type":"ContainerStarted","Data":"213f12eff051865942d6dd66fb75034a22ab1ebc5581be23c69582a2e3bb1ef5"} May 21 20:21:44.797269 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:44.797170 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" event={"ID":"5907ffb2-76c1-4579-8f6c-827c5ba1a39d","Type":"ContainerStarted","Data":"3a67660549338aef6c410290d6e5b9731d949376722c99fd499d9c69942b521d"} May 21 20:21:44.797722 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:44.797700 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:21:44.807154 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:44.807096 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vgg7n" podStartSLOduration=32.861472723 podStartE2EDuration="36.807081745s" podCreationTimestamp="2026-05-21 20:21:08 +0000 UTC" firstStartedPulling="2026-05-21 20:21:40.309702851 +0000 UTC m=+46.308091815" lastFinishedPulling="2026-05-21 20:21:44.255311862 +0000 UTC m=+50.253700837" observedRunningTime="2026-05-21 20:21:44.806125257 +0000 UTC m=+50.804514242" watchObservedRunningTime="2026-05-21 20:21:44.807081745 +0000 UTC m=+50.805470724" May 21 20:21:44.823009 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:44.822946 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" podStartSLOduration=57.822930439 podStartE2EDuration="57.822930439s" podCreationTimestamp="2026-05-21 20:20:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:21:44.822405829 +0000 UTC m=+50.820794812" watchObservedRunningTime="2026-05-21 20:21:44.822930439 +0000 UTC m=+50.821319422" May 21 20:21:46.802870 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:46.802836 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vrb96" event={"ID":"20ec65f6-efea-4276-8673-ccdec1229094","Type":"ContainerStarted","Data":"4319cac72dede60cba679e5af6647c9b4e773f47506ad632e8b6646942d541d0"} May 21 20:21:46.804393 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:46.804370 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9ppsn" event={"ID":"8f451aeb-9e99-470f-9f53-635e5e4bea18","Type":"ContainerStarted","Data":"0ad7526cb39afa4df2912de4a4ab3da8c1726887b6a3c1cd523e0d8cd259c8a3"} May 21 20:21:46.804393 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:46.804397 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9ppsn" event={"ID":"8f451aeb-9e99-470f-9f53-635e5e4bea18","Type":"ContainerStarted","Data":"94b88b92592c4dcdbb56e55c8607806296a2cf39f40f655d3f45ac52fcc44ecc"} May 21 20:21:46.819014 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:46.818976 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vrb96" podStartSLOduration=18.122144465 podStartE2EDuration="19.818963225s" podCreationTimestamp="2026-05-21 20:21:27 +0000 UTC" firstStartedPulling="2026-05-21 20:21:44.33628005 +0000 UTC m=+50.334669011" lastFinishedPulling="2026-05-21 20:21:46.033098796 +0000 UTC m=+52.031487771" observedRunningTime="2026-05-21 20:21:46.818830901 +0000 UTC m=+52.817219884" watchObservedRunningTime="2026-05-21 20:21:46.818963225 +0000 UTC m=+52.817352207" May 21 20:21:46.832806 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:46.832756 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-9ppsn" podStartSLOduration=17.908650194 podStartE2EDuration="19.83274392s" podCreationTimestamp="2026-05-21 20:21:27 +0000 UTC" firstStartedPulling="2026-05-21 20:21:44.107612628 +0000 UTC m=+50.106001590" lastFinishedPulling="2026-05-21 20:21:46.031706352 +0000 UTC m=+52.030095316" observedRunningTime="2026-05-21 20:21:46.832164024 +0000 UTC m=+52.830553032" watchObservedRunningTime="2026-05-21 20:21:46.83274392 +0000 UTC m=+52.831132902" May 21 20:21:47.806726 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:47.806690 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9ppsn" May 21 20:21:49.203671 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.203635 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5fb495b879-l5sq8"] May 21 20:21:49.211605 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.211571 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-dmbwc"] May 21 20:21:49.213632 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.213613 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-vxhvx"] May 21 20:21:49.213760 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.213745 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-dmbwc" May 21 20:21:49.215412 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.215395 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-vxhvx" May 21 20:21:49.215852 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.215832 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 21 20:21:49.216123 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.216103 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 21 20:21:49.216224 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.216198 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-4mf6j\"" May 21 20:21:49.217648 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.217631 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 21 20:21:49.217740 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.217661 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 21 20:21:49.217810 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.217761 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-w5hhk\"" May 21 20:21:49.217810 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.217782 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 21 20:21:49.222254 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.222235 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-dmbwc"] May 21 20:21:49.225767 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.225745 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-vxhvx"] May 21 20:21:49.296697 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.296661 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkxvj\" (UniqueName: \"kubernetes.io/projected/8da7802b-c3e2-4f39-b978-5a5f93f645de-kube-api-access-tkxvj\") pod \"cluster-samples-operator-697587599-vxhvx\" (UID: \"8da7802b-c3e2-4f39-b978-5a5f93f645de\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-vxhvx" May 21 20:21:49.296697 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.296701 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8da7802b-c3e2-4f39-b978-5a5f93f645de-samples-operator-tls\") pod \"cluster-samples-operator-697587599-vxhvx\" (UID: \"8da7802b-c3e2-4f39-b978-5a5f93f645de\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-vxhvx" May 21 20:21:49.296912 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.296747 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99ch2\" (UniqueName: \"kubernetes.io/projected/db5b79c9-f8b6-47eb-8fd9-7ff9f5e14753-kube-api-access-99ch2\") pod \"volume-data-source-validator-5cf8c89d64-dmbwc\" (UID: \"db5b79c9-f8b6-47eb-8fd9-7ff9f5e14753\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-dmbwc" May 21 20:21:49.303071 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.303034 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-zzz86"] May 21 20:21:49.304793 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.304774 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-zzz86" May 21 20:21:49.307038 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.307018 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 21 20:21:49.307146 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.307084 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jwzsv\"" May 21 20:21:49.307146 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.307108 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 20:21:49.307146 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.307114 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 21 20:21:49.307286 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.307087 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 20:21:49.311046 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.310771 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-8xms4"] May 21 20:21:49.312966 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.312949 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vn4g8"] May 21 20:21:49.313164 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.313148 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-8xms4" May 21 20:21:49.315354 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.313738 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 21 20:21:49.316793 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.316769 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-9k4hs"] May 21 20:21:49.317037 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.317021 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vn4g8" May 21 20:21:49.317485 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.317464 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 21 20:21:49.317674 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.317651 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 21 20:21:49.317792 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.317123 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 21 20:21:49.317843 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.317540 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-prxl6\"" May 21 20:21:49.318239 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.318219 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 21 20:21:49.319738 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.319719 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-576545cfb4-rlx4k"] May 21 20:21:49.319850 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.319836 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9k4hs" May 21 20:21:49.321455 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.321435 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 21 20:21:49.321580 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.321562 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-576545cfb4-rlx4k" May 21 20:21:49.321740 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.321722 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5s8gx\"" May 21 20:21:49.322372 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.322352 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 21 20:21:49.322484 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.322412 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 21 20:21:49.322635 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.322616 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-zzz86"] May 21 20:21:49.322776 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.322747 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 21 20:21:49.323007 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.322977 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xp92f\"" May 21 20:21:49.323680 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.323659 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 20:21:49.323813 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.323766 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 20:21:49.324073 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.324036 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 21 20:21:49.324146 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.324129 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 21 20:21:49.324228 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.324093 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 20:21:49.325429 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.325409 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 21 20:21:49.326000 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.325975 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 20:21:49.326269 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.326254 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 21 20:21:49.326450 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.326436 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 21 20:21:49.326564 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.326545 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 21 20:21:49.327097 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.327078 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-b4n6z\"" May 21 20:21:49.328277 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.328257 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 21 20:21:49.334387 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.334369 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vn4g8"] May 21 20:21:49.335639 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.335618 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-8xms4"] May 21 20:21:49.336742 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.336725 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-9k4hs"] May 21 20:21:49.337879 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.337856 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-576545cfb4-rlx4k"] May 21 20:21:49.397658 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.397628 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b6a24522-88a4-432c-97bb-f6f2083901fd-serving-cert\") pod \"console-operator-76dff48d59-8xms4\" (UID: \"b6a24522-88a4-432c-97bb-f6f2083901fd\") " pod="openshift-console-operator/console-operator-76dff48d59-8xms4" May 21 20:21:49.397658 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.397659 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feb4a481-c655-4be3-ae09-4f6c8277ca62-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-zzz86\" (UID: \"feb4a481-c655-4be3-ae09-4f6c8277ca62\") " pod="openshift-insights/insights-operator-78bdfb888c-zzz86" May 21 20:21:49.397852 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.397679 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b6a24522-88a4-432c-97bb-f6f2083901fd-config\") pod \"console-operator-76dff48d59-8xms4\" (UID: \"b6a24522-88a4-432c-97bb-f6f2083901fd\") " pod="openshift-console-operator/console-operator-76dff48d59-8xms4" May 21 20:21:49.397852 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.397696 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/724eb768-6856-4129-a9a0-a9d7fff49eb2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9k4hs\" (UID: \"724eb768-6856-4129-a9a0-a9d7fff49eb2\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9k4hs" May 21 20:21:49.397852 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.397723 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c39245e2-2433-4601-bf1b-443f5fd576e7-service-ca-bundle\") pod \"router-default-576545cfb4-rlx4k\" (UID: \"c39245e2-2433-4601-bf1b-443f5fd576e7\") " pod="openshift-ingress/router-default-576545cfb4-rlx4k" May 21 20:21:49.397852 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.397787 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/724eb768-6856-4129-a9a0-a9d7fff49eb2-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-9k4hs\" (UID: \"724eb768-6856-4129-a9a0-a9d7fff49eb2\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9k4hs" May 21 20:21:49.397852 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.397821 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6a24522-88a4-432c-97bb-f6f2083901fd-trusted-ca\") pod \"console-operator-76dff48d59-8xms4\" (UID: \"b6a24522-88a4-432c-97bb-f6f2083901fd\") " pod="openshift-console-operator/console-operator-76dff48d59-8xms4" May 21 20:21:49.397852 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.397845 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c39245e2-2433-4601-bf1b-443f5fd576e7-default-certificate\") pod \"router-default-576545cfb4-rlx4k\" (UID: \"c39245e2-2433-4601-bf1b-443f5fd576e7\") " pod="openshift-ingress/router-default-576545cfb4-rlx4k" May 21 20:21:49.398040 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.397896 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58270938-7043-423b-91cc-07aa70d5cb14-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-vn4g8\" (UID: \"58270938-7043-423b-91cc-07aa70d5cb14\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vn4g8" May 21 20:21:49.398040 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.397924 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8da7802b-c3e2-4f39-b978-5a5f93f645de-samples-operator-tls\") pod \"cluster-samples-operator-697587599-vxhvx\" (UID: \"8da7802b-c3e2-4f39-b978-5a5f93f645de\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-vxhvx" May 21 20:21:49.398040 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.397969 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2stf\" (UniqueName: \"kubernetes.io/projected/c39245e2-2433-4601-bf1b-443f5fd576e7-kube-api-access-l2stf\") pod \"router-default-576545cfb4-rlx4k\" (UID: \"c39245e2-2433-4601-bf1b-443f5fd576e7\") " pod="openshift-ingress/router-default-576545cfb4-rlx4k" May 21 20:21:49.398040 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.398029 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnwh9\" (UniqueName: \"kubernetes.io/projected/b6a24522-88a4-432c-97bb-f6f2083901fd-kube-api-access-cnwh9\") pod \"console-operator-76dff48d59-8xms4\" (UID: \"b6a24522-88a4-432c-97bb-f6f2083901fd\") " pod="openshift-console-operator/console-operator-76dff48d59-8xms4" May 21 20:21:49.398236 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.398080 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-99ch2\" (UniqueName: \"kubernetes.io/projected/db5b79c9-f8b6-47eb-8fd9-7ff9f5e14753-kube-api-access-99ch2\") pod \"volume-data-source-validator-5cf8c89d64-dmbwc\" (UID: \"db5b79c9-f8b6-47eb-8fd9-7ff9f5e14753\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-dmbwc" May 21 20:21:49.398236 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.398132 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feb4a481-c655-4be3-ae09-4f6c8277ca62-service-ca-bundle\") pod \"insights-operator-78bdfb888c-zzz86\" (UID: \"feb4a481-c655-4be3-ae09-4f6c8277ca62\") " pod="openshift-insights/insights-operator-78bdfb888c-zzz86" May 21 20:21:49.398236 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.398156 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/feb4a481-c655-4be3-ae09-4f6c8277ca62-serving-cert\") pod \"insights-operator-78bdfb888c-zzz86\" (UID: \"feb4a481-c655-4be3-ae09-4f6c8277ca62\") " pod="openshift-insights/insights-operator-78bdfb888c-zzz86" May 21 20:21:49.398236 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.398186 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvcrs\" (UniqueName: \"kubernetes.io/projected/58270938-7043-423b-91cc-07aa70d5cb14-kube-api-access-vvcrs\") pod \"kube-storage-version-migrator-operator-565644f49-vn4g8\" (UID: \"58270938-7043-423b-91cc-07aa70d5cb14\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vn4g8" May 21 20:21:49.398236 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.398207 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c39245e2-2433-4601-bf1b-443f5fd576e7-metrics-certs\") pod \"router-default-576545cfb4-rlx4k\" (UID: \"c39245e2-2433-4601-bf1b-443f5fd576e7\") " pod="openshift-ingress/router-default-576545cfb4-rlx4k" May 21 20:21:49.398236 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.398226 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/feb4a481-c655-4be3-ae09-4f6c8277ca62-snapshots\") pod \"insights-operator-78bdfb888c-zzz86\" (UID: \"feb4a481-c655-4be3-ae09-4f6c8277ca62\") " pod="openshift-insights/insights-operator-78bdfb888c-zzz86" May 21 20:21:49.398492 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.398296 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tkxvj\" (UniqueName: \"kubernetes.io/projected/8da7802b-c3e2-4f39-b978-5a5f93f645de-kube-api-access-tkxvj\") pod \"cluster-samples-operator-697587599-vxhvx\" (UID: \"8da7802b-c3e2-4f39-b978-5a5f93f645de\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-vxhvx" May 21 20:21:49.398492 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.398366 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5jvg\" (UniqueName: \"kubernetes.io/projected/feb4a481-c655-4be3-ae09-4f6c8277ca62-kube-api-access-f5jvg\") pod \"insights-operator-78bdfb888c-zzz86\" (UID: \"feb4a481-c655-4be3-ae09-4f6c8277ca62\") " pod="openshift-insights/insights-operator-78bdfb888c-zzz86" May 21 20:21:49.398492 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.398410 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58270938-7043-423b-91cc-07aa70d5cb14-config\") pod \"kube-storage-version-migrator-operator-565644f49-vn4g8\" (UID: \"58270938-7043-423b-91cc-07aa70d5cb14\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vn4g8" May 21 20:21:49.398492 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.398457 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c39245e2-2433-4601-bf1b-443f5fd576e7-stats-auth\") pod \"router-default-576545cfb4-rlx4k\" (UID: \"c39245e2-2433-4601-bf1b-443f5fd576e7\") " pod="openshift-ingress/router-default-576545cfb4-rlx4k" May 21 20:21:49.398492 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.398481 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/feb4a481-c655-4be3-ae09-4f6c8277ca62-tmp\") pod \"insights-operator-78bdfb888c-zzz86\" (UID: \"feb4a481-c655-4be3-ae09-4f6c8277ca62\") " pod="openshift-insights/insights-operator-78bdfb888c-zzz86" May 21 20:21:49.398720 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.398500 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f64tq\" (UniqueName: \"kubernetes.io/projected/724eb768-6856-4129-a9a0-a9d7fff49eb2-kube-api-access-f64tq\") pod \"cluster-monitoring-operator-6c75959455-9k4hs\" (UID: \"724eb768-6856-4129-a9a0-a9d7fff49eb2\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9k4hs" May 21 20:21:49.400644 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.400624 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8da7802b-c3e2-4f39-b978-5a5f93f645de-samples-operator-tls\") pod \"cluster-samples-operator-697587599-vxhvx\" (UID: \"8da7802b-c3e2-4f39-b978-5a5f93f645de\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-vxhvx" May 21 20:21:49.406342 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.406319 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-765b5b7fbf-f2n57"] May 21 20:21:49.408216 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.408203 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.416803 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.416782 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkxvj\" (UniqueName: \"kubernetes.io/projected/8da7802b-c3e2-4f39-b978-5a5f93f645de-kube-api-access-tkxvj\") pod \"cluster-samples-operator-697587599-vxhvx\" (UID: \"8da7802b-c3e2-4f39-b978-5a5f93f645de\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-vxhvx" May 21 20:21:49.417042 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.417026 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99ch2\" (UniqueName: \"kubernetes.io/projected/db5b79c9-f8b6-47eb-8fd9-7ff9f5e14753-kube-api-access-99ch2\") pod \"volume-data-source-validator-5cf8c89d64-dmbwc\" (UID: \"db5b79c9-f8b6-47eb-8fd9-7ff9f5e14753\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-dmbwc" May 21 20:21:49.423621 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.423595 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-765b5b7fbf-f2n57"] May 21 20:21:49.499341 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.499254 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b6a24522-88a4-432c-97bb-f6f2083901fd-config\") pod \"console-operator-76dff48d59-8xms4\" (UID: \"b6a24522-88a4-432c-97bb-f6f2083901fd\") " pod="openshift-console-operator/console-operator-76dff48d59-8xms4" May 21 20:21:49.499341 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.499289 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/724eb768-6856-4129-a9a0-a9d7fff49eb2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9k4hs\" (UID: \"724eb768-6856-4129-a9a0-a9d7fff49eb2\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9k4hs" May 21 20:21:49.499341 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.499310 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c39245e2-2433-4601-bf1b-443f5fd576e7-service-ca-bundle\") pod \"router-default-576545cfb4-rlx4k\" (UID: \"c39245e2-2433-4601-bf1b-443f5fd576e7\") " pod="openshift-ingress/router-default-576545cfb4-rlx4k" May 21 20:21:49.499603 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.499554 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d8195ad-7810-45c5-8c9d-4121696777d7-image-registry-private-configuration\") pod \"image-registry-765b5b7fbf-f2n57\" (UID: \"1d8195ad-7810-45c5-8c9d-4121696777d7\") " pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.499657 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.499602 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/724eb768-6856-4129-a9a0-a9d7fff49eb2-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-9k4hs\" (UID: \"724eb768-6856-4129-a9a0-a9d7fff49eb2\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9k4hs" May 21 20:21:49.499657 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.499649 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6a24522-88a4-432c-97bb-f6f2083901fd-trusted-ca\") pod \"console-operator-76dff48d59-8xms4\" (UID: \"b6a24522-88a4-432c-97bb-f6f2083901fd\") " pod="openshift-console-operator/console-operator-76dff48d59-8xms4" May 21 20:21:49.499751 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.499682 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d8195ad-7810-45c5-8c9d-4121696777d7-trusted-ca\") pod \"image-registry-765b5b7fbf-f2n57\" (UID: \"1d8195ad-7810-45c5-8c9d-4121696777d7\") " pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.499831 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.499805 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c39245e2-2433-4601-bf1b-443f5fd576e7-default-certificate\") pod \"router-default-576545cfb4-rlx4k\" (UID: \"c39245e2-2433-4601-bf1b-443f5fd576e7\") " pod="openshift-ingress/router-default-576545cfb4-rlx4k" May 21 20:21:49.499884 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.499865 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58270938-7043-423b-91cc-07aa70d5cb14-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-vn4g8\" (UID: \"58270938-7043-423b-91cc-07aa70d5cb14\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vn4g8" May 21 20:21:49.499992 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.499974 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d8195ad-7810-45c5-8c9d-4121696777d7-installation-pull-secrets\") pod \"image-registry-765b5b7fbf-f2n57\" (UID: \"1d8195ad-7810-45c5-8c9d-4121696777d7\") " pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.500245 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.500011 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l2stf\" (UniqueName: \"kubernetes.io/projected/c39245e2-2433-4601-bf1b-443f5fd576e7-kube-api-access-l2stf\") pod \"router-default-576545cfb4-rlx4k\" (UID: \"c39245e2-2433-4601-bf1b-443f5fd576e7\") " pod="openshift-ingress/router-default-576545cfb4-rlx4k" May 21 20:21:49.500245 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.500044 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d8195ad-7810-45c5-8c9d-4121696777d7-registry-certificates\") pod \"image-registry-765b5b7fbf-f2n57\" (UID: \"1d8195ad-7810-45c5-8c9d-4121696777d7\") " pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.500245 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.500105 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d8195ad-7810-45c5-8c9d-4121696777d7-bound-sa-token\") pod \"image-registry-765b5b7fbf-f2n57\" (UID: \"1d8195ad-7810-45c5-8c9d-4121696777d7\") " pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.500245 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.500136 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cnwh9\" (UniqueName: \"kubernetes.io/projected/b6a24522-88a4-432c-97bb-f6f2083901fd-kube-api-access-cnwh9\") pod \"console-operator-76dff48d59-8xms4\" (UID: \"b6a24522-88a4-432c-97bb-f6f2083901fd\") " pod="openshift-console-operator/console-operator-76dff48d59-8xms4" May 21 20:21:49.500245 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.500144 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c39245e2-2433-4601-bf1b-443f5fd576e7-service-ca-bundle\") pod \"router-default-576545cfb4-rlx4k\" (UID: \"c39245e2-2433-4601-bf1b-443f5fd576e7\") " pod="openshift-ingress/router-default-576545cfb4-rlx4k" May 21 20:21:49.500245 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.500149 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b6a24522-88a4-432c-97bb-f6f2083901fd-config\") pod \"console-operator-76dff48d59-8xms4\" (UID: \"b6a24522-88a4-432c-97bb-f6f2083901fd\") " pod="openshift-console-operator/console-operator-76dff48d59-8xms4" May 21 20:21:49.500245 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.500198 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d8195ad-7810-45c5-8c9d-4121696777d7-ca-trust-extracted\") pod \"image-registry-765b5b7fbf-f2n57\" (UID: \"1d8195ad-7810-45c5-8c9d-4121696777d7\") " pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.500624 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.500356 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feb4a481-c655-4be3-ae09-4f6c8277ca62-service-ca-bundle\") pod \"insights-operator-78bdfb888c-zzz86\" (UID: \"feb4a481-c655-4be3-ae09-4f6c8277ca62\") " pod="openshift-insights/insights-operator-78bdfb888c-zzz86" May 21 20:21:49.500624 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.500356 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/724eb768-6856-4129-a9a0-a9d7fff49eb2-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-9k4hs\" (UID: \"724eb768-6856-4129-a9a0-a9d7fff49eb2\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9k4hs" May 21 20:21:49.500624 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.500431 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6a24522-88a4-432c-97bb-f6f2083901fd-trusted-ca\") pod \"console-operator-76dff48d59-8xms4\" (UID: \"b6a24522-88a4-432c-97bb-f6f2083901fd\") " pod="openshift-console-operator/console-operator-76dff48d59-8xms4" May 21 20:21:49.500624 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.500443 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/feb4a481-c655-4be3-ae09-4f6c8277ca62-serving-cert\") pod \"insights-operator-78bdfb888c-zzz86\" (UID: \"feb4a481-c655-4be3-ae09-4f6c8277ca62\") " pod="openshift-insights/insights-operator-78bdfb888c-zzz86" May 21 20:21:49.500624 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.500567 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb8t4\" (UniqueName: \"kubernetes.io/projected/1d8195ad-7810-45c5-8c9d-4121696777d7-kube-api-access-cb8t4\") pod \"image-registry-765b5b7fbf-f2n57\" (UID: \"1d8195ad-7810-45c5-8c9d-4121696777d7\") " pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.500624 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.500602 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvcrs\" (UniqueName: \"kubernetes.io/projected/58270938-7043-423b-91cc-07aa70d5cb14-kube-api-access-vvcrs\") pod \"kube-storage-version-migrator-operator-565644f49-vn4g8\" (UID: \"58270938-7043-423b-91cc-07aa70d5cb14\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vn4g8" May 21 20:21:49.500918 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.500666 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c39245e2-2433-4601-bf1b-443f5fd576e7-metrics-certs\") pod \"router-default-576545cfb4-rlx4k\" (UID: \"c39245e2-2433-4601-bf1b-443f5fd576e7\") " pod="openshift-ingress/router-default-576545cfb4-rlx4k" May 21 20:21:49.500918 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.500720 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/feb4a481-c655-4be3-ae09-4f6c8277ca62-snapshots\") pod \"insights-operator-78bdfb888c-zzz86\" (UID: \"feb4a481-c655-4be3-ae09-4f6c8277ca62\") " pod="openshift-insights/insights-operator-78bdfb888c-zzz86" May 21 20:21:49.500918 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.500751 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f5jvg\" (UniqueName: \"kubernetes.io/projected/feb4a481-c655-4be3-ae09-4f6c8277ca62-kube-api-access-f5jvg\") pod \"insights-operator-78bdfb888c-zzz86\" (UID: \"feb4a481-c655-4be3-ae09-4f6c8277ca62\") " pod="openshift-insights/insights-operator-78bdfb888c-zzz86" May 21 20:21:49.500918 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.500781 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58270938-7043-423b-91cc-07aa70d5cb14-config\") pod \"kube-storage-version-migrator-operator-565644f49-vn4g8\" (UID: \"58270938-7043-423b-91cc-07aa70d5cb14\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vn4g8" May 21 20:21:49.500918 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.500830 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c39245e2-2433-4601-bf1b-443f5fd576e7-stats-auth\") pod \"router-default-576545cfb4-rlx4k\" (UID: \"c39245e2-2433-4601-bf1b-443f5fd576e7\") " pod="openshift-ingress/router-default-576545cfb4-rlx4k" May 21 20:21:49.500918 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.500859 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/feb4a481-c655-4be3-ae09-4f6c8277ca62-tmp\") pod \"insights-operator-78bdfb888c-zzz86\" (UID: \"feb4a481-c655-4be3-ae09-4f6c8277ca62\") " pod="openshift-insights/insights-operator-78bdfb888c-zzz86" May 21 20:21:49.500918 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.500889 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d8195ad-7810-45c5-8c9d-4121696777d7-registry-tls\") pod \"image-registry-765b5b7fbf-f2n57\" (UID: \"1d8195ad-7810-45c5-8c9d-4121696777d7\") " pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.501295 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.500922 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f64tq\" (UniqueName: \"kubernetes.io/projected/724eb768-6856-4129-a9a0-a9d7fff49eb2-kube-api-access-f64tq\") pod \"cluster-monitoring-operator-6c75959455-9k4hs\" (UID: \"724eb768-6856-4129-a9a0-a9d7fff49eb2\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9k4hs" May 21 20:21:49.501295 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.500974 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b6a24522-88a4-432c-97bb-f6f2083901fd-serving-cert\") pod \"console-operator-76dff48d59-8xms4\" (UID: \"b6a24522-88a4-432c-97bb-f6f2083901fd\") " pod="openshift-console-operator/console-operator-76dff48d59-8xms4" May 21 20:21:49.501295 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.501006 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feb4a481-c655-4be3-ae09-4f6c8277ca62-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-zzz86\" (UID: \"feb4a481-c655-4be3-ae09-4f6c8277ca62\") " pod="openshift-insights/insights-operator-78bdfb888c-zzz86" May 21 20:21:49.501295 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.501024 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feb4a481-c655-4be3-ae09-4f6c8277ca62-service-ca-bundle\") pod \"insights-operator-78bdfb888c-zzz86\" (UID: \"feb4a481-c655-4be3-ae09-4f6c8277ca62\") " pod="openshift-insights/insights-operator-78bdfb888c-zzz86" May 21 20:21:49.502164 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.501584 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/feb4a481-c655-4be3-ae09-4f6c8277ca62-snapshots\") pod \"insights-operator-78bdfb888c-zzz86\" (UID: \"feb4a481-c655-4be3-ae09-4f6c8277ca62\") " pod="openshift-insights/insights-operator-78bdfb888c-zzz86" May 21 20:21:49.502164 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.502068 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58270938-7043-423b-91cc-07aa70d5cb14-config\") pod \"kube-storage-version-migrator-operator-565644f49-vn4g8\" (UID: \"58270938-7043-423b-91cc-07aa70d5cb14\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vn4g8" May 21 20:21:49.502353 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.502306 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/feb4a481-c655-4be3-ae09-4f6c8277ca62-tmp\") pod \"insights-operator-78bdfb888c-zzz86\" (UID: \"feb4a481-c655-4be3-ae09-4f6c8277ca62\") " pod="openshift-insights/insights-operator-78bdfb888c-zzz86" May 21 20:21:49.502494 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.502470 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/724eb768-6856-4129-a9a0-a9d7fff49eb2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9k4hs\" (UID: \"724eb768-6856-4129-a9a0-a9d7fff49eb2\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9k4hs" May 21 20:21:49.502692 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.502648 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feb4a481-c655-4be3-ae09-4f6c8277ca62-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-zzz86\" (UID: \"feb4a481-c655-4be3-ae09-4f6c8277ca62\") " pod="openshift-insights/insights-operator-78bdfb888c-zzz86" May 21 20:21:49.503141 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.503120 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58270938-7043-423b-91cc-07aa70d5cb14-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-vn4g8\" (UID: \"58270938-7043-423b-91cc-07aa70d5cb14\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vn4g8" May 21 20:21:49.503745 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.503517 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c39245e2-2433-4601-bf1b-443f5fd576e7-default-certificate\") pod \"router-default-576545cfb4-rlx4k\" (UID: \"c39245e2-2433-4601-bf1b-443f5fd576e7\") " pod="openshift-ingress/router-default-576545cfb4-rlx4k" May 21 20:21:49.503745 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.503733 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c39245e2-2433-4601-bf1b-443f5fd576e7-metrics-certs\") pod \"router-default-576545cfb4-rlx4k\" (UID: \"c39245e2-2433-4601-bf1b-443f5fd576e7\") " pod="openshift-ingress/router-default-576545cfb4-rlx4k" May 21 20:21:49.504032 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.504012 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/feb4a481-c655-4be3-ae09-4f6c8277ca62-serving-cert\") pod \"insights-operator-78bdfb888c-zzz86\" (UID: \"feb4a481-c655-4be3-ae09-4f6c8277ca62\") " pod="openshift-insights/insights-operator-78bdfb888c-zzz86" May 21 20:21:49.504549 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.504518 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b6a24522-88a4-432c-97bb-f6f2083901fd-serving-cert\") pod \"console-operator-76dff48d59-8xms4\" (UID: \"b6a24522-88a4-432c-97bb-f6f2083901fd\") " pod="openshift-console-operator/console-operator-76dff48d59-8xms4" May 21 20:21:49.504679 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.504663 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c39245e2-2433-4601-bf1b-443f5fd576e7-stats-auth\") pod \"router-default-576545cfb4-rlx4k\" (UID: \"c39245e2-2433-4601-bf1b-443f5fd576e7\") " pod="openshift-ingress/router-default-576545cfb4-rlx4k" May 21 20:21:49.513574 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.513549 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5jvg\" (UniqueName: \"kubernetes.io/projected/feb4a481-c655-4be3-ae09-4f6c8277ca62-kube-api-access-f5jvg\") pod \"insights-operator-78bdfb888c-zzz86\" (UID: \"feb4a481-c655-4be3-ae09-4f6c8277ca62\") " pod="openshift-insights/insights-operator-78bdfb888c-zzz86" May 21 20:21:49.513699 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.513678 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2stf\" (UniqueName: \"kubernetes.io/projected/c39245e2-2433-4601-bf1b-443f5fd576e7-kube-api-access-l2stf\") pod \"router-default-576545cfb4-rlx4k\" (UID: \"c39245e2-2433-4601-bf1b-443f5fd576e7\") " pod="openshift-ingress/router-default-576545cfb4-rlx4k" May 21 20:21:49.514204 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.514185 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f64tq\" (UniqueName: \"kubernetes.io/projected/724eb768-6856-4129-a9a0-a9d7fff49eb2-kube-api-access-f64tq\") pod \"cluster-monitoring-operator-6c75959455-9k4hs\" (UID: \"724eb768-6856-4129-a9a0-a9d7fff49eb2\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9k4hs" May 21 20:21:49.515586 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.515569 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnwh9\" (UniqueName: \"kubernetes.io/projected/b6a24522-88a4-432c-97bb-f6f2083901fd-kube-api-access-cnwh9\") pod \"console-operator-76dff48d59-8xms4\" (UID: \"b6a24522-88a4-432c-97bb-f6f2083901fd\") " pod="openshift-console-operator/console-operator-76dff48d59-8xms4" May 21 20:21:49.517903 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.517878 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvcrs\" (UniqueName: \"kubernetes.io/projected/58270938-7043-423b-91cc-07aa70d5cb14-kube-api-access-vvcrs\") pod \"kube-storage-version-migrator-operator-565644f49-vn4g8\" (UID: \"58270938-7043-423b-91cc-07aa70d5cb14\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vn4g8" May 21 20:21:49.524021 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.524004 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-dmbwc" May 21 20:21:49.530192 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.530173 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-vxhvx" May 21 20:21:49.601703 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.601672 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d8195ad-7810-45c5-8c9d-4121696777d7-image-registry-private-configuration\") pod \"image-registry-765b5b7fbf-f2n57\" (UID: \"1d8195ad-7810-45c5-8c9d-4121696777d7\") " pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.601851 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.601711 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d8195ad-7810-45c5-8c9d-4121696777d7-trusted-ca\") pod \"image-registry-765b5b7fbf-f2n57\" (UID: \"1d8195ad-7810-45c5-8c9d-4121696777d7\") " pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.601851 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.601752 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d8195ad-7810-45c5-8c9d-4121696777d7-installation-pull-secrets\") pod \"image-registry-765b5b7fbf-f2n57\" (UID: \"1d8195ad-7810-45c5-8c9d-4121696777d7\") " pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.601851 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.601769 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d8195ad-7810-45c5-8c9d-4121696777d7-registry-certificates\") pod \"image-registry-765b5b7fbf-f2n57\" (UID: \"1d8195ad-7810-45c5-8c9d-4121696777d7\") " pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.601851 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.601788 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d8195ad-7810-45c5-8c9d-4121696777d7-bound-sa-token\") pod \"image-registry-765b5b7fbf-f2n57\" (UID: \"1d8195ad-7810-45c5-8c9d-4121696777d7\") " pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.601851 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.601810 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d8195ad-7810-45c5-8c9d-4121696777d7-ca-trust-extracted\") pod \"image-registry-765b5b7fbf-f2n57\" (UID: \"1d8195ad-7810-45c5-8c9d-4121696777d7\") " pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.601851 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.601829 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cb8t4\" (UniqueName: \"kubernetes.io/projected/1d8195ad-7810-45c5-8c9d-4121696777d7-kube-api-access-cb8t4\") pod \"image-registry-765b5b7fbf-f2n57\" (UID: \"1d8195ad-7810-45c5-8c9d-4121696777d7\") " pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.601851 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.601851 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d8195ad-7810-45c5-8c9d-4121696777d7-registry-tls\") pod \"image-registry-765b5b7fbf-f2n57\" (UID: \"1d8195ad-7810-45c5-8c9d-4121696777d7\") " pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.602898 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.602858 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d8195ad-7810-45c5-8c9d-4121696777d7-ca-trust-extracted\") pod \"image-registry-765b5b7fbf-f2n57\" (UID: \"1d8195ad-7810-45c5-8c9d-4121696777d7\") " pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.603443 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.603418 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d8195ad-7810-45c5-8c9d-4121696777d7-trusted-ca\") pod \"image-registry-765b5b7fbf-f2n57\" (UID: \"1d8195ad-7810-45c5-8c9d-4121696777d7\") " pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.603501 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.603479 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d8195ad-7810-45c5-8c9d-4121696777d7-registry-certificates\") pod \"image-registry-765b5b7fbf-f2n57\" (UID: \"1d8195ad-7810-45c5-8c9d-4121696777d7\") " pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.605277 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.605253 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d8195ad-7810-45c5-8c9d-4121696777d7-image-registry-private-configuration\") pod \"image-registry-765b5b7fbf-f2n57\" (UID: \"1d8195ad-7810-45c5-8c9d-4121696777d7\") " pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.605720 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.605697 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d8195ad-7810-45c5-8c9d-4121696777d7-registry-tls\") pod \"image-registry-765b5b7fbf-f2n57\" (UID: \"1d8195ad-7810-45c5-8c9d-4121696777d7\") " pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.605778 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.605757 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d8195ad-7810-45c5-8c9d-4121696777d7-installation-pull-secrets\") pod \"image-registry-765b5b7fbf-f2n57\" (UID: \"1d8195ad-7810-45c5-8c9d-4121696777d7\") " pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.611015 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.610979 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d8195ad-7810-45c5-8c9d-4121696777d7-bound-sa-token\") pod \"image-registry-765b5b7fbf-f2n57\" (UID: \"1d8195ad-7810-45c5-8c9d-4121696777d7\") " pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.611147 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.611121 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb8t4\" (UniqueName: \"kubernetes.io/projected/1d8195ad-7810-45c5-8c9d-4121696777d7-kube-api-access-cb8t4\") pod \"image-registry-765b5b7fbf-f2n57\" (UID: \"1d8195ad-7810-45c5-8c9d-4121696777d7\") " pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.617232 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.617213 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-zzz86" May 21 20:21:49.629365 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.629326 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-8xms4" May 21 20:21:49.639538 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.639212 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vn4g8" May 21 20:21:49.645426 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.645392 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9k4hs" May 21 20:21:49.651175 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.650758 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-576545cfb4-rlx4k" May 21 20:21:49.661630 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.661598 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-dmbwc"] May 21 20:21:49.665741 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:21:49.665702 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb5b79c9_f8b6_47eb_8fd9_7ff9f5e14753.slice/crio-f678969ed2a8405bf18cf8d68032eaaa522d2d453bc9f452eecf3e0c220df61e WatchSource:0}: Error finding container f678969ed2a8405bf18cf8d68032eaaa522d2d453bc9f452eecf3e0c220df61e: Status 404 returned error can't find the container with id f678969ed2a8405bf18cf8d68032eaaa522d2d453bc9f452eecf3e0c220df61e May 21 20:21:49.685094 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.685023 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-vxhvx"] May 21 20:21:49.723076 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.720884 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:49.815855 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.815789 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-vxhvx" event={"ID":"8da7802b-c3e2-4f39-b978-5a5f93f645de","Type":"ContainerStarted","Data":"de4ff7ed1da9a15a5f2f95c842a6135cf8eabcce90c1d7e5ef09c3278a8c4d3f"} May 21 20:21:49.818621 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.818566 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-dmbwc" event={"ID":"db5b79c9-f8b6-47eb-8fd9-7ff9f5e14753","Type":"ContainerStarted","Data":"f678969ed2a8405bf18cf8d68032eaaa522d2d453bc9f452eecf3e0c220df61e"} May 21 20:21:49.825845 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.825686 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-zzz86"] May 21 20:21:49.832147 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:21:49.832115 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeb4a481_c655_4be3_ae09_4f6c8277ca62.slice/crio-b845571333eb579763c8721b1b54191ad4f630bd3249603379f42760b7b9e9bb WatchSource:0}: Error finding container b845571333eb579763c8721b1b54191ad4f630bd3249603379f42760b7b9e9bb: Status 404 returned error can't find the container with id b845571333eb579763c8721b1b54191ad4f630bd3249603379f42760b7b9e9bb May 21 20:21:49.853768 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.853715 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-8xms4"] May 21 20:21:49.859689 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:21:49.859656 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6a24522_88a4_432c_97bb_f6f2083901fd.slice/crio-8d2fbb6d221348495feeb5fad614c674a70edb7d2755747bbdf3913ea2af0828 WatchSource:0}: Error finding container 8d2fbb6d221348495feeb5fad614c674a70edb7d2755747bbdf3913ea2af0828: Status 404 returned error can't find the container with id 8d2fbb6d221348495feeb5fad614c674a70edb7d2755747bbdf3913ea2af0828 May 21 20:21:49.890258 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.889925 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-576545cfb4-rlx4k"] May 21 20:21:49.895888 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:21:49.895842 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc39245e2_2433_4601_bf1b_443f5fd576e7.slice/crio-0c8afae73a1788828207ddc2abd825fdaff0228c784e3d250f82e7792fcc5dbd WatchSource:0}: Error finding container 0c8afae73a1788828207ddc2abd825fdaff0228c784e3d250f82e7792fcc5dbd: Status 404 returned error can't find the container with id 0c8afae73a1788828207ddc2abd825fdaff0228c784e3d250f82e7792fcc5dbd May 21 20:21:49.903199 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.903147 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-9k4hs"] May 21 20:21:49.906125 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:21:49.906096 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod724eb768_6856_4129_a9a0_a9d7fff49eb2.slice/crio-9fa5d177407e1d05987615ebd25cc2db799d2264cd36c2d71cfb6fce45627ba3 WatchSource:0}: Error finding container 9fa5d177407e1d05987615ebd25cc2db799d2264cd36c2d71cfb6fce45627ba3: Status 404 returned error can't find the container with id 9fa5d177407e1d05987615ebd25cc2db799d2264cd36c2d71cfb6fce45627ba3 May 21 20:21:49.922422 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.922393 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vn4g8"] May 21 20:21:49.938493 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:21:49.938468 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58270938_7043_423b_91cc_07aa70d5cb14.slice/crio-376e2257265deec5d6a0c9e756150490876fc065d37aa68cbeb0c919b3654cff WatchSource:0}: Error finding container 376e2257265deec5d6a0c9e756150490876fc065d37aa68cbeb0c919b3654cff: Status 404 returned error can't find the container with id 376e2257265deec5d6a0c9e756150490876fc065d37aa68cbeb0c919b3654cff May 21 20:21:49.938626 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:49.938612 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-765b5b7fbf-f2n57"] May 21 20:21:49.941788 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:21:49.941766 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d8195ad_7810_45c5_8c9d_4121696777d7.slice/crio-e22989205609aedd58765ea8d9044053e1df685be9d9271b1bab19af5ec0b860 WatchSource:0}: Error finding container e22989205609aedd58765ea8d9044053e1df685be9d9271b1bab19af5ec0b860: Status 404 returned error can't find the container with id e22989205609aedd58765ea8d9044053e1df685be9d9271b1bab19af5ec0b860 May 21 20:21:50.839031 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:50.838969 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vn4g8" event={"ID":"58270938-7043-423b-91cc-07aa70d5cb14","Type":"ContainerStarted","Data":"376e2257265deec5d6a0c9e756150490876fc065d37aa68cbeb0c919b3654cff"} May 21 20:21:50.842312 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:50.842241 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-8xms4" event={"ID":"b6a24522-88a4-432c-97bb-f6f2083901fd","Type":"ContainerStarted","Data":"8d2fbb6d221348495feeb5fad614c674a70edb7d2755747bbdf3913ea2af0828"} May 21 20:21:50.844987 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:50.844779 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9k4hs" event={"ID":"724eb768-6856-4129-a9a0-a9d7fff49eb2","Type":"ContainerStarted","Data":"9fa5d177407e1d05987615ebd25cc2db799d2264cd36c2d71cfb6fce45627ba3"} May 21 20:21:50.849075 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:50.848794 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" event={"ID":"1d8195ad-7810-45c5-8c9d-4121696777d7","Type":"ContainerStarted","Data":"eee374cdbcd9f7c7572fa76c0d5847ceb2f7e37fb4d556b48470d2dae1fc0cf0"} May 21 20:21:50.849075 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:50.848824 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" event={"ID":"1d8195ad-7810-45c5-8c9d-4121696777d7","Type":"ContainerStarted","Data":"e22989205609aedd58765ea8d9044053e1df685be9d9271b1bab19af5ec0b860"} May 21 20:21:50.849314 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:50.849279 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:21:50.853252 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:50.853206 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-zzz86" event={"ID":"feb4a481-c655-4be3-ae09-4f6c8277ca62","Type":"ContainerStarted","Data":"b845571333eb579763c8721b1b54191ad4f630bd3249603379f42760b7b9e9bb"} May 21 20:21:50.856464 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:50.856439 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-576545cfb4-rlx4k" event={"ID":"c39245e2-2433-4601-bf1b-443f5fd576e7","Type":"ContainerStarted","Data":"a299ab513e5184f51ffd7ae1333bff4d7af91f977c914cbc2d984bef82cae6ec"} May 21 20:21:50.856564 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:50.856473 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-576545cfb4-rlx4k" event={"ID":"c39245e2-2433-4601-bf1b-443f5fd576e7","Type":"ContainerStarted","Data":"0c8afae73a1788828207ddc2abd825fdaff0228c784e3d250f82e7792fcc5dbd"} May 21 20:21:50.889616 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:50.889543 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" podStartSLOduration=1.889522544 podStartE2EDuration="1.889522544s" podCreationTimestamp="2026-05-21 20:21:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:21:50.871803633 +0000 UTC m=+56.870192612" watchObservedRunningTime="2026-05-21 20:21:50.889522544 +0000 UTC m=+56.887911531" May 21 20:21:50.889939 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:50.889756 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-576545cfb4-rlx4k" podStartSLOduration=1.8897455029999999 podStartE2EDuration="1.889745503s" podCreationTimestamp="2026-05-21 20:21:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:21:50.888647092 +0000 UTC m=+56.887036081" watchObservedRunningTime="2026-05-21 20:21:50.889745503 +0000 UTC m=+56.888134488" May 21 20:21:51.652200 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:51.652149 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-576545cfb4-rlx4k" May 21 20:21:51.655083 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:51.655043 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-576545cfb4-rlx4k" May 21 20:21:51.868826 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:51.868789 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-576545cfb4-rlx4k" May 21 20:21:51.870165 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:51.870132 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-576545cfb4-rlx4k" May 21 20:21:53.743075 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:53.743035 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6tkgs" May 21 20:21:54.878464 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:54.878422 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-zzz86" event={"ID":"feb4a481-c655-4be3-ae09-4f6c8277ca62","Type":"ContainerStarted","Data":"db6298e0199b66ccc86e9d74aa0ed30bd65ac5613843cc521ed66121e4bca7d7"} May 21 20:21:54.880301 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:54.880275 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-vxhvx" event={"ID":"8da7802b-c3e2-4f39-b978-5a5f93f645de","Type":"ContainerStarted","Data":"537d18596af52bde234cddd1c47dd49ad599db992274d54524d0ea291dca216b"} May 21 20:21:54.880476 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:54.880451 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-vxhvx" event={"ID":"8da7802b-c3e2-4f39-b978-5a5f93f645de","Type":"ContainerStarted","Data":"49db9d855e2b65ef9dab315413746e0d0dcbbfc824b50f18b180da4cadfd0a54"} May 21 20:21:54.881894 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:54.881873 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vn4g8" event={"ID":"58270938-7043-423b-91cc-07aa70d5cb14","Type":"ContainerStarted","Data":"2e6d7601baa388fb28e35e66b03c8d4ff1491c2cfe42f821c71af849c8ba7d67"} May 21 20:21:54.883450 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:54.883429 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-8xms4" event={"ID":"b6a24522-88a4-432c-97bb-f6f2083901fd","Type":"ContainerStarted","Data":"6228c6fd1f3a93b6b657bc9cefc44db24ea2f534ee57cdc92396e56affe46255"} May 21 20:21:54.883762 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:54.883744 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-8xms4" May 21 20:21:54.884909 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:54.884885 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-dmbwc" event={"ID":"db5b79c9-f8b6-47eb-8fd9-7ff9f5e14753","Type":"ContainerStarted","Data":"1a7cb453684b38d81f58c52656c11422c940f233b7124a2eeaba02f4017bfc22"} May 21 20:21:54.886586 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:54.886564 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9k4hs" event={"ID":"724eb768-6856-4129-a9a0-a9d7fff49eb2","Type":"ContainerStarted","Data":"4bda5b39a17a86caef51dcb60d661c884dbef6f80c960d97a1104f0c9885cca6"} May 21 20:21:54.896352 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:54.896293 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-zzz86" podStartSLOduration=1.601055443 podStartE2EDuration="5.896278688s" podCreationTimestamp="2026-05-21 20:21:49 +0000 UTC" firstStartedPulling="2026-05-21 20:21:49.834422006 +0000 UTC m=+55.832810970" lastFinishedPulling="2026-05-21 20:21:54.129645252 +0000 UTC m=+60.128034215" observedRunningTime="2026-05-21 20:21:54.895203112 +0000 UTC m=+60.893592095" watchObservedRunningTime="2026-05-21 20:21:54.896278688 +0000 UTC m=+60.894667672" May 21 20:21:54.909904 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:54.909831 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-dmbwc" podStartSLOduration=1.453155254 podStartE2EDuration="5.909811883s" podCreationTimestamp="2026-05-21 20:21:49 +0000 UTC" firstStartedPulling="2026-05-21 20:21:49.668156178 +0000 UTC m=+55.666545151" lastFinishedPulling="2026-05-21 20:21:54.124812819 +0000 UTC m=+60.123201780" observedRunningTime="2026-05-21 20:21:54.907983519 +0000 UTC m=+60.906372503" watchObservedRunningTime="2026-05-21 20:21:54.909811883 +0000 UTC m=+60.908200867" May 21 20:21:54.924115 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:54.924032 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-vxhvx" podStartSLOduration=1.5591381979999999 podStartE2EDuration="5.924020508s" podCreationTimestamp="2026-05-21 20:21:49 +0000 UTC" firstStartedPulling="2026-05-21 20:21:49.760860507 +0000 UTC m=+55.759249483" lastFinishedPulling="2026-05-21 20:21:54.125742826 +0000 UTC m=+60.124131793" observedRunningTime="2026-05-21 20:21:54.923510872 +0000 UTC m=+60.921899854" watchObservedRunningTime="2026-05-21 20:21:54.924020508 +0000 UTC m=+60.922409489" May 21 20:21:54.942571 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:54.942468 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-8xms4" podStartSLOduration=1.67610244 podStartE2EDuration="5.942449661s" podCreationTimestamp="2026-05-21 20:21:49 +0000 UTC" firstStartedPulling="2026-05-21 20:21:49.862373184 +0000 UTC m=+55.860762152" lastFinishedPulling="2026-05-21 20:21:54.128720404 +0000 UTC m=+60.127109373" observedRunningTime="2026-05-21 20:21:54.941838736 +0000 UTC m=+60.940227717" watchObservedRunningTime="2026-05-21 20:21:54.942449661 +0000 UTC m=+60.940838647" May 21 20:21:54.959106 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:54.959029 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9k4hs" podStartSLOduration=1.742517549 podStartE2EDuration="5.959011357s" podCreationTimestamp="2026-05-21 20:21:49 +0000 UTC" firstStartedPulling="2026-05-21 20:21:49.909254891 +0000 UTC m=+55.907643852" lastFinishedPulling="2026-05-21 20:21:54.1257487 +0000 UTC m=+60.124137660" observedRunningTime="2026-05-21 20:21:54.957725702 +0000 UTC m=+60.956114686" watchObservedRunningTime="2026-05-21 20:21:54.959011357 +0000 UTC m=+60.957400341" May 21 20:21:54.974939 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:54.974888 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-vn4g8" podStartSLOduration=1.783218057 podStartE2EDuration="5.974875543s" podCreationTimestamp="2026-05-21 20:21:49 +0000 UTC" firstStartedPulling="2026-05-21 20:21:49.940540475 +0000 UTC m=+55.938929436" lastFinishedPulling="2026-05-21 20:21:54.132197943 +0000 UTC m=+60.130586922" observedRunningTime="2026-05-21 20:21:54.974079919 +0000 UTC m=+60.972468903" watchObservedRunningTime="2026-05-21 20:21:54.974875543 +0000 UTC m=+60.973264526" May 21 20:21:55.313565 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:55.313484 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-8xms4" May 21 20:21:56.917515 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:56.917485 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9ppsn_8f451aeb-9e99-470f-9f53-635e5e4bea18/dns/0.log" May 21 20:21:57.102941 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:57.102907 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9ppsn_8f451aeb-9e99-470f-9f53-635e5e4bea18/kube-rbac-proxy/0.log" May 21 20:21:57.811880 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:57.811847 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9ppsn" May 21 20:21:58.102555 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:58.102530 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f9rbz_e971a16c-8d63-4b87-b028-72941ca4388f/dns-node-resolver/0.log" May 21 20:21:58.702543 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:58.702495 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5fb495b879-l5sq8_5907ffb2-76c1-4579-8f6c-827c5ba1a39d/registry/0.log" May 21 20:21:58.903251 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:58.903211 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-765b5b7fbf-f2n57_1d8195ad-7810-45c5-8c9d-4121696777d7/registry/0.log" May 21 20:21:59.209314 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:59.209274 2559 patch_prober.go:28] interesting pod/image-registry-5fb495b879-l5sq8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 21 20:21:59.209676 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:59.209342 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" podUID="5907ffb2-76c1-4579-8f6c-827c5ba1a39d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 20:21:59.296463 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:59.296425 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-metrics-certs\") pod \"network-metrics-daemon-5nnzg\" (UID: \"f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2\") " pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:21:59.298628 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:59.298606 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 20:21:59.309846 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:59.309814 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2-metrics-certs\") pod \"network-metrics-daemon-5nnzg\" (UID: \"f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2\") " pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:21:59.395239 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:59.395206 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kwprk\"" May 21 20:21:59.397154 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:59.397137 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rxvn\" (UniqueName: \"kubernetes.io/projected/ecaedb39-3cf7-450d-8e42-f508c68a92b8-kube-api-access-7rxvn\") pod \"network-check-target-h9lxq\" (UID: \"ecaedb39-3cf7-450d-8e42-f508c68a92b8\") " pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:21:59.399149 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:59.399132 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 20:21:59.403825 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:59.403810 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nnzg" May 21 20:21:59.409540 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:59.409519 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 20:21:59.420951 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:59.420918 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rxvn\" (UniqueName: \"kubernetes.io/projected/ecaedb39-3cf7-450d-8e42-f508c68a92b8-kube-api-access-7rxvn\") pod \"network-check-target-h9lxq\" (UID: \"ecaedb39-3cf7-450d-8e42-f508c68a92b8\") " pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:21:59.532654 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:59.532624 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5nnzg"] May 21 20:21:59.535519 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:21:59.535487 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8eaaa97_1ea9_4939_9f92_b63f2a33d4d2.slice/crio-e5f60a1d317ba185e55178b8b9305d11793dbd9f40e9ab50c508b9da6145629e WatchSource:0}: Error finding container e5f60a1d317ba185e55178b8b9305d11793dbd9f40e9ab50c508b9da6145629e: Status 404 returned error can't find the container with id e5f60a1d317ba185e55178b8b9305d11793dbd9f40e9ab50c508b9da6145629e May 21 20:21:59.700590 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:59.700557 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-stvkr\"" May 21 20:21:59.702538 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:59.702514 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ttlgr_9cfae7f5-193d-448f-91d1-e9992e31ea60/node-ca/0.log" May 21 20:21:59.708644 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:59.708623 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:21:59.839140 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:59.838990 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h9lxq"] May 21 20:21:59.841608 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:21:59.841580 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecaedb39_3cf7_450d_8e42_f508c68a92b8.slice/crio-0fa9356070683f59e0c6f2844d7a0ef0508a59a6f5f566b4a1761df720d9c411 WatchSource:0}: Error finding container 0fa9356070683f59e0c6f2844d7a0ef0508a59a6f5f566b4a1761df720d9c411: Status 404 returned error can't find the container with id 0fa9356070683f59e0c6f2844d7a0ef0508a59a6f5f566b4a1761df720d9c411 May 21 20:21:59.899834 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:59.899793 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5nnzg" event={"ID":"f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2","Type":"ContainerStarted","Data":"e5f60a1d317ba185e55178b8b9305d11793dbd9f40e9ab50c508b9da6145629e"} May 21 20:21:59.900808 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:59.900778 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h9lxq" event={"ID":"ecaedb39-3cf7-450d-8e42-f508c68a92b8","Type":"ContainerStarted","Data":"0fa9356070683f59e0c6f2844d7a0ef0508a59a6f5f566b4a1761df720d9c411"} May 21 20:21:59.903484 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:21:59.903450 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-576545cfb4-rlx4k_c39245e2-2433-4601-bf1b-443f5fd576e7/router/0.log" May 21 20:22:00.504384 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:00.504290 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vrb96_20ec65f6-efea-4276-8673-ccdec1229094/serve-healthcheck-canary/0.log" May 21 20:22:01.104885 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:01.104812 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-vn4g8_58270938-7043-423b-91cc-07aa70d5cb14/kube-storage-version-migrator-operator/0.log" May 21 20:22:01.910153 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:01.910117 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5nnzg" event={"ID":"f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2","Type":"ContainerStarted","Data":"4cce32c2c9156b3b7f06a6b302ab38cd7839d92fb47317bea8a943d3a61dfa63"} May 21 20:22:01.910153 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:01.910158 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5nnzg" event={"ID":"f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2","Type":"ContainerStarted","Data":"4ea1cc58b510cefa3348e0073ec6cc6a1855149f591f04d87ddd52c9b9e3ad38"} May 21 20:22:01.926772 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:01.926726 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5nnzg" podStartSLOduration=66.45701959 podStartE2EDuration="1m7.926711703s" podCreationTimestamp="2026-05-21 20:20:54 +0000 UTC" firstStartedPulling="2026-05-21 20:21:59.537432026 +0000 UTC m=+65.535820989" lastFinishedPulling="2026-05-21 20:22:01.007124124 +0000 UTC m=+67.005513102" observedRunningTime="2026-05-21 20:22:01.924947565 +0000 UTC m=+67.923336561" watchObservedRunningTime="2026-05-21 20:22:01.926711703 +0000 UTC m=+67.925100686" May 21 20:22:02.914951 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:02.914916 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h9lxq" event={"ID":"ecaedb39-3cf7-450d-8e42-f508c68a92b8","Type":"ContainerStarted","Data":"d44ab9af8bd6b1efe65e038ec2f39bc708cd49c42d535cc7f0e4cd71409ce096"} May 21 20:22:02.915416 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:02.915091 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:22:02.930296 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:02.930249 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-h9lxq" podStartSLOduration=66.033428586 podStartE2EDuration="1m8.930226928s" podCreationTimestamp="2026-05-21 20:20:54 +0000 UTC" firstStartedPulling="2026-05-21 20:21:59.843502457 +0000 UTC m=+65.841891418" lastFinishedPulling="2026-05-21 20:22:02.7403008 +0000 UTC m=+68.738689760" observedRunningTime="2026-05-21 20:22:02.928867268 +0000 UTC m=+68.927256255" watchObservedRunningTime="2026-05-21 20:22:02.930226928 +0000 UTC m=+68.928615913" May 21 20:22:03.166571 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.166537 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9dlg4"] May 21 20:22:03.169223 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.169196 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.171875 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.171849 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 20:22:03.172005 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.171885 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 20:22:03.172157 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.172139 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 20:22:03.172349 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.172333 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mdkbz\"" May 21 20:22:03.172646 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.172614 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 20:22:03.229633 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.229585 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-metrics-client-ca\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.229817 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.229641 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-node-exporter-wtmp\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.229817 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.229678 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-node-exporter-textfile\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.229817 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.229764 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.229981 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.229856 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-node-exporter-accelerators-collector-config\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.229981 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.229896 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfq7g\" (UniqueName: \"kubernetes.io/projected/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-kube-api-access-qfq7g\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.229981 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.229928 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-sys\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.229981 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.229949 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-root\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.230193 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.229979 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-node-exporter-tls\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.331064 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.331013 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-sys\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.331231 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.331089 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-root\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.331231 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.331124 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-node-exporter-tls\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.331231 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.331143 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-sys\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.331231 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.331165 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-root\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.331231 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.331154 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-metrics-client-ca\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.331515 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.331242 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-node-exporter-wtmp\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.331515 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:22:03.331274 2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 21 20:22:03.331515 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.331280 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-node-exporter-textfile\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.331515 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.331317 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.331515 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:22:03.331334 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-node-exporter-tls podName:9f48ea62-df33-4b7b-a63d-49688b7dd3b1 nodeName:}" failed. No retries permitted until 2026-05-21 20:22:03.831314005 +0000 UTC m=+69.829702970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-node-exporter-tls") pod "node-exporter-9dlg4" (UID: "9f48ea62-df33-4b7b-a63d-49688b7dd3b1") : secret "node-exporter-tls" not found May 21 20:22:03.331515 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.331398 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-node-exporter-accelerators-collector-config\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.331515 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.331438 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qfq7g\" (UniqueName: \"kubernetes.io/projected/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-kube-api-access-qfq7g\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.331847 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.331722 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-metrics-client-ca\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.331906 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.331855 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-node-exporter-wtmp\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.332165 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.332141 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-node-exporter-textfile\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.332272 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.332240 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-node-exporter-accelerators-collector-config\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.334331 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.334308 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.341699 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.341677 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfq7g\" (UniqueName: \"kubernetes.io/projected/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-kube-api-access-qfq7g\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.835110 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.835070 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-node-exporter-tls\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:03.837510 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:03.837487 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9f48ea62-df33-4b7b-a63d-49688b7dd3b1-node-exporter-tls\") pod \"node-exporter-9dlg4\" (UID: \"9f48ea62-df33-4b7b-a63d-49688b7dd3b1\") " pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:04.081120 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:04.081084 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9dlg4" May 21 20:22:04.089925 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:22:04.089898 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f48ea62_df33_4b7b_a63d_49688b7dd3b1.slice/crio-3fa3a267e94d8ab8cac0def144472946faf3487d4fff94edc47eb94996b0ff99 WatchSource:0}: Error finding container 3fa3a267e94d8ab8cac0def144472946faf3487d4fff94edc47eb94996b0ff99: Status 404 returned error can't find the container with id 3fa3a267e94d8ab8cac0def144472946faf3487d4fff94edc47eb94996b0ff99 May 21 20:22:04.923308 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:04.922648 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9dlg4" event={"ID":"9f48ea62-df33-4b7b-a63d-49688b7dd3b1","Type":"ContainerStarted","Data":"3fa3a267e94d8ab8cac0def144472946faf3487d4fff94edc47eb94996b0ff99"} May 21 20:22:05.926478 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:05.926439 2559 generic.go:358] "Generic (PLEG): container finished" podID="9f48ea62-df33-4b7b-a63d-49688b7dd3b1" containerID="9e1b87f37d4d10637e01f6e011970def6f80c22d03d169981d2c042b323342fa" exitCode=0 May 21 20:22:05.926929 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:05.926534 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9dlg4" event={"ID":"9f48ea62-df33-4b7b-a63d-49688b7dd3b1","Type":"ContainerDied","Data":"9e1b87f37d4d10637e01f6e011970def6f80c22d03d169981d2c042b323342fa"} May 21 20:22:06.409618 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:06.409585 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vb6w7"] May 21 20:22:06.418743 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:06.418719 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vb6w7" May 21 20:22:06.421311 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:06.421174 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 20:22:06.421311 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:06.421192 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pwfsr\"" May 21 20:22:06.421311 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:06.421278 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 20:22:06.423628 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:06.423600 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vb6w7"] May 21 20:22:06.559503 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:06.559462 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84e3015b-fd5e-4fe4-93a8-7a01aa8630d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vb6w7\" (UID: \"84e3015b-fd5e-4fe4-93a8-7a01aa8630d8\") " pod="openshift-insights/insights-runtime-extractor-vb6w7" May 21 20:22:06.559503 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:06.559504 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p7sp\" (UniqueName: \"kubernetes.io/projected/84e3015b-fd5e-4fe4-93a8-7a01aa8630d8-kube-api-access-4p7sp\") pod \"insights-runtime-extractor-vb6w7\" (UID: \"84e3015b-fd5e-4fe4-93a8-7a01aa8630d8\") " pod="openshift-insights/insights-runtime-extractor-vb6w7" May 21 20:22:06.559724 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:06.559528 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84e3015b-fd5e-4fe4-93a8-7a01aa8630d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vb6w7\" (UID: \"84e3015b-fd5e-4fe4-93a8-7a01aa8630d8\") " pod="openshift-insights/insights-runtime-extractor-vb6w7" May 21 20:22:06.559724 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:06.559597 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/84e3015b-fd5e-4fe4-93a8-7a01aa8630d8-data-volume\") pod \"insights-runtime-extractor-vb6w7\" (UID: \"84e3015b-fd5e-4fe4-93a8-7a01aa8630d8\") " pod="openshift-insights/insights-runtime-extractor-vb6w7" May 21 20:22:06.559724 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:06.559634 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/84e3015b-fd5e-4fe4-93a8-7a01aa8630d8-crio-socket\") pod \"insights-runtime-extractor-vb6w7\" (UID: \"84e3015b-fd5e-4fe4-93a8-7a01aa8630d8\") " pod="openshift-insights/insights-runtime-extractor-vb6w7" May 21 20:22:06.660550 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:06.660449 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84e3015b-fd5e-4fe4-93a8-7a01aa8630d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vb6w7\" (UID: \"84e3015b-fd5e-4fe4-93a8-7a01aa8630d8\") " pod="openshift-insights/insights-runtime-extractor-vb6w7" May 21 20:22:06.660550 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:06.660495 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4p7sp\" (UniqueName: \"kubernetes.io/projected/84e3015b-fd5e-4fe4-93a8-7a01aa8630d8-kube-api-access-4p7sp\") pod \"insights-runtime-extractor-vb6w7\" (UID: \"84e3015b-fd5e-4fe4-93a8-7a01aa8630d8\") " pod="openshift-insights/insights-runtime-extractor-vb6w7" May 21 20:22:06.660550 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:06.660520 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84e3015b-fd5e-4fe4-93a8-7a01aa8630d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vb6w7\" (UID: \"84e3015b-fd5e-4fe4-93a8-7a01aa8630d8\") " pod="openshift-insights/insights-runtime-extractor-vb6w7" May 21 20:22:06.660843 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:22:06.660618 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 21 20:22:06.660843 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:06.660650 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/84e3015b-fd5e-4fe4-93a8-7a01aa8630d8-data-volume\") pod \"insights-runtime-extractor-vb6w7\" (UID: \"84e3015b-fd5e-4fe4-93a8-7a01aa8630d8\") " pod="openshift-insights/insights-runtime-extractor-vb6w7" May 21 20:22:06.660843 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:22:06.660684 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84e3015b-fd5e-4fe4-93a8-7a01aa8630d8-insights-runtime-extractor-tls podName:84e3015b-fd5e-4fe4-93a8-7a01aa8630d8 nodeName:}" failed. No retries permitted until 2026-05-21 20:22:07.160662551 +0000 UTC m=+73.159051512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/84e3015b-fd5e-4fe4-93a8-7a01aa8630d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vb6w7" (UID: "84e3015b-fd5e-4fe4-93a8-7a01aa8630d8") : secret "insights-runtime-extractor-tls" not found May 21 20:22:06.660843 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:06.660727 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/84e3015b-fd5e-4fe4-93a8-7a01aa8630d8-crio-socket\") pod \"insights-runtime-extractor-vb6w7\" (UID: \"84e3015b-fd5e-4fe4-93a8-7a01aa8630d8\") " pod="openshift-insights/insights-runtime-extractor-vb6w7" May 21 20:22:06.661081 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:06.660932 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/84e3015b-fd5e-4fe4-93a8-7a01aa8630d8-data-volume\") pod \"insights-runtime-extractor-vb6w7\" (UID: \"84e3015b-fd5e-4fe4-93a8-7a01aa8630d8\") " pod="openshift-insights/insights-runtime-extractor-vb6w7" May 21 20:22:06.661081 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:06.660979 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/84e3015b-fd5e-4fe4-93a8-7a01aa8630d8-crio-socket\") pod \"insights-runtime-extractor-vb6w7\" (UID: \"84e3015b-fd5e-4fe4-93a8-7a01aa8630d8\") " pod="openshift-insights/insights-runtime-extractor-vb6w7" May 21 20:22:06.661081 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:06.661017 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84e3015b-fd5e-4fe4-93a8-7a01aa8630d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vb6w7\" (UID: \"84e3015b-fd5e-4fe4-93a8-7a01aa8630d8\") " pod="openshift-insights/insights-runtime-extractor-vb6w7" May 21 20:22:06.668771 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:06.668749 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p7sp\" (UniqueName: \"kubernetes.io/projected/84e3015b-fd5e-4fe4-93a8-7a01aa8630d8-kube-api-access-4p7sp\") pod \"insights-runtime-extractor-vb6w7\" (UID: \"84e3015b-fd5e-4fe4-93a8-7a01aa8630d8\") " pod="openshift-insights/insights-runtime-extractor-vb6w7" May 21 20:22:06.931612 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:06.931535 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9dlg4" event={"ID":"9f48ea62-df33-4b7b-a63d-49688b7dd3b1","Type":"ContainerStarted","Data":"4a6b80a62c71064f4d91df0e91e21d1a4eb409889bd745bbddf77fe95e2ef13b"} May 21 20:22:06.931612 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:06.931570 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9dlg4" event={"ID":"9f48ea62-df33-4b7b-a63d-49688b7dd3b1","Type":"ContainerStarted","Data":"fb856164128533a47ee6ee89b1d65e27a68bc8286c2c403cb7bd0a9f22e2c379"} May 21 20:22:06.949348 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:06.949301 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9dlg4" podStartSLOduration=3.033798358 podStartE2EDuration="3.949287384s" podCreationTimestamp="2026-05-21 20:22:03 +0000 UTC" firstStartedPulling="2026-05-21 20:22:04.091677961 +0000 UTC m=+70.090066935" lastFinishedPulling="2026-05-21 20:22:05.007166997 +0000 UTC m=+71.005555961" observedRunningTime="2026-05-21 20:22:06.947512376 +0000 UTC m=+72.945901359" watchObservedRunningTime="2026-05-21 20:22:06.949287384 +0000 UTC m=+72.947676368" May 21 20:22:07.164879 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:07.164839 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84e3015b-fd5e-4fe4-93a8-7a01aa8630d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vb6w7\" (UID: \"84e3015b-fd5e-4fe4-93a8-7a01aa8630d8\") " pod="openshift-insights/insights-runtime-extractor-vb6w7" May 21 20:22:07.167355 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:07.167326 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84e3015b-fd5e-4fe4-93a8-7a01aa8630d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vb6w7\" (UID: \"84e3015b-fd5e-4fe4-93a8-7a01aa8630d8\") " pod="openshift-insights/insights-runtime-extractor-vb6w7" May 21 20:22:07.329285 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:07.329262 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vb6w7" May 21 20:22:07.464112 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:07.463740 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vb6w7"] May 21 20:22:07.466446 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:22:07.466404 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84e3015b_fd5e_4fe4_93a8_7a01aa8630d8.slice/crio-0fc48df5b2b6ae2bdbc1a56941067dd8434175d49fe12d837a56c0fb3dde04c3 WatchSource:0}: Error finding container 0fc48df5b2b6ae2bdbc1a56941067dd8434175d49fe12d837a56c0fb3dde04c3: Status 404 returned error can't find the container with id 0fc48df5b2b6ae2bdbc1a56941067dd8434175d49fe12d837a56c0fb3dde04c3 May 21 20:22:07.935946 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:07.935902 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vb6w7" event={"ID":"84e3015b-fd5e-4fe4-93a8-7a01aa8630d8","Type":"ContainerStarted","Data":"e8f288f1223d4bfc7f73185d1ccfae564462ab824a939ab776637b41c51775cd"} May 21 20:22:07.935946 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:07.935948 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vb6w7" event={"ID":"84e3015b-fd5e-4fe4-93a8-7a01aa8630d8","Type":"ContainerStarted","Data":"0fc48df5b2b6ae2bdbc1a56941067dd8434175d49fe12d837a56c0fb3dde04c3"} May 21 20:22:08.944061 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:08.944014 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vb6w7" event={"ID":"84e3015b-fd5e-4fe4-93a8-7a01aa8630d8","Type":"ContainerStarted","Data":"b201adc072a08e70bbddf553cfe3c8a35db9aed9e527d2c44b323e109d18a9fe"} May 21 20:22:09.208955 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:09.208872 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:22:09.948494 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:09.948462 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vb6w7" event={"ID":"84e3015b-fd5e-4fe4-93a8-7a01aa8630d8","Type":"ContainerStarted","Data":"1d76082d8f8bec92bd631e2a2bdf2ffa31d8b629adebe8e18b18718aa2d7b4f7"} May 21 20:22:09.966891 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:09.966840 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vb6w7" podStartSLOduration=1.6235568809999998 podStartE2EDuration="3.966827563s" podCreationTimestamp="2026-05-21 20:22:06 +0000 UTC" firstStartedPulling="2026-05-21 20:22:07.518934185 +0000 UTC m=+73.517323145" lastFinishedPulling="2026-05-21 20:22:09.862204867 +0000 UTC m=+75.860593827" observedRunningTime="2026-05-21 20:22:09.964925792 +0000 UTC m=+75.963314779" watchObservedRunningTime="2026-05-21 20:22:09.966827563 +0000 UTC m=+75.965216546" May 21 20:22:10.391431 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.391391 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-c77d5bb58-m7z59"] May 21 20:22:10.393610 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.393587 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:10.396066 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.396034 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 21 20:22:10.397107 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.397012 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dwk6c\"" May 21 20:22:10.397107 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.397045 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 21 20:22:10.397107 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.397084 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 21 20:22:10.397337 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.397109 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 21 20:22:10.397337 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.397128 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 21 20:22:10.397337 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.397113 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 21 20:22:10.397337 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.397081 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 21 20:22:10.401497 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.401479 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 21 20:22:10.405463 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.405442 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c77d5bb58-m7z59"] May 21 20:22:10.495044 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.495016 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-oauth-serving-cert\") pod \"console-c77d5bb58-m7z59\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:10.495195 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.495070 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-console-serving-cert\") pod \"console-c77d5bb58-m7z59\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:10.495195 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.495158 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvsz9\" (UniqueName: \"kubernetes.io/projected/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-kube-api-access-lvsz9\") pod \"console-c77d5bb58-m7z59\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:10.495275 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.495197 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-trusted-ca-bundle\") pod \"console-c77d5bb58-m7z59\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:10.495275 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.495218 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-service-ca\") pod \"console-c77d5bb58-m7z59\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:10.495275 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.495268 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-console-oauth-config\") pod \"console-c77d5bb58-m7z59\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:10.495366 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.495284 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-console-config\") pod \"console-c77d5bb58-m7z59\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:10.595938 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.595912 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-console-serving-cert\") pod \"console-c77d5bb58-m7z59\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:10.596100 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.595960 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lvsz9\" (UniqueName: \"kubernetes.io/projected/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-kube-api-access-lvsz9\") pod \"console-c77d5bb58-m7z59\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:10.596156 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.596104 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-trusted-ca-bundle\") pod \"console-c77d5bb58-m7z59\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:10.596156 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.596139 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-service-ca\") pod \"console-c77d5bb58-m7z59\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:10.596269 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.596176 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-console-oauth-config\") pod \"console-c77d5bb58-m7z59\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:10.596269 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.596192 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-console-config\") pod \"console-c77d5bb58-m7z59\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:10.596269 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.596227 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-oauth-serving-cert\") pod \"console-c77d5bb58-m7z59\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:10.596828 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.596806 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-service-ca\") pod \"console-c77d5bb58-m7z59\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:10.596933 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.596916 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-console-config\") pod \"console-c77d5bb58-m7z59\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:10.597197 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.597176 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-oauth-serving-cert\") pod \"console-c77d5bb58-m7z59\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:10.597239 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.597223 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-trusted-ca-bundle\") pod \"console-c77d5bb58-m7z59\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:10.598669 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.598645 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-console-oauth-config\") pod \"console-c77d5bb58-m7z59\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:10.598781 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.598761 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-console-serving-cert\") pod \"console-c77d5bb58-m7z59\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:10.603342 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.603324 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvsz9\" (UniqueName: \"kubernetes.io/projected/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-kube-api-access-lvsz9\") pod \"console-c77d5bb58-m7z59\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:10.703546 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.703464 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:10.831778 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.831647 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c77d5bb58-m7z59"] May 21 20:22:10.834239 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:22:10.834215 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ae33d02_c176_4ff9_abeb_0c02532c0ed1.slice/crio-6db0a61dd34aa60ea8e7730484212269a8bd02d0fd76f442ca59c31a9219b951 WatchSource:0}: Error finding container 6db0a61dd34aa60ea8e7730484212269a8bd02d0fd76f442ca59c31a9219b951: Status 404 returned error can't find the container with id 6db0a61dd34aa60ea8e7730484212269a8bd02d0fd76f442ca59c31a9219b951 May 21 20:22:10.955602 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:10.955518 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c77d5bb58-m7z59" event={"ID":"2ae33d02-c176-4ff9-abeb-0c02532c0ed1","Type":"ContainerStarted","Data":"6db0a61dd34aa60ea8e7730484212269a8bd02d0fd76f442ca59c31a9219b951"} May 21 20:22:11.873310 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:11.873211 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-765b5b7fbf-f2n57" May 21 20:22:13.965932 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:13.965896 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c77d5bb58-m7z59" event={"ID":"2ae33d02-c176-4ff9-abeb-0c02532c0ed1","Type":"ContainerStarted","Data":"6dcb419bdbfadd7cf15c941606b1427ed589b89135e0814709267aa2a0da4090"} May 21 20:22:13.983109 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:13.983046 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-c77d5bb58-m7z59" podStartSLOduration=0.958471776 podStartE2EDuration="3.983031377s" podCreationTimestamp="2026-05-21 20:22:10 +0000 UTC" firstStartedPulling="2026-05-21 20:22:10.836107864 +0000 UTC m=+76.834496826" lastFinishedPulling="2026-05-21 20:22:13.860667462 +0000 UTC m=+79.859056427" observedRunningTime="2026-05-21 20:22:13.981892521 +0000 UTC m=+79.980281505" watchObservedRunningTime="2026-05-21 20:22:13.983031377 +0000 UTC m=+79.981420359" May 21 20:22:14.224386 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.224270 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" podUID="5907ffb2-76c1-4579-8f6c-827c5ba1a39d" containerName="registry" containerID="cri-o://213f12eff051865942d6dd66fb75034a22ab1ebc5581be23c69582a2e3bb1ef5" gracePeriod=30 May 21 20:22:14.489292 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.489269 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:22:14.634304 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.634270 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-tls\") pod \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " May 21 20:22:14.634304 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.634311 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-bound-sa-token\") pod \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " May 21 20:22:14.634503 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.634334 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-image-registry-private-configuration\") pod \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " May 21 20:22:14.634503 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.634355 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-trusted-ca\") pod \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " May 21 20:22:14.634503 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.634407 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-installation-pull-secrets\") pod \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " May 21 20:22:14.634503 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.634440 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-certificates\") pod \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " May 21 20:22:14.634503 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.634475 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-ca-trust-extracted\") pod \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " May 21 20:22:14.634763 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.634508 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k29kn\" (UniqueName: \"kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-kube-api-access-k29kn\") pod \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\" (UID: \"5907ffb2-76c1-4579-8f6c-827c5ba1a39d\") " May 21 20:22:14.634911 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.634885 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5907ffb2-76c1-4579-8f6c-827c5ba1a39d" (UID: "5907ffb2-76c1-4579-8f6c-827c5ba1a39d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:22:14.635462 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.635365 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5907ffb2-76c1-4579-8f6c-827c5ba1a39d" (UID: "5907ffb2-76c1-4579-8f6c-827c5ba1a39d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:22:14.637456 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.637425 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-kube-api-access-k29kn" (OuterVolumeSpecName: "kube-api-access-k29kn") pod "5907ffb2-76c1-4579-8f6c-827c5ba1a39d" (UID: "5907ffb2-76c1-4579-8f6c-827c5ba1a39d"). InnerVolumeSpecName "kube-api-access-k29kn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:22:14.637558 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.637472 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5907ffb2-76c1-4579-8f6c-827c5ba1a39d" (UID: "5907ffb2-76c1-4579-8f6c-827c5ba1a39d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 20:22:14.637620 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.637564 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5907ffb2-76c1-4579-8f6c-827c5ba1a39d" (UID: "5907ffb2-76c1-4579-8f6c-827c5ba1a39d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:22:14.637620 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.637590 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5907ffb2-76c1-4579-8f6c-827c5ba1a39d" (UID: "5907ffb2-76c1-4579-8f6c-827c5ba1a39d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 20:22:14.637687 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.637662 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5907ffb2-76c1-4579-8f6c-827c5ba1a39d" (UID: "5907ffb2-76c1-4579-8f6c-827c5ba1a39d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:22:14.643470 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.643449 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5907ffb2-76c1-4579-8f6c-827c5ba1a39d" (UID: "5907ffb2-76c1-4579-8f6c-827c5ba1a39d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:22:14.736018 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.735930 2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-installation-pull-secrets\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:22:14.736018 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.735968 2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-certificates\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:22:14.736018 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.735979 2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-ca-trust-extracted\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:22:14.736018 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.735988 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k29kn\" (UniqueName: \"kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-kube-api-access-k29kn\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:22:14.736018 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.735997 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-registry-tls\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:22:14.736018 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.736006 2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-bound-sa-token\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:22:14.736018 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.736014 2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-image-registry-private-configuration\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:22:14.736018 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.736023 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5907ffb2-76c1-4579-8f6c-827c5ba1a39d-trusted-ca\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:22:14.969616 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.969567 2559 generic.go:358] "Generic (PLEG): container finished" podID="5907ffb2-76c1-4579-8f6c-827c5ba1a39d" containerID="213f12eff051865942d6dd66fb75034a22ab1ebc5581be23c69582a2e3bb1ef5" exitCode=0 May 21 20:22:14.970122 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.969629 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" May 21 20:22:14.970122 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.969647 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" event={"ID":"5907ffb2-76c1-4579-8f6c-827c5ba1a39d","Type":"ContainerDied","Data":"213f12eff051865942d6dd66fb75034a22ab1ebc5581be23c69582a2e3bb1ef5"} May 21 20:22:14.970122 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.969686 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fb495b879-l5sq8" event={"ID":"5907ffb2-76c1-4579-8f6c-827c5ba1a39d","Type":"ContainerDied","Data":"3a67660549338aef6c410290d6e5b9731d949376722c99fd499d9c69942b521d"} May 21 20:22:14.970122 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.969713 2559 scope.go:117] "RemoveContainer" containerID="213f12eff051865942d6dd66fb75034a22ab1ebc5581be23c69582a2e3bb1ef5" May 21 20:22:14.978350 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.978329 2559 scope.go:117] "RemoveContainer" containerID="213f12eff051865942d6dd66fb75034a22ab1ebc5581be23c69582a2e3bb1ef5" May 21 20:22:14.978607 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:22:14.978589 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"213f12eff051865942d6dd66fb75034a22ab1ebc5581be23c69582a2e3bb1ef5\": container with ID starting with 213f12eff051865942d6dd66fb75034a22ab1ebc5581be23c69582a2e3bb1ef5 not found: ID does not exist" containerID="213f12eff051865942d6dd66fb75034a22ab1ebc5581be23c69582a2e3bb1ef5" May 21 20:22:14.978653 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.978615 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"213f12eff051865942d6dd66fb75034a22ab1ebc5581be23c69582a2e3bb1ef5"} err="failed to get container status \"213f12eff051865942d6dd66fb75034a22ab1ebc5581be23c69582a2e3bb1ef5\": rpc error: code = NotFound desc = could not find container \"213f12eff051865942d6dd66fb75034a22ab1ebc5581be23c69582a2e3bb1ef5\": container with ID starting with 213f12eff051865942d6dd66fb75034a22ab1ebc5581be23c69582a2e3bb1ef5 not found: ID does not exist" May 21 20:22:14.989184 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.989128 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5fb495b879-l5sq8"] May 21 20:22:14.992886 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:14.992865 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5fb495b879-l5sq8"] May 21 20:22:16.575681 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:16.575644 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5907ffb2-76c1-4579-8f6c-827c5ba1a39d" path="/var/lib/kubelet/pods/5907ffb2-76c1-4579-8f6c-827c5ba1a39d/volumes" May 21 20:22:20.704249 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:20.704210 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:20.704249 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:20.704258 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:20.708965 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:20.708943 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:20.991085 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:20.990996 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:22:33.920647 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:22:33.920614 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-h9lxq" May 21 20:23:31.340096 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.340046 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-68f445d89d-ddb47"] May 21 20:23:31.340555 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.340319 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5907ffb2-76c1-4579-8f6c-827c5ba1a39d" containerName="registry" May 21 20:23:31.340555 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.340330 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5907ffb2-76c1-4579-8f6c-827c5ba1a39d" containerName="registry" May 21 20:23:31.340555 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.340399 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="5907ffb2-76c1-4579-8f6c-827c5ba1a39d" containerName="registry" May 21 20:23:31.342283 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.342262 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:31.352411 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.352382 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68f445d89d-ddb47"] May 21 20:23:31.412936 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.412900 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82e2b593-1011-4236-ab9d-1914286d9b13-oauth-serving-cert\") pod \"console-68f445d89d-ddb47\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:31.413129 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.412960 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82e2b593-1011-4236-ab9d-1914286d9b13-service-ca\") pod \"console-68f445d89d-ddb47\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:31.413129 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.412983 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82e2b593-1011-4236-ab9d-1914286d9b13-trusted-ca-bundle\") pod \"console-68f445d89d-ddb47\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:31.413129 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.413036 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnbdt\" (UniqueName: \"kubernetes.io/projected/82e2b593-1011-4236-ab9d-1914286d9b13-kube-api-access-jnbdt\") pod \"console-68f445d89d-ddb47\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:31.413261 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.413128 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82e2b593-1011-4236-ab9d-1914286d9b13-console-oauth-config\") pod \"console-68f445d89d-ddb47\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:31.413261 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.413169 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82e2b593-1011-4236-ab9d-1914286d9b13-console-serving-cert\") pod \"console-68f445d89d-ddb47\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:31.413261 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.413210 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82e2b593-1011-4236-ab9d-1914286d9b13-console-config\") pod \"console-68f445d89d-ddb47\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:31.514210 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.514171 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82e2b593-1011-4236-ab9d-1914286d9b13-console-config\") pod \"console-68f445d89d-ddb47\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:31.514398 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.514225 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82e2b593-1011-4236-ab9d-1914286d9b13-oauth-serving-cert\") pod \"console-68f445d89d-ddb47\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:31.514398 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.514275 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82e2b593-1011-4236-ab9d-1914286d9b13-service-ca\") pod \"console-68f445d89d-ddb47\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:31.514398 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.514299 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82e2b593-1011-4236-ab9d-1914286d9b13-trusted-ca-bundle\") pod \"console-68f445d89d-ddb47\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:31.514398 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.514327 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jnbdt\" (UniqueName: \"kubernetes.io/projected/82e2b593-1011-4236-ab9d-1914286d9b13-kube-api-access-jnbdt\") pod \"console-68f445d89d-ddb47\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:31.514617 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.514471 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82e2b593-1011-4236-ab9d-1914286d9b13-console-oauth-config\") pod \"console-68f445d89d-ddb47\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:31.514617 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.514524 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82e2b593-1011-4236-ab9d-1914286d9b13-console-serving-cert\") pod \"console-68f445d89d-ddb47\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:31.515040 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.514970 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82e2b593-1011-4236-ab9d-1914286d9b13-console-config\") pod \"console-68f445d89d-ddb47\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:31.515183 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.515146 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82e2b593-1011-4236-ab9d-1914286d9b13-oauth-serving-cert\") pod \"console-68f445d89d-ddb47\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:31.515183 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.515162 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82e2b593-1011-4236-ab9d-1914286d9b13-service-ca\") pod \"console-68f445d89d-ddb47\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:31.515389 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.515368 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82e2b593-1011-4236-ab9d-1914286d9b13-trusted-ca-bundle\") pod \"console-68f445d89d-ddb47\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:31.517649 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.517631 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82e2b593-1011-4236-ab9d-1914286d9b13-console-serving-cert\") pod \"console-68f445d89d-ddb47\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:31.517757 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.517736 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82e2b593-1011-4236-ab9d-1914286d9b13-console-oauth-config\") pod \"console-68f445d89d-ddb47\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:31.522270 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.522249 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnbdt\" (UniqueName: \"kubernetes.io/projected/82e2b593-1011-4236-ab9d-1914286d9b13-kube-api-access-jnbdt\") pod \"console-68f445d89d-ddb47\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:31.654017 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.653924 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:31.783366 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:31.783327 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68f445d89d-ddb47"] May 21 20:23:31.786301 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:23:31.786276 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82e2b593_1011_4236_ab9d_1914286d9b13.slice/crio-598c7aab8529fc55e25c008b1cb453764bbed76ba192d40d4a437663a298eced WatchSource:0}: Error finding container 598c7aab8529fc55e25c008b1cb453764bbed76ba192d40d4a437663a298eced: Status 404 returned error can't find the container with id 598c7aab8529fc55e25c008b1cb453764bbed76ba192d40d4a437663a298eced May 21 20:23:32.184038 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:32.183995 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68f445d89d-ddb47" event={"ID":"82e2b593-1011-4236-ab9d-1914286d9b13","Type":"ContainerStarted","Data":"ae24949c865005f8205ab9953d7b13677be5f5f3d1f447086695bba24e905848"} May 21 20:23:32.184038 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:32.184039 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68f445d89d-ddb47" event={"ID":"82e2b593-1011-4236-ab9d-1914286d9b13","Type":"ContainerStarted","Data":"598c7aab8529fc55e25c008b1cb453764bbed76ba192d40d4a437663a298eced"} May 21 20:23:32.202024 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:32.201977 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-68f445d89d-ddb47" podStartSLOduration=1.201963639 podStartE2EDuration="1.201963639s" podCreationTimestamp="2026-05-21 20:23:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:23:32.201168502 +0000 UTC m=+158.199557486" watchObservedRunningTime="2026-05-21 20:23:32.201963639 +0000 UTC m=+158.200352623" May 21 20:23:41.654921 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:41.654870 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:41.654921 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:41.654936 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:41.659609 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:41.659574 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:42.215188 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:42.215159 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68f445d89d-ddb47" May 21 20:23:42.260093 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:23:42.260042 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c77d5bb58-m7z59"] May 21 20:24:07.282303 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:07.282207 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-c77d5bb58-m7z59" podUID="2ae33d02-c176-4ff9-abeb-0c02532c0ed1" containerName="console" containerID="cri-o://6dcb419bdbfadd7cf15c941606b1427ed589b89135e0814709267aa2a0da4090" gracePeriod=15 May 21 20:24:07.529430 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:07.529410 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c77d5bb58-m7z59_2ae33d02-c176-4ff9-abeb-0c02532c0ed1/console/0.log" May 21 20:24:07.529534 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:07.529470 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:24:07.583642 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:07.583616 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvsz9\" (UniqueName: \"kubernetes.io/projected/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-kube-api-access-lvsz9\") pod \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " May 21 20:24:07.583785 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:07.583660 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-console-serving-cert\") pod \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " May 21 20:24:07.583785 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:07.583702 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-console-oauth-config\") pod \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " May 21 20:24:07.583785 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:07.583730 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-oauth-serving-cert\") pod \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " May 21 20:24:07.583785 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:07.583744 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-trusted-ca-bundle\") pod \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " May 21 20:24:07.583785 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:07.583763 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-service-ca\") pod \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " May 21 20:24:07.584034 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:07.583895 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-console-config\") pod \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\" (UID: \"2ae33d02-c176-4ff9-abeb-0c02532c0ed1\") " May 21 20:24:07.584196 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:07.584166 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-service-ca" (OuterVolumeSpecName: "service-ca") pod "2ae33d02-c176-4ff9-abeb-0c02532c0ed1" (UID: "2ae33d02-c176-4ff9-abeb-0c02532c0ed1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:24:07.584196 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:07.584180 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2ae33d02-c176-4ff9-abeb-0c02532c0ed1" (UID: "2ae33d02-c176-4ff9-abeb-0c02532c0ed1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:24:07.584538 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:07.584511 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-console-config" (OuterVolumeSpecName: "console-config") pod "2ae33d02-c176-4ff9-abeb-0c02532c0ed1" (UID: "2ae33d02-c176-4ff9-abeb-0c02532c0ed1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:24:07.584838 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:07.584814 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2ae33d02-c176-4ff9-abeb-0c02532c0ed1" (UID: "2ae33d02-c176-4ff9-abeb-0c02532c0ed1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:24:07.586124 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:07.586103 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-kube-api-access-lvsz9" (OuterVolumeSpecName: "kube-api-access-lvsz9") pod "2ae33d02-c176-4ff9-abeb-0c02532c0ed1" (UID: "2ae33d02-c176-4ff9-abeb-0c02532c0ed1"). InnerVolumeSpecName "kube-api-access-lvsz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:24:07.586455 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:07.586438 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2ae33d02-c176-4ff9-abeb-0c02532c0ed1" (UID: "2ae33d02-c176-4ff9-abeb-0c02532c0ed1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 20:24:07.586526 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:07.586456 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2ae33d02-c176-4ff9-abeb-0c02532c0ed1" (UID: "2ae33d02-c176-4ff9-abeb-0c02532c0ed1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 20:24:07.685323 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:07.685290 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-console-oauth-config\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:24:07.685323 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:07.685322 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-oauth-serving-cert\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:24:07.685323 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:07.685332 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-trusted-ca-bundle\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:24:07.685482 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:07.685342 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-service-ca\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:24:07.685482 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:07.685351 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-console-config\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:24:07.685482 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:07.685359 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvsz9\" (UniqueName: \"kubernetes.io/projected/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-kube-api-access-lvsz9\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:24:07.685482 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:07.685369 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ae33d02-c176-4ff9-abeb-0c02532c0ed1-console-serving-cert\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:24:08.284023 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:08.283996 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c77d5bb58-m7z59_2ae33d02-c176-4ff9-abeb-0c02532c0ed1/console/0.log" May 21 20:24:08.284453 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:08.284036 2559 generic.go:358] "Generic (PLEG): container finished" podID="2ae33d02-c176-4ff9-abeb-0c02532c0ed1" containerID="6dcb419bdbfadd7cf15c941606b1427ed589b89135e0814709267aa2a0da4090" exitCode=2 May 21 20:24:08.284453 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:08.284085 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c77d5bb58-m7z59" event={"ID":"2ae33d02-c176-4ff9-abeb-0c02532c0ed1","Type":"ContainerDied","Data":"6dcb419bdbfadd7cf15c941606b1427ed589b89135e0814709267aa2a0da4090"} May 21 20:24:08.284453 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:08.284111 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c77d5bb58-m7z59" May 21 20:24:08.284453 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:08.284126 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c77d5bb58-m7z59" event={"ID":"2ae33d02-c176-4ff9-abeb-0c02532c0ed1","Type":"ContainerDied","Data":"6db0a61dd34aa60ea8e7730484212269a8bd02d0fd76f442ca59c31a9219b951"} May 21 20:24:08.284453 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:08.284141 2559 scope.go:117] "RemoveContainer" containerID="6dcb419bdbfadd7cf15c941606b1427ed589b89135e0814709267aa2a0da4090" May 21 20:24:08.292488 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:08.292469 2559 scope.go:117] "RemoveContainer" containerID="6dcb419bdbfadd7cf15c941606b1427ed589b89135e0814709267aa2a0da4090" May 21 20:24:08.292731 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:24:08.292711 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dcb419bdbfadd7cf15c941606b1427ed589b89135e0814709267aa2a0da4090\": container with ID starting with 6dcb419bdbfadd7cf15c941606b1427ed589b89135e0814709267aa2a0da4090 not found: ID does not exist" containerID="6dcb419bdbfadd7cf15c941606b1427ed589b89135e0814709267aa2a0da4090" May 21 20:24:08.292779 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:08.292739 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dcb419bdbfadd7cf15c941606b1427ed589b89135e0814709267aa2a0da4090"} err="failed to get container status \"6dcb419bdbfadd7cf15c941606b1427ed589b89135e0814709267aa2a0da4090\": rpc error: code = NotFound desc = could not find container \"6dcb419bdbfadd7cf15c941606b1427ed589b89135e0814709267aa2a0da4090\": container with ID starting with 6dcb419bdbfadd7cf15c941606b1427ed589b89135e0814709267aa2a0da4090 not found: ID does not exist" May 21 20:24:08.303833 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:08.303810 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c77d5bb58-m7z59"] May 21 20:24:08.308818 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:08.308798 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c77d5bb58-m7z59"] May 21 20:24:08.575134 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:08.575034 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ae33d02-c176-4ff9-abeb-0c02532c0ed1" path="/var/lib/kubelet/pods/2ae33d02-c176-4ff9-abeb-0c02532c0ed1/volumes" May 21 20:24:49.497988 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.497953 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c64989c55-9jd5d"] May 21 20:24:49.499038 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.499014 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ae33d02-c176-4ff9-abeb-0c02532c0ed1" containerName="console" May 21 20:24:49.499214 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.499198 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ae33d02-c176-4ff9-abeb-0c02532c0ed1" containerName="console" May 21 20:24:49.499406 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.499390 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="2ae33d02-c176-4ff9-abeb-0c02532c0ed1" containerName="console" May 21 20:24:49.502311 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.502293 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:49.512984 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.512958 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c64989c55-9jd5d"] May 21 20:24:49.593858 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.593824 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtn7f\" (UniqueName: \"kubernetes.io/projected/2cc944c5-ab1d-4415-86a1-5489d616685e-kube-api-access-wtn7f\") pod \"console-7c64989c55-9jd5d\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:49.593858 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.593859 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cc944c5-ab1d-4415-86a1-5489d616685e-oauth-serving-cert\") pod \"console-7c64989c55-9jd5d\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:49.594097 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.593895 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cc944c5-ab1d-4415-86a1-5489d616685e-service-ca\") pod \"console-7c64989c55-9jd5d\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:49.594097 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.593922 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cc944c5-ab1d-4415-86a1-5489d616685e-console-oauth-config\") pod \"console-7c64989c55-9jd5d\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:49.594097 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.593969 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cc944c5-ab1d-4415-86a1-5489d616685e-console-config\") pod \"console-7c64989c55-9jd5d\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:49.594097 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.594006 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cc944c5-ab1d-4415-86a1-5489d616685e-console-serving-cert\") pod \"console-7c64989c55-9jd5d\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:49.594097 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.594031 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cc944c5-ab1d-4415-86a1-5489d616685e-trusted-ca-bundle\") pod \"console-7c64989c55-9jd5d\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:49.694620 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.694579 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtn7f\" (UniqueName: \"kubernetes.io/projected/2cc944c5-ab1d-4415-86a1-5489d616685e-kube-api-access-wtn7f\") pod \"console-7c64989c55-9jd5d\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:49.694620 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.694625 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cc944c5-ab1d-4415-86a1-5489d616685e-oauth-serving-cert\") pod \"console-7c64989c55-9jd5d\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:49.694859 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.694658 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cc944c5-ab1d-4415-86a1-5489d616685e-service-ca\") pod \"console-7c64989c55-9jd5d\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:49.694859 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.694689 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cc944c5-ab1d-4415-86a1-5489d616685e-console-oauth-config\") pod \"console-7c64989c55-9jd5d\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:49.694859 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.694726 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cc944c5-ab1d-4415-86a1-5489d616685e-console-config\") pod \"console-7c64989c55-9jd5d\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:49.694859 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.694757 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cc944c5-ab1d-4415-86a1-5489d616685e-console-serving-cert\") pod \"console-7c64989c55-9jd5d\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:49.694859 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.694790 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cc944c5-ab1d-4415-86a1-5489d616685e-trusted-ca-bundle\") pod \"console-7c64989c55-9jd5d\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:49.695573 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.695467 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cc944c5-ab1d-4415-86a1-5489d616685e-oauth-serving-cert\") pod \"console-7c64989c55-9jd5d\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:49.695573 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.695478 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cc944c5-ab1d-4415-86a1-5489d616685e-console-config\") pod \"console-7c64989c55-9jd5d\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:49.695573 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.695487 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cc944c5-ab1d-4415-86a1-5489d616685e-service-ca\") pod \"console-7c64989c55-9jd5d\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:49.695573 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.695639 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cc944c5-ab1d-4415-86a1-5489d616685e-trusted-ca-bundle\") pod \"console-7c64989c55-9jd5d\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:49.697404 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.697377 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cc944c5-ab1d-4415-86a1-5489d616685e-console-oauth-config\") pod \"console-7c64989c55-9jd5d\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:49.697558 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.697542 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cc944c5-ab1d-4415-86a1-5489d616685e-console-serving-cert\") pod \"console-7c64989c55-9jd5d\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:49.702036 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.702017 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtn7f\" (UniqueName: \"kubernetes.io/projected/2cc944c5-ab1d-4415-86a1-5489d616685e-kube-api-access-wtn7f\") pod \"console-7c64989c55-9jd5d\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:49.816623 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.816545 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:49.941941 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:49.941911 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c64989c55-9jd5d"] May 21 20:24:49.944882 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:24:49.944856 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cc944c5_ab1d_4415_86a1_5489d616685e.slice/crio-bf437c4613ba1f5a5cf9ef2a901c78090c15fa1b9a4464708ca0e6f03b292502 WatchSource:0}: Error finding container bf437c4613ba1f5a5cf9ef2a901c78090c15fa1b9a4464708ca0e6f03b292502: Status 404 returned error can't find the container with id bf437c4613ba1f5a5cf9ef2a901c78090c15fa1b9a4464708ca0e6f03b292502 May 21 20:24:50.400985 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:50.400949 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c64989c55-9jd5d" event={"ID":"2cc944c5-ab1d-4415-86a1-5489d616685e","Type":"ContainerStarted","Data":"01c754ce2a636efd3da473ab5ea0c25ee269551ace0b7fb0cd20f3f14ae58a67"} May 21 20:24:50.400985 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:50.400986 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c64989c55-9jd5d" event={"ID":"2cc944c5-ab1d-4415-86a1-5489d616685e","Type":"ContainerStarted","Data":"bf437c4613ba1f5a5cf9ef2a901c78090c15fa1b9a4464708ca0e6f03b292502"} May 21 20:24:50.421604 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:50.421561 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7c64989c55-9jd5d" podStartSLOduration=1.421547052 podStartE2EDuration="1.421547052s" podCreationTimestamp="2026-05-21 20:24:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:24:50.420339899 +0000 UTC m=+236.418728883" watchObservedRunningTime="2026-05-21 20:24:50.421547052 +0000 UTC m=+236.419936034" May 21 20:24:59.817438 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:59.817396 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:59.817961 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:59.817534 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:24:59.822386 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:24:59.822363 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:25:00.432761 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:00.432732 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:25:00.481246 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:00.481214 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68f445d89d-ddb47"] May 21 20:25:25.501682 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:25.501627 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-68f445d89d-ddb47" podUID="82e2b593-1011-4236-ab9d-1914286d9b13" containerName="console" containerID="cri-o://ae24949c865005f8205ab9953d7b13677be5f5f3d1f447086695bba24e905848" gracePeriod=15 May 21 20:25:25.729798 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:25.729776 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-68f445d89d-ddb47_82e2b593-1011-4236-ab9d-1914286d9b13/console/0.log" May 21 20:25:25.729897 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:25.729840 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68f445d89d-ddb47" May 21 20:25:25.779977 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:25.779904 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnbdt\" (UniqueName: \"kubernetes.io/projected/82e2b593-1011-4236-ab9d-1914286d9b13-kube-api-access-jnbdt\") pod \"82e2b593-1011-4236-ab9d-1914286d9b13\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " May 21 20:25:25.779977 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:25.779972 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82e2b593-1011-4236-ab9d-1914286d9b13-service-ca\") pod \"82e2b593-1011-4236-ab9d-1914286d9b13\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " May 21 20:25:25.780209 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:25.780001 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82e2b593-1011-4236-ab9d-1914286d9b13-console-oauth-config\") pod \"82e2b593-1011-4236-ab9d-1914286d9b13\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " May 21 20:25:25.780209 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:25.780034 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82e2b593-1011-4236-ab9d-1914286d9b13-console-config\") pod \"82e2b593-1011-4236-ab9d-1914286d9b13\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " May 21 20:25:25.780209 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:25.780083 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82e2b593-1011-4236-ab9d-1914286d9b13-oauth-serving-cert\") pod \"82e2b593-1011-4236-ab9d-1914286d9b13\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " May 21 20:25:25.780209 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:25.780118 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82e2b593-1011-4236-ab9d-1914286d9b13-console-serving-cert\") pod \"82e2b593-1011-4236-ab9d-1914286d9b13\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " May 21 20:25:25.780209 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:25.780177 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82e2b593-1011-4236-ab9d-1914286d9b13-trusted-ca-bundle\") pod \"82e2b593-1011-4236-ab9d-1914286d9b13\" (UID: \"82e2b593-1011-4236-ab9d-1914286d9b13\") " May 21 20:25:25.780495 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:25.780469 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82e2b593-1011-4236-ab9d-1914286d9b13-service-ca" (OuterVolumeSpecName: "service-ca") pod "82e2b593-1011-4236-ab9d-1914286d9b13" (UID: "82e2b593-1011-4236-ab9d-1914286d9b13"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:25:25.780552 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:25.780468 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82e2b593-1011-4236-ab9d-1914286d9b13-console-config" (OuterVolumeSpecName: "console-config") pod "82e2b593-1011-4236-ab9d-1914286d9b13" (UID: "82e2b593-1011-4236-ab9d-1914286d9b13"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:25:25.780671 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:25.780642 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82e2b593-1011-4236-ab9d-1914286d9b13-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "82e2b593-1011-4236-ab9d-1914286d9b13" (UID: "82e2b593-1011-4236-ab9d-1914286d9b13"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:25:25.780923 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:25.780900 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82e2b593-1011-4236-ab9d-1914286d9b13-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "82e2b593-1011-4236-ab9d-1914286d9b13" (UID: "82e2b593-1011-4236-ab9d-1914286d9b13"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:25:25.782341 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:25.782313 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82e2b593-1011-4236-ab9d-1914286d9b13-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "82e2b593-1011-4236-ab9d-1914286d9b13" (UID: "82e2b593-1011-4236-ab9d-1914286d9b13"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 20:25:25.782435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:25.782338 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82e2b593-1011-4236-ab9d-1914286d9b13-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "82e2b593-1011-4236-ab9d-1914286d9b13" (UID: "82e2b593-1011-4236-ab9d-1914286d9b13"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 20:25:25.782435 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:25.782365 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82e2b593-1011-4236-ab9d-1914286d9b13-kube-api-access-jnbdt" (OuterVolumeSpecName: "kube-api-access-jnbdt") pod "82e2b593-1011-4236-ab9d-1914286d9b13" (UID: "82e2b593-1011-4236-ab9d-1914286d9b13"). InnerVolumeSpecName "kube-api-access-jnbdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:25:25.880880 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:25.880843 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82e2b593-1011-4236-ab9d-1914286d9b13-service-ca\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:25:25.880880 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:25.880873 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82e2b593-1011-4236-ab9d-1914286d9b13-console-oauth-config\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:25:25.880880 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:25.880884 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82e2b593-1011-4236-ab9d-1914286d9b13-console-config\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:25:25.881132 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:25.880893 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82e2b593-1011-4236-ab9d-1914286d9b13-oauth-serving-cert\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:25:25.881132 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:25.880902 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82e2b593-1011-4236-ab9d-1914286d9b13-console-serving-cert\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:25:25.881132 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:25.880910 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82e2b593-1011-4236-ab9d-1914286d9b13-trusted-ca-bundle\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:25:25.881132 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:25.880918 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnbdt\" (UniqueName: \"kubernetes.io/projected/82e2b593-1011-4236-ab9d-1914286d9b13-kube-api-access-jnbdt\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:25:26.498463 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:26.498439 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-68f445d89d-ddb47_82e2b593-1011-4236-ab9d-1914286d9b13/console/0.log" May 21 20:25:26.498616 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:26.498480 2559 generic.go:358] "Generic (PLEG): container finished" podID="82e2b593-1011-4236-ab9d-1914286d9b13" containerID="ae24949c865005f8205ab9953d7b13677be5f5f3d1f447086695bba24e905848" exitCode=2 May 21 20:25:26.498616 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:26.498522 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68f445d89d-ddb47" event={"ID":"82e2b593-1011-4236-ab9d-1914286d9b13","Type":"ContainerDied","Data":"ae24949c865005f8205ab9953d7b13677be5f5f3d1f447086695bba24e905848"} May 21 20:25:26.498616 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:26.498543 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68f445d89d-ddb47" event={"ID":"82e2b593-1011-4236-ab9d-1914286d9b13","Type":"ContainerDied","Data":"598c7aab8529fc55e25c008b1cb453764bbed76ba192d40d4a437663a298eced"} May 21 20:25:26.498616 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:26.498552 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68f445d89d-ddb47" May 21 20:25:26.498751 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:26.498558 2559 scope.go:117] "RemoveContainer" containerID="ae24949c865005f8205ab9953d7b13677be5f5f3d1f447086695bba24e905848" May 21 20:25:26.506870 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:26.506706 2559 scope.go:117] "RemoveContainer" containerID="ae24949c865005f8205ab9953d7b13677be5f5f3d1f447086695bba24e905848" May 21 20:25:26.507141 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:25:26.506973 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae24949c865005f8205ab9953d7b13677be5f5f3d1f447086695bba24e905848\": container with ID starting with ae24949c865005f8205ab9953d7b13677be5f5f3d1f447086695bba24e905848 not found: ID does not exist" containerID="ae24949c865005f8205ab9953d7b13677be5f5f3d1f447086695bba24e905848" May 21 20:25:26.507141 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:26.506998 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae24949c865005f8205ab9953d7b13677be5f5f3d1f447086695bba24e905848"} err="failed to get container status \"ae24949c865005f8205ab9953d7b13677be5f5f3d1f447086695bba24e905848\": rpc error: code = NotFound desc = could not find container \"ae24949c865005f8205ab9953d7b13677be5f5f3d1f447086695bba24e905848\": container with ID starting with ae24949c865005f8205ab9953d7b13677be5f5f3d1f447086695bba24e905848 not found: ID does not exist" May 21 20:25:26.518129 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:26.518110 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68f445d89d-ddb47"] May 21 20:25:26.522015 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:26.521997 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68f445d89d-ddb47"] May 21 20:25:26.575559 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:26.575522 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82e2b593-1011-4236-ab9d-1914286d9b13" path="/var/lib/kubelet/pods/82e2b593-1011-4236-ab9d-1914286d9b13/volumes" May 21 20:25:52.168008 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:52.167972 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w"] May 21 20:25:52.168432 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:52.168256 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82e2b593-1011-4236-ab9d-1914286d9b13" containerName="console" May 21 20:25:52.168432 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:52.168268 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="82e2b593-1011-4236-ab9d-1914286d9b13" containerName="console" May 21 20:25:52.168432 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:52.168312 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="82e2b593-1011-4236-ab9d-1914286d9b13" containerName="console" May 21 20:25:52.171247 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:52.171230 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w" May 21 20:25:52.173913 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:52.173895 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2zshn\"" May 21 20:25:52.174227 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:52.174209 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 20:25:52.174797 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:52.174782 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 20:25:52.183151 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:52.183131 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w"] May 21 20:25:52.300088 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:52.300018 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aef64ce9-6538-4c54-9b98-82f6aaa5afc8-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w\" (UID: \"aef64ce9-6538-4c54-9b98-82f6aaa5afc8\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w" May 21 20:25:52.300272 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:52.300170 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqt8k\" (UniqueName: \"kubernetes.io/projected/aef64ce9-6538-4c54-9b98-82f6aaa5afc8-kube-api-access-vqt8k\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w\" (UID: \"aef64ce9-6538-4c54-9b98-82f6aaa5afc8\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w" May 21 20:25:52.300272 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:52.300234 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aef64ce9-6538-4c54-9b98-82f6aaa5afc8-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w\" (UID: \"aef64ce9-6538-4c54-9b98-82f6aaa5afc8\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w" May 21 20:25:52.401197 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:52.401162 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aef64ce9-6538-4c54-9b98-82f6aaa5afc8-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w\" (UID: \"aef64ce9-6538-4c54-9b98-82f6aaa5afc8\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w" May 21 20:25:52.401197 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:52.401203 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aef64ce9-6538-4c54-9b98-82f6aaa5afc8-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w\" (UID: \"aef64ce9-6538-4c54-9b98-82f6aaa5afc8\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w" May 21 20:25:52.401420 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:52.401253 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vqt8k\" (UniqueName: \"kubernetes.io/projected/aef64ce9-6538-4c54-9b98-82f6aaa5afc8-kube-api-access-vqt8k\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w\" (UID: \"aef64ce9-6538-4c54-9b98-82f6aaa5afc8\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w" May 21 20:25:52.401571 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:52.401549 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aef64ce9-6538-4c54-9b98-82f6aaa5afc8-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w\" (UID: \"aef64ce9-6538-4c54-9b98-82f6aaa5afc8\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w" May 21 20:25:52.401636 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:52.401594 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aef64ce9-6538-4c54-9b98-82f6aaa5afc8-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w\" (UID: \"aef64ce9-6538-4c54-9b98-82f6aaa5afc8\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w" May 21 20:25:52.409972 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:52.409941 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqt8k\" (UniqueName: \"kubernetes.io/projected/aef64ce9-6538-4c54-9b98-82f6aaa5afc8-kube-api-access-vqt8k\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w\" (UID: \"aef64ce9-6538-4c54-9b98-82f6aaa5afc8\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w" May 21 20:25:52.481119 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:52.481014 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w" May 21 20:25:52.611643 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:52.611557 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w"] May 21 20:25:52.613949 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:25:52.613923 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaef64ce9_6538_4c54_9b98_82f6aaa5afc8.slice/crio-9841e12cd2dde15ef763c3d8da4a88d8e962787f8769500f6242f93e234f06b4 WatchSource:0}: Error finding container 9841e12cd2dde15ef763c3d8da4a88d8e962787f8769500f6242f93e234f06b4: Status 404 returned error can't find the container with id 9841e12cd2dde15ef763c3d8da4a88d8e962787f8769500f6242f93e234f06b4 May 21 20:25:53.570685 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:53.570645 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w" event={"ID":"aef64ce9-6538-4c54-9b98-82f6aaa5afc8","Type":"ContainerStarted","Data":"9841e12cd2dde15ef763c3d8da4a88d8e962787f8769500f6242f93e234f06b4"} May 21 20:25:54.473341 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:54.473309 2559 kubelet.go:1628] "Image garbage collection succeeded" May 21 20:25:57.584507 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:57.584472 2559 generic.go:358] "Generic (PLEG): container finished" podID="aef64ce9-6538-4c54-9b98-82f6aaa5afc8" containerID="ade2ba703c27a344ca3fb5746d84ea76acf6dfc754670d56287bfc09dc6bca74" exitCode=0 May 21 20:25:57.584918 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:57.584558 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w" event={"ID":"aef64ce9-6538-4c54-9b98-82f6aaa5afc8","Type":"ContainerDied","Data":"ade2ba703c27a344ca3fb5746d84ea76acf6dfc754670d56287bfc09dc6bca74"} May 21 20:25:57.585522 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:25:57.585507 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 20:26:00.593273 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:00.593230 2559 generic.go:358] "Generic (PLEG): container finished" podID="aef64ce9-6538-4c54-9b98-82f6aaa5afc8" containerID="083ea7f0879c48a99fc871e74303b59cb8e92bb113babf6f4e9f62ddb5e1f375" exitCode=0 May 21 20:26:00.593653 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:00.593328 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w" event={"ID":"aef64ce9-6538-4c54-9b98-82f6aaa5afc8","Type":"ContainerDied","Data":"083ea7f0879c48a99fc871e74303b59cb8e92bb113babf6f4e9f62ddb5e1f375"} May 21 20:26:07.615856 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:07.615819 2559 generic.go:358] "Generic (PLEG): container finished" podID="aef64ce9-6538-4c54-9b98-82f6aaa5afc8" containerID="2f792cbe123c1858f11b86a5eb762159a766e2fb43e01c086e7de90b7f34ff9a" exitCode=0 May 21 20:26:07.616266 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:07.615869 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w" event={"ID":"aef64ce9-6538-4c54-9b98-82f6aaa5afc8","Type":"ContainerDied","Data":"2f792cbe123c1858f11b86a5eb762159a766e2fb43e01c086e7de90b7f34ff9a"} May 21 20:26:08.742154 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:08.742128 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w" May 21 20:26:08.838425 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:08.838383 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aef64ce9-6538-4c54-9b98-82f6aaa5afc8-util\") pod \"aef64ce9-6538-4c54-9b98-82f6aaa5afc8\" (UID: \"aef64ce9-6538-4c54-9b98-82f6aaa5afc8\") " May 21 20:26:08.838425 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:08.838432 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqt8k\" (UniqueName: \"kubernetes.io/projected/aef64ce9-6538-4c54-9b98-82f6aaa5afc8-kube-api-access-vqt8k\") pod \"aef64ce9-6538-4c54-9b98-82f6aaa5afc8\" (UID: \"aef64ce9-6538-4c54-9b98-82f6aaa5afc8\") " May 21 20:26:08.838625 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:08.838467 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aef64ce9-6538-4c54-9b98-82f6aaa5afc8-bundle\") pod \"aef64ce9-6538-4c54-9b98-82f6aaa5afc8\" (UID: \"aef64ce9-6538-4c54-9b98-82f6aaa5afc8\") " May 21 20:26:08.839234 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:08.839206 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aef64ce9-6538-4c54-9b98-82f6aaa5afc8-bundle" (OuterVolumeSpecName: "bundle") pod "aef64ce9-6538-4c54-9b98-82f6aaa5afc8" (UID: "aef64ce9-6538-4c54-9b98-82f6aaa5afc8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:26:08.840835 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:08.840812 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aef64ce9-6538-4c54-9b98-82f6aaa5afc8-kube-api-access-vqt8k" (OuterVolumeSpecName: "kube-api-access-vqt8k") pod "aef64ce9-6538-4c54-9b98-82f6aaa5afc8" (UID: "aef64ce9-6538-4c54-9b98-82f6aaa5afc8"). InnerVolumeSpecName "kube-api-access-vqt8k". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:26:08.842546 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:08.842521 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aef64ce9-6538-4c54-9b98-82f6aaa5afc8-util" (OuterVolumeSpecName: "util") pod "aef64ce9-6538-4c54-9b98-82f6aaa5afc8" (UID: "aef64ce9-6538-4c54-9b98-82f6aaa5afc8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:26:08.939696 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:08.939595 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aef64ce9-6538-4c54-9b98-82f6aaa5afc8-util\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:26:08.939696 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:08.939647 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqt8k\" (UniqueName: \"kubernetes.io/projected/aef64ce9-6538-4c54-9b98-82f6aaa5afc8-kube-api-access-vqt8k\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:26:08.939696 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:08.939657 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aef64ce9-6538-4c54-9b98-82f6aaa5afc8-bundle\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:26:09.623074 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:09.623026 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w" event={"ID":"aef64ce9-6538-4c54-9b98-82f6aaa5afc8","Type":"ContainerDied","Data":"9841e12cd2dde15ef763c3d8da4a88d8e962787f8769500f6242f93e234f06b4"} May 21 20:26:09.623074 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:09.623074 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9841e12cd2dde15ef763c3d8da4a88d8e962787f8769500f6242f93e234f06b4" May 21 20:26:09.623273 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:09.623084 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd8n4w" May 21 20:26:15.262788 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:15.262753 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-j7lhj"] May 21 20:26:15.263240 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:15.263013 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aef64ce9-6538-4c54-9b98-82f6aaa5afc8" containerName="extract" May 21 20:26:15.263240 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:15.263024 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aef64ce9-6538-4c54-9b98-82f6aaa5afc8" containerName="extract" May 21 20:26:15.263240 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:15.263036 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aef64ce9-6538-4c54-9b98-82f6aaa5afc8" containerName="pull" May 21 20:26:15.263240 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:15.263041 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aef64ce9-6538-4c54-9b98-82f6aaa5afc8" containerName="pull" May 21 20:26:15.263240 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:15.263065 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aef64ce9-6538-4c54-9b98-82f6aaa5afc8" containerName="util" May 21 20:26:15.263240 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:15.263071 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aef64ce9-6538-4c54-9b98-82f6aaa5afc8" containerName="util" May 21 20:26:15.263240 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:15.263120 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="aef64ce9-6538-4c54-9b98-82f6aaa5afc8" containerName="extract" May 21 20:26:15.308838 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:15.308810 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-j7lhj"] May 21 20:26:15.308967 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:15.308914 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-j7lhj" May 21 20:26:15.312483 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:15.312461 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 21 20:26:15.312618 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:15.312599 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 21 20:26:15.313173 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:15.313156 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-k98rg\"" May 21 20:26:15.388405 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:15.388371 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e8cc3a8-f7d4-40fe-900f-2d75e561dfe5-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-j7lhj\" (UID: \"9e8cc3a8-f7d4-40fe-900f-2d75e561dfe5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-j7lhj" May 21 20:26:15.388555 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:15.388409 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9wm6\" (UniqueName: \"kubernetes.io/projected/9e8cc3a8-f7d4-40fe-900f-2d75e561dfe5-kube-api-access-p9wm6\") pod \"cert-manager-operator-controller-manager-54b9655956-j7lhj\" (UID: \"9e8cc3a8-f7d4-40fe-900f-2d75e561dfe5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-j7lhj" May 21 20:26:15.488825 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:15.488795 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e8cc3a8-f7d4-40fe-900f-2d75e561dfe5-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-j7lhj\" (UID: \"9e8cc3a8-f7d4-40fe-900f-2d75e561dfe5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-j7lhj" May 21 20:26:15.488825 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:15.488827 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p9wm6\" (UniqueName: \"kubernetes.io/projected/9e8cc3a8-f7d4-40fe-900f-2d75e561dfe5-kube-api-access-p9wm6\") pod \"cert-manager-operator-controller-manager-54b9655956-j7lhj\" (UID: \"9e8cc3a8-f7d4-40fe-900f-2d75e561dfe5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-j7lhj" May 21 20:26:15.489254 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:15.489232 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e8cc3a8-f7d4-40fe-900f-2d75e561dfe5-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-j7lhj\" (UID: \"9e8cc3a8-f7d4-40fe-900f-2d75e561dfe5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-j7lhj" May 21 20:26:15.497317 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:15.497298 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9wm6\" (UniqueName: \"kubernetes.io/projected/9e8cc3a8-f7d4-40fe-900f-2d75e561dfe5-kube-api-access-p9wm6\") pod \"cert-manager-operator-controller-manager-54b9655956-j7lhj\" (UID: \"9e8cc3a8-f7d4-40fe-900f-2d75e561dfe5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-j7lhj" May 21 20:26:15.618153 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:15.618121 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-j7lhj" May 21 20:26:15.751995 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:15.751973 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-j7lhj"] May 21 20:26:15.754316 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:26:15.754289 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e8cc3a8_f7d4_40fe_900f_2d75e561dfe5.slice/crio-e3f0611b385bb23c12c807970af7556db4ec17c476af53c59beaddfc387eeb1f WatchSource:0}: Error finding container e3f0611b385bb23c12c807970af7556db4ec17c476af53c59beaddfc387eeb1f: Status 404 returned error can't find the container with id e3f0611b385bb23c12c807970af7556db4ec17c476af53c59beaddfc387eeb1f May 21 20:26:16.644552 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:16.644505 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-j7lhj" event={"ID":"9e8cc3a8-f7d4-40fe-900f-2d75e561dfe5","Type":"ContainerStarted","Data":"e3f0611b385bb23c12c807970af7556db4ec17c476af53c59beaddfc387eeb1f"} May 21 20:26:18.657028 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:18.656939 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-j7lhj" event={"ID":"9e8cc3a8-f7d4-40fe-900f-2d75e561dfe5","Type":"ContainerStarted","Data":"c36f66df7c13b8a13298571276a52cd6ebf7e86e40a4ede269f36187a199dc6b"} May 21 20:26:19.262807 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:19.262748 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-j7lhj" podStartSLOduration=1.6495702209999998 podStartE2EDuration="4.262733183s" podCreationTimestamp="2026-05-21 20:26:15 +0000 UTC" firstStartedPulling="2026-05-21 20:26:15.756871611 +0000 UTC m=+321.755260571" lastFinishedPulling="2026-05-21 20:26:18.370034572 +0000 UTC m=+324.368423533" observedRunningTime="2026-05-21 20:26:18.677866399 +0000 UTC m=+324.676255381" watchObservedRunningTime="2026-05-21 20:26:19.262733183 +0000 UTC m=+325.261122166" May 21 20:26:19.263353 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:19.263331 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv"] May 21 20:26:19.286554 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:19.286527 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv"] May 21 20:26:19.286717 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:19.286667 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv" May 21 20:26:19.290646 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:19.290608 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2zshn\"" May 21 20:26:19.290764 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:19.290658 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 20:26:19.291573 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:19.291551 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 20:26:19.321402 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:19.321367 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17504843-01d7-400c-8862-eed3337584c8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv\" (UID: \"17504843-01d7-400c-8862-eed3337584c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv" May 21 20:26:19.321721 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:19.321703 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8htqd\" (UniqueName: \"kubernetes.io/projected/17504843-01d7-400c-8862-eed3337584c8-kube-api-access-8htqd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv\" (UID: \"17504843-01d7-400c-8862-eed3337584c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv" May 21 20:26:19.321930 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:19.321912 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17504843-01d7-400c-8862-eed3337584c8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv\" (UID: \"17504843-01d7-400c-8862-eed3337584c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv" May 21 20:26:19.423449 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:19.423416 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17504843-01d7-400c-8862-eed3337584c8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv\" (UID: \"17504843-01d7-400c-8862-eed3337584c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv" May 21 20:26:19.423449 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:19.423455 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17504843-01d7-400c-8862-eed3337584c8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv\" (UID: \"17504843-01d7-400c-8862-eed3337584c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv" May 21 20:26:19.423662 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:19.423492 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8htqd\" (UniqueName: \"kubernetes.io/projected/17504843-01d7-400c-8862-eed3337584c8-kube-api-access-8htqd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv\" (UID: \"17504843-01d7-400c-8862-eed3337584c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv" May 21 20:26:19.423829 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:19.423810 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17504843-01d7-400c-8862-eed3337584c8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv\" (UID: \"17504843-01d7-400c-8862-eed3337584c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv" May 21 20:26:19.423863 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:19.423832 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17504843-01d7-400c-8862-eed3337584c8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv\" (UID: \"17504843-01d7-400c-8862-eed3337584c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv" May 21 20:26:19.444109 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:19.444070 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8htqd\" (UniqueName: \"kubernetes.io/projected/17504843-01d7-400c-8862-eed3337584c8-kube-api-access-8htqd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv\" (UID: \"17504843-01d7-400c-8862-eed3337584c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv" May 21 20:26:19.598583 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:19.598553 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv" May 21 20:26:19.739839 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:19.739818 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv"] May 21 20:26:19.742405 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:26:19.742378 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17504843_01d7_400c_8862_eed3337584c8.slice/crio-af84f20e72dd5b1101957c3cd04801a391a2aed81ee1aace36fe98068c059782 WatchSource:0}: Error finding container af84f20e72dd5b1101957c3cd04801a391a2aed81ee1aace36fe98068c059782: Status 404 returned error can't find the container with id af84f20e72dd5b1101957c3cd04801a391a2aed81ee1aace36fe98068c059782 May 21 20:26:20.665147 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:20.665108 2559 generic.go:358] "Generic (PLEG): container finished" podID="17504843-01d7-400c-8862-eed3337584c8" containerID="ad155fb4aadbcf3a2c61bc9d6eb6bd342f906cd5766f57bb579366e238447329" exitCode=0 May 21 20:26:20.665324 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:20.665210 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv" event={"ID":"17504843-01d7-400c-8862-eed3337584c8","Type":"ContainerDied","Data":"ad155fb4aadbcf3a2c61bc9d6eb6bd342f906cd5766f57bb579366e238447329"} May 21 20:26:20.665324 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:20.665250 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv" event={"ID":"17504843-01d7-400c-8862-eed3337584c8","Type":"ContainerStarted","Data":"af84f20e72dd5b1101957c3cd04801a391a2aed81ee1aace36fe98068c059782"} May 21 20:26:23.293464 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:23.293380 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-2fcrs"] May 21 20:26:23.295350 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:23.295333 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-2fcrs" May 21 20:26:23.298208 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:23.298189 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 21 20:26:23.299156 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:23.299137 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 21 20:26:23.299259 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:23.299179 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-988wv\"" May 21 20:26:23.304798 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:23.304779 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-2fcrs"] May 21 20:26:23.356881 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:23.356858 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/126b2c32-16c8-424b-b96b-8497efceb08e-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-2fcrs\" (UID: \"126b2c32-16c8-424b-b96b-8497efceb08e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-2fcrs" May 21 20:26:23.357025 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:23.356888 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st5cg\" (UniqueName: \"kubernetes.io/projected/126b2c32-16c8-424b-b96b-8497efceb08e-kube-api-access-st5cg\") pod \"cert-manager-cainjector-68b757865b-2fcrs\" (UID: \"126b2c32-16c8-424b-b96b-8497efceb08e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-2fcrs" May 21 20:26:23.457982 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:23.457944 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/126b2c32-16c8-424b-b96b-8497efceb08e-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-2fcrs\" (UID: \"126b2c32-16c8-424b-b96b-8497efceb08e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-2fcrs" May 21 20:26:23.457982 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:23.457985 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-st5cg\" (UniqueName: \"kubernetes.io/projected/126b2c32-16c8-424b-b96b-8497efceb08e-kube-api-access-st5cg\") pod \"cert-manager-cainjector-68b757865b-2fcrs\" (UID: \"126b2c32-16c8-424b-b96b-8497efceb08e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-2fcrs" May 21 20:26:23.467504 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:23.467475 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/126b2c32-16c8-424b-b96b-8497efceb08e-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-2fcrs\" (UID: \"126b2c32-16c8-424b-b96b-8497efceb08e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-2fcrs" May 21 20:26:23.467683 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:23.467661 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-st5cg\" (UniqueName: \"kubernetes.io/projected/126b2c32-16c8-424b-b96b-8497efceb08e-kube-api-access-st5cg\") pod \"cert-manager-cainjector-68b757865b-2fcrs\" (UID: \"126b2c32-16c8-424b-b96b-8497efceb08e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-2fcrs" May 21 20:26:23.618269 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:23.618219 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-2fcrs" May 21 20:26:23.676794 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:23.676684 2559 generic.go:358] "Generic (PLEG): container finished" podID="17504843-01d7-400c-8862-eed3337584c8" containerID="f2314209856708e4ca66d66a61494c6bd10a09401251a76a4487a66994094a4d" exitCode=0 May 21 20:26:23.676794 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:23.676727 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv" event={"ID":"17504843-01d7-400c-8862-eed3337584c8","Type":"ContainerDied","Data":"f2314209856708e4ca66d66a61494c6bd10a09401251a76a4487a66994094a4d"} May 21 20:26:23.750242 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:23.750213 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-2fcrs"] May 21 20:26:23.752886 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:26:23.752855 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod126b2c32_16c8_424b_b96b_8497efceb08e.slice/crio-2d0889cc267e2e920465307773985fdf7694317bf1f9f96e963ef442dccf2b18 WatchSource:0}: Error finding container 2d0889cc267e2e920465307773985fdf7694317bf1f9f96e963ef442dccf2b18: Status 404 returned error can't find the container with id 2d0889cc267e2e920465307773985fdf7694317bf1f9f96e963ef442dccf2b18 May 21 20:26:24.682772 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:24.682736 2559 generic.go:358] "Generic (PLEG): container finished" podID="17504843-01d7-400c-8862-eed3337584c8" containerID="b3849c481ddad9f0c84ff07be7982fb38104773f0c8638cb21333835ed486ed9" exitCode=0 May 21 20:26:24.683241 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:24.682819 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv" event={"ID":"17504843-01d7-400c-8862-eed3337584c8","Type":"ContainerDied","Data":"b3849c481ddad9f0c84ff07be7982fb38104773f0c8638cb21333835ed486ed9"} May 21 20:26:24.684087 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:24.684035 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-2fcrs" event={"ID":"126b2c32-16c8-424b-b96b-8497efceb08e","Type":"ContainerStarted","Data":"2d0889cc267e2e920465307773985fdf7694317bf1f9f96e963ef442dccf2b18"} May 21 20:26:26.379599 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:26.379565 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv" May 21 20:26:26.486122 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:26.486099 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8htqd\" (UniqueName: \"kubernetes.io/projected/17504843-01d7-400c-8862-eed3337584c8-kube-api-access-8htqd\") pod \"17504843-01d7-400c-8862-eed3337584c8\" (UID: \"17504843-01d7-400c-8862-eed3337584c8\") " May 21 20:26:26.486217 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:26.486138 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17504843-01d7-400c-8862-eed3337584c8-util\") pod \"17504843-01d7-400c-8862-eed3337584c8\" (UID: \"17504843-01d7-400c-8862-eed3337584c8\") " May 21 20:26:26.486217 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:26.486207 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17504843-01d7-400c-8862-eed3337584c8-bundle\") pod \"17504843-01d7-400c-8862-eed3337584c8\" (UID: \"17504843-01d7-400c-8862-eed3337584c8\") " May 21 20:26:26.486604 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:26.486582 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17504843-01d7-400c-8862-eed3337584c8-bundle" (OuterVolumeSpecName: "bundle") pod "17504843-01d7-400c-8862-eed3337584c8" (UID: "17504843-01d7-400c-8862-eed3337584c8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:26:26.488083 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:26.488040 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17504843-01d7-400c-8862-eed3337584c8-kube-api-access-8htqd" (OuterVolumeSpecName: "kube-api-access-8htqd") pod "17504843-01d7-400c-8862-eed3337584c8" (UID: "17504843-01d7-400c-8862-eed3337584c8"). InnerVolumeSpecName "kube-api-access-8htqd". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:26:26.492614 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:26.492572 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17504843-01d7-400c-8862-eed3337584c8-util" (OuterVolumeSpecName: "util") pod "17504843-01d7-400c-8862-eed3337584c8" (UID: "17504843-01d7-400c-8862-eed3337584c8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:26:26.587623 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:26.587600 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8htqd\" (UniqueName: \"kubernetes.io/projected/17504843-01d7-400c-8862-eed3337584c8-kube-api-access-8htqd\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:26:26.587623 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:26.587625 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17504843-01d7-400c-8862-eed3337584c8-util\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:26:26.587773 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:26.587640 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17504843-01d7-400c-8862-eed3337584c8-bundle\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:26:26.693181 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:26.693089 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv" event={"ID":"17504843-01d7-400c-8862-eed3337584c8","Type":"ContainerDied","Data":"af84f20e72dd5b1101957c3cd04801a391a2aed81ee1aace36fe98068c059782"} May 21 20:26:26.693181 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:26.693130 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af84f20e72dd5b1101957c3cd04801a391a2aed81ee1aace36fe98068c059782" May 21 20:26:26.693181 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:26.693138 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5rcbv" May 21 20:26:26.694576 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:26.694548 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-2fcrs" event={"ID":"126b2c32-16c8-424b-b96b-8497efceb08e","Type":"ContainerStarted","Data":"8cb0247e2e05105e22130b05925b43b89b4b99968c62fc884e1d40e242b3832d"} May 21 20:26:26.725513 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:26.725468 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-2fcrs" podStartSLOduration=1.053111078 podStartE2EDuration="3.725455884s" podCreationTimestamp="2026-05-21 20:26:23 +0000 UTC" firstStartedPulling="2026-05-21 20:26:23.75487482 +0000 UTC m=+329.753263781" lastFinishedPulling="2026-05-21 20:26:26.427219625 +0000 UTC m=+332.425608587" observedRunningTime="2026-05-21 20:26:26.724328927 +0000 UTC m=+332.722717924" watchObservedRunningTime="2026-05-21 20:26:26.725455884 +0000 UTC m=+332.723844867" May 21 20:26:27.097922 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:27.097882 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-tpn4k"] May 21 20:26:27.098525 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:27.098501 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17504843-01d7-400c-8862-eed3337584c8" containerName="pull" May 21 20:26:27.098640 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:27.098528 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="17504843-01d7-400c-8862-eed3337584c8" containerName="pull" May 21 20:26:27.098640 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:27.098551 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17504843-01d7-400c-8862-eed3337584c8" containerName="extract" May 21 20:26:27.098640 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:27.098559 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="17504843-01d7-400c-8862-eed3337584c8" containerName="extract" May 21 20:26:27.098640 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:27.098573 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17504843-01d7-400c-8862-eed3337584c8" containerName="util" May 21 20:26:27.098640 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:27.098581 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="17504843-01d7-400c-8862-eed3337584c8" containerName="util" May 21 20:26:27.098841 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:27.098702 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="17504843-01d7-400c-8862-eed3337584c8" containerName="extract" May 21 20:26:27.102616 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:27.102594 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-tpn4k" May 21 20:26:27.108774 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:27.108750 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-s9zcg\"" May 21 20:26:27.110611 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:27.110587 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-tpn4k"] May 21 20:26:27.193579 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:27.193552 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56e9c4ca-8984-40b8-aa06-28ea769dad84-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-tpn4k\" (UID: \"56e9c4ca-8984-40b8-aa06-28ea769dad84\") " pod="cert-manager/cert-manager-webhook-587ccfb98-tpn4k" May 21 20:26:27.193746 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:27.193626 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsxrm\" (UniqueName: \"kubernetes.io/projected/56e9c4ca-8984-40b8-aa06-28ea769dad84-kube-api-access-fsxrm\") pod \"cert-manager-webhook-587ccfb98-tpn4k\" (UID: \"56e9c4ca-8984-40b8-aa06-28ea769dad84\") " pod="cert-manager/cert-manager-webhook-587ccfb98-tpn4k" May 21 20:26:27.294720 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:27.294688 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56e9c4ca-8984-40b8-aa06-28ea769dad84-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-tpn4k\" (UID: \"56e9c4ca-8984-40b8-aa06-28ea769dad84\") " pod="cert-manager/cert-manager-webhook-587ccfb98-tpn4k" May 21 20:26:27.294871 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:27.294749 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fsxrm\" (UniqueName: \"kubernetes.io/projected/56e9c4ca-8984-40b8-aa06-28ea769dad84-kube-api-access-fsxrm\") pod \"cert-manager-webhook-587ccfb98-tpn4k\" (UID: \"56e9c4ca-8984-40b8-aa06-28ea769dad84\") " pod="cert-manager/cert-manager-webhook-587ccfb98-tpn4k" May 21 20:26:27.303560 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:27.303531 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56e9c4ca-8984-40b8-aa06-28ea769dad84-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-tpn4k\" (UID: \"56e9c4ca-8984-40b8-aa06-28ea769dad84\") " pod="cert-manager/cert-manager-webhook-587ccfb98-tpn4k" May 21 20:26:27.303717 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:27.303629 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsxrm\" (UniqueName: \"kubernetes.io/projected/56e9c4ca-8984-40b8-aa06-28ea769dad84-kube-api-access-fsxrm\") pod \"cert-manager-webhook-587ccfb98-tpn4k\" (UID: \"56e9c4ca-8984-40b8-aa06-28ea769dad84\") " pod="cert-manager/cert-manager-webhook-587ccfb98-tpn4k" May 21 20:26:27.412584 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:27.412509 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-tpn4k" May 21 20:26:27.541479 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:27.541429 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-tpn4k"] May 21 20:26:27.543491 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:26:27.543468 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56e9c4ca_8984_40b8_aa06_28ea769dad84.slice/crio-2e90c8f83172f6c312b895d9cab49faa81811c97b8fbaa51f489fd85f5536e05 WatchSource:0}: Error finding container 2e90c8f83172f6c312b895d9cab49faa81811c97b8fbaa51f489fd85f5536e05: Status 404 returned error can't find the container with id 2e90c8f83172f6c312b895d9cab49faa81811c97b8fbaa51f489fd85f5536e05 May 21 20:26:27.699170 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:27.699070 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-tpn4k" event={"ID":"56e9c4ca-8984-40b8-aa06-28ea769dad84","Type":"ContainerStarted","Data":"0d6ac589199a59753dd9fd03a2bb6f29635a168d9a9798d5e47a421a7350c09d"} May 21 20:26:27.699170 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:27.699109 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-tpn4k" event={"ID":"56e9c4ca-8984-40b8-aa06-28ea769dad84","Type":"ContainerStarted","Data":"2e90c8f83172f6c312b895d9cab49faa81811c97b8fbaa51f489fd85f5536e05"} May 21 20:26:27.699170 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:27.699132 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-tpn4k" May 21 20:26:27.723295 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:27.723246 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-tpn4k" podStartSLOduration=0.723233934 podStartE2EDuration="723.233934ms" podCreationTimestamp="2026-05-21 20:26:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:26:27.720704412 +0000 UTC m=+333.719093414" watchObservedRunningTime="2026-05-21 20:26:27.723233934 +0000 UTC m=+333.721622916" May 21 20:26:33.704545 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:33.704513 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-tpn4k" May 21 20:26:49.915482 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:49.915392 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx"] May 21 20:26:49.918567 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:49.918550 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx" May 21 20:26:49.923296 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:49.923272 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2zshn\"" May 21 20:26:49.923417 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:49.923274 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 20:26:49.924096 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:49.924082 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 20:26:49.931304 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:49.931285 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx"] May 21 20:26:50.083912 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:50.083874 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5d6242e-dbef-4eeb-9cec-357d29666a98-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx\" (UID: \"a5d6242e-dbef-4eeb-9cec-357d29666a98\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx" May 21 20:26:50.083912 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:50.083918 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5d6242e-dbef-4eeb-9cec-357d29666a98-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx\" (UID: \"a5d6242e-dbef-4eeb-9cec-357d29666a98\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx" May 21 20:26:50.084153 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:50.083943 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht92c\" (UniqueName: \"kubernetes.io/projected/a5d6242e-dbef-4eeb-9cec-357d29666a98-kube-api-access-ht92c\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx\" (UID: \"a5d6242e-dbef-4eeb-9cec-357d29666a98\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx" May 21 20:26:50.185309 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:50.185229 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5d6242e-dbef-4eeb-9cec-357d29666a98-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx\" (UID: \"a5d6242e-dbef-4eeb-9cec-357d29666a98\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx" May 21 20:26:50.185309 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:50.185271 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5d6242e-dbef-4eeb-9cec-357d29666a98-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx\" (UID: \"a5d6242e-dbef-4eeb-9cec-357d29666a98\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx" May 21 20:26:50.185309 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:50.185295 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ht92c\" (UniqueName: \"kubernetes.io/projected/a5d6242e-dbef-4eeb-9cec-357d29666a98-kube-api-access-ht92c\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx\" (UID: \"a5d6242e-dbef-4eeb-9cec-357d29666a98\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx" May 21 20:26:50.185594 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:50.185571 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5d6242e-dbef-4eeb-9cec-357d29666a98-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx\" (UID: \"a5d6242e-dbef-4eeb-9cec-357d29666a98\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx" May 21 20:26:50.185633 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:50.185613 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5d6242e-dbef-4eeb-9cec-357d29666a98-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx\" (UID: \"a5d6242e-dbef-4eeb-9cec-357d29666a98\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx" May 21 20:26:50.199395 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:50.199367 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht92c\" (UniqueName: \"kubernetes.io/projected/a5d6242e-dbef-4eeb-9cec-357d29666a98-kube-api-access-ht92c\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx\" (UID: \"a5d6242e-dbef-4eeb-9cec-357d29666a98\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx" May 21 20:26:50.227182 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:50.227156 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx" May 21 20:26:50.379943 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:50.379918 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx"] May 21 20:26:50.381938 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:26:50.381906 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5d6242e_dbef_4eeb_9cec_357d29666a98.slice/crio-a6e3158bfc4604e4c3c0459d2a50f2e66a847e22389874f1dae5f79d5411c3ae WatchSource:0}: Error finding container a6e3158bfc4604e4c3c0459d2a50f2e66a847e22389874f1dae5f79d5411c3ae: Status 404 returned error can't find the container with id a6e3158bfc4604e4c3c0459d2a50f2e66a847e22389874f1dae5f79d5411c3ae May 21 20:26:50.773528 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:50.773439 2559 generic.go:358] "Generic (PLEG): container finished" podID="a5d6242e-dbef-4eeb-9cec-357d29666a98" containerID="613768cfff25bc2b6dfa948d333ad8ead979c47120d85ac0bec26c4707b69485" exitCode=0 May 21 20:26:50.773681 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:50.773529 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx" event={"ID":"a5d6242e-dbef-4eeb-9cec-357d29666a98","Type":"ContainerDied","Data":"613768cfff25bc2b6dfa948d333ad8ead979c47120d85ac0bec26c4707b69485"} May 21 20:26:50.773681 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:50.773570 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx" event={"ID":"a5d6242e-dbef-4eeb-9cec-357d29666a98","Type":"ContainerStarted","Data":"a6e3158bfc4604e4c3c0459d2a50f2e66a847e22389874f1dae5f79d5411c3ae"} May 21 20:26:51.777780 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:51.777749 2559 generic.go:358] "Generic (PLEG): container finished" podID="a5d6242e-dbef-4eeb-9cec-357d29666a98" containerID="e6b665baeacdb5fd65f0d3468482ea1a078d780f7534c1f0aa2afd4bb47b6ad4" exitCode=0 May 21 20:26:51.778170 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:51.777788 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx" event={"ID":"a5d6242e-dbef-4eeb-9cec-357d29666a98","Type":"ContainerDied","Data":"e6b665baeacdb5fd65f0d3468482ea1a078d780f7534c1f0aa2afd4bb47b6ad4"} May 21 20:26:52.783189 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:52.783152 2559 generic.go:358] "Generic (PLEG): container finished" podID="a5d6242e-dbef-4eeb-9cec-357d29666a98" containerID="2295ffe7dbb84777031e00520eef64b293b53516294eb8e432195896554773bd" exitCode=0 May 21 20:26:52.783551 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:52.783192 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx" event={"ID":"a5d6242e-dbef-4eeb-9cec-357d29666a98","Type":"ContainerDied","Data":"2295ffe7dbb84777031e00520eef64b293b53516294eb8e432195896554773bd"} May 21 20:26:53.909536 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:53.909514 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx" May 21 20:26:54.018888 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:54.018849 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5d6242e-dbef-4eeb-9cec-357d29666a98-bundle\") pod \"a5d6242e-dbef-4eeb-9cec-357d29666a98\" (UID: \"a5d6242e-dbef-4eeb-9cec-357d29666a98\") " May 21 20:26:54.018888 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:54.018893 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5d6242e-dbef-4eeb-9cec-357d29666a98-util\") pod \"a5d6242e-dbef-4eeb-9cec-357d29666a98\" (UID: \"a5d6242e-dbef-4eeb-9cec-357d29666a98\") " May 21 20:26:54.019184 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:54.018913 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ht92c\" (UniqueName: \"kubernetes.io/projected/a5d6242e-dbef-4eeb-9cec-357d29666a98-kube-api-access-ht92c\") pod \"a5d6242e-dbef-4eeb-9cec-357d29666a98\" (UID: \"a5d6242e-dbef-4eeb-9cec-357d29666a98\") " May 21 20:26:54.019773 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:54.019716 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5d6242e-dbef-4eeb-9cec-357d29666a98-bundle" (OuterVolumeSpecName: "bundle") pod "a5d6242e-dbef-4eeb-9cec-357d29666a98" (UID: "a5d6242e-dbef-4eeb-9cec-357d29666a98"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:26:54.021189 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:54.021161 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5d6242e-dbef-4eeb-9cec-357d29666a98-kube-api-access-ht92c" (OuterVolumeSpecName: "kube-api-access-ht92c") pod "a5d6242e-dbef-4eeb-9cec-357d29666a98" (UID: "a5d6242e-dbef-4eeb-9cec-357d29666a98"). InnerVolumeSpecName "kube-api-access-ht92c". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:26:54.024727 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:54.024706 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5d6242e-dbef-4eeb-9cec-357d29666a98-util" (OuterVolumeSpecName: "util") pod "a5d6242e-dbef-4eeb-9cec-357d29666a98" (UID: "a5d6242e-dbef-4eeb-9cec-357d29666a98"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:26:54.119908 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:54.119874 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5d6242e-dbef-4eeb-9cec-357d29666a98-bundle\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:26:54.119908 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:54.119906 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5d6242e-dbef-4eeb-9cec-357d29666a98-util\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:26:54.120101 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:54.119916 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht92c\" (UniqueName: \"kubernetes.io/projected/a5d6242e-dbef-4eeb-9cec-357d29666a98-kube-api-access-ht92c\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:26:54.790833 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:54.790807 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx" May 21 20:26:54.790988 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:54.790801 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d9kkx" event={"ID":"a5d6242e-dbef-4eeb-9cec-357d29666a98","Type":"ContainerDied","Data":"a6e3158bfc4604e4c3c0459d2a50f2e66a847e22389874f1dae5f79d5411c3ae"} May 21 20:26:54.790988 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:26:54.790917 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a6e3158bfc4604e4c3c0459d2a50f2e66a847e22389874f1dae5f79d5411c3ae" May 21 20:27:04.021072 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.021013 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph"] May 21 20:27:04.021563 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.021292 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5d6242e-dbef-4eeb-9cec-357d29666a98" containerName="pull" May 21 20:27:04.021563 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.021302 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5d6242e-dbef-4eeb-9cec-357d29666a98" containerName="pull" May 21 20:27:04.021563 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.021309 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5d6242e-dbef-4eeb-9cec-357d29666a98" containerName="extract" May 21 20:27:04.021563 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.021315 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5d6242e-dbef-4eeb-9cec-357d29666a98" containerName="extract" May 21 20:27:04.021563 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.021326 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5d6242e-dbef-4eeb-9cec-357d29666a98" containerName="util" May 21 20:27:04.021563 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.021332 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5d6242e-dbef-4eeb-9cec-357d29666a98" containerName="util" May 21 20:27:04.021563 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.021383 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="a5d6242e-dbef-4eeb-9cec-357d29666a98" containerName="extract" May 21 20:27:04.025709 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.025692 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph" May 21 20:27:04.028259 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.028233 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 20:27:04.028391 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.028266 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 20:27:04.028391 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.028276 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2zshn\"" May 21 20:27:04.035110 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.035090 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph"] May 21 20:27:04.087197 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.087170 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ef4a6af-17c5-4029-bdff-0e700df60edd-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph\" (UID: \"9ef4a6af-17c5-4029-bdff-0e700df60edd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph" May 21 20:27:04.087358 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.087209 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bsb9\" (UniqueName: \"kubernetes.io/projected/9ef4a6af-17c5-4029-bdff-0e700df60edd-kube-api-access-8bsb9\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph\" (UID: \"9ef4a6af-17c5-4029-bdff-0e700df60edd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph" May 21 20:27:04.087358 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.087316 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ef4a6af-17c5-4029-bdff-0e700df60edd-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph\" (UID: \"9ef4a6af-17c5-4029-bdff-0e700df60edd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph" May 21 20:27:04.187835 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.187794 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8bsb9\" (UniqueName: \"kubernetes.io/projected/9ef4a6af-17c5-4029-bdff-0e700df60edd-kube-api-access-8bsb9\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph\" (UID: \"9ef4a6af-17c5-4029-bdff-0e700df60edd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph" May 21 20:27:04.188007 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.187861 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ef4a6af-17c5-4029-bdff-0e700df60edd-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph\" (UID: \"9ef4a6af-17c5-4029-bdff-0e700df60edd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph" May 21 20:27:04.188007 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.187919 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ef4a6af-17c5-4029-bdff-0e700df60edd-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph\" (UID: \"9ef4a6af-17c5-4029-bdff-0e700df60edd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph" May 21 20:27:04.188306 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.188284 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ef4a6af-17c5-4029-bdff-0e700df60edd-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph\" (UID: \"9ef4a6af-17c5-4029-bdff-0e700df60edd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph" May 21 20:27:04.188306 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.188299 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ef4a6af-17c5-4029-bdff-0e700df60edd-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph\" (UID: \"9ef4a6af-17c5-4029-bdff-0e700df60edd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph" May 21 20:27:04.196274 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.196257 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bsb9\" (UniqueName: \"kubernetes.io/projected/9ef4a6af-17c5-4029-bdff-0e700df60edd-kube-api-access-8bsb9\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph\" (UID: \"9ef4a6af-17c5-4029-bdff-0e700df60edd\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph" May 21 20:27:04.335397 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.335369 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph" May 21 20:27:04.473500 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.473479 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph"] May 21 20:27:04.476047 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:27:04.476017 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ef4a6af_17c5_4029_bdff_0e700df60edd.slice/crio-51f5127101ba3c64d46eaf2a0dfb4830ba38aef6d9fc5b8629f3bd620d2fd629 WatchSource:0}: Error finding container 51f5127101ba3c64d46eaf2a0dfb4830ba38aef6d9fc5b8629f3bd620d2fd629: Status 404 returned error can't find the container with id 51f5127101ba3c64d46eaf2a0dfb4830ba38aef6d9fc5b8629f3bd620d2fd629 May 21 20:27:04.825463 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.825369 2559 generic.go:358] "Generic (PLEG): container finished" podID="9ef4a6af-17c5-4029-bdff-0e700df60edd" containerID="6661dc173f2beaf62f8650cc55275759e118f116db6caa4d73ce7f883b4c7b39" exitCode=0 May 21 20:27:04.825463 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.825420 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph" event={"ID":"9ef4a6af-17c5-4029-bdff-0e700df60edd","Type":"ContainerDied","Data":"6661dc173f2beaf62f8650cc55275759e118f116db6caa4d73ce7f883b4c7b39"} May 21 20:27:04.825463 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:04.825447 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph" event={"ID":"9ef4a6af-17c5-4029-bdff-0e700df60edd","Type":"ContainerStarted","Data":"51f5127101ba3c64d46eaf2a0dfb4830ba38aef6d9fc5b8629f3bd620d2fd629"} May 21 20:27:05.830458 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:05.830419 2559 generic.go:358] "Generic (PLEG): container finished" podID="9ef4a6af-17c5-4029-bdff-0e700df60edd" containerID="7f03d4af596c85892d2e34ac7bc059bcb0b97ad6d71adde092a5c6f393f4c8e2" exitCode=0 May 21 20:27:05.830870 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:05.830505 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph" event={"ID":"9ef4a6af-17c5-4029-bdff-0e700df60edd","Type":"ContainerDied","Data":"7f03d4af596c85892d2e34ac7bc059bcb0b97ad6d71adde092a5c6f393f4c8e2"} May 21 20:27:06.203976 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:06.203895 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj"] May 21 20:27:06.206840 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:06.206825 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj" May 21 20:27:06.211226 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:06.211204 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 20:27:06.211335 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:06.211248 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 20:27:06.211335 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:06.211252 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 20:27:06.212121 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:06.212103 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7tnw8\"" May 21 20:27:06.218345 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:06.218328 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 20:27:06.232833 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:06.232808 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj"] May 21 20:27:06.304554 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:06.304523 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gddwk\" (UniqueName: \"kubernetes.io/projected/f196a1f9-f9f2-46f6-9fb0-421e8b79d27f-kube-api-access-gddwk\") pod \"opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj\" (UID: \"f196a1f9-f9f2-46f6-9fb0-421e8b79d27f\") " pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj" May 21 20:27:06.304701 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:06.304558 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f196a1f9-f9f2-46f6-9fb0-421e8b79d27f-webhook-cert\") pod \"opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj\" (UID: \"f196a1f9-f9f2-46f6-9fb0-421e8b79d27f\") " pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj" May 21 20:27:06.304701 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:06.304589 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f196a1f9-f9f2-46f6-9fb0-421e8b79d27f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj\" (UID: \"f196a1f9-f9f2-46f6-9fb0-421e8b79d27f\") " pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj" May 21 20:27:06.405316 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:06.405280 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gddwk\" (UniqueName: \"kubernetes.io/projected/f196a1f9-f9f2-46f6-9fb0-421e8b79d27f-kube-api-access-gddwk\") pod \"opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj\" (UID: \"f196a1f9-f9f2-46f6-9fb0-421e8b79d27f\") " pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj" May 21 20:27:06.405494 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:06.405320 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f196a1f9-f9f2-46f6-9fb0-421e8b79d27f-webhook-cert\") pod \"opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj\" (UID: \"f196a1f9-f9f2-46f6-9fb0-421e8b79d27f\") " pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj" May 21 20:27:06.405494 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:06.405358 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f196a1f9-f9f2-46f6-9fb0-421e8b79d27f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj\" (UID: \"f196a1f9-f9f2-46f6-9fb0-421e8b79d27f\") " pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj" May 21 20:27:06.407935 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:06.407910 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f196a1f9-f9f2-46f6-9fb0-421e8b79d27f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj\" (UID: \"f196a1f9-f9f2-46f6-9fb0-421e8b79d27f\") " pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj" May 21 20:27:06.407935 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:06.407928 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f196a1f9-f9f2-46f6-9fb0-421e8b79d27f-webhook-cert\") pod \"opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj\" (UID: \"f196a1f9-f9f2-46f6-9fb0-421e8b79d27f\") " pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj" May 21 20:27:06.417293 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:06.417270 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gddwk\" (UniqueName: \"kubernetes.io/projected/f196a1f9-f9f2-46f6-9fb0-421e8b79d27f-kube-api-access-gddwk\") pod \"opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj\" (UID: \"f196a1f9-f9f2-46f6-9fb0-421e8b79d27f\") " pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj" May 21 20:27:06.517646 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:06.517568 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj" May 21 20:27:06.689535 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:06.689501 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj"] May 21 20:27:06.692705 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:27:06.692677 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf196a1f9_f9f2_46f6_9fb0_421e8b79d27f.slice/crio-abf3495bd9a5fe42980c80b0e1059566bd2a40e3c8d70e888805a9496732fac8 WatchSource:0}: Error finding container abf3495bd9a5fe42980c80b0e1059566bd2a40e3c8d70e888805a9496732fac8: Status 404 returned error can't find the container with id abf3495bd9a5fe42980c80b0e1059566bd2a40e3c8d70e888805a9496732fac8 May 21 20:27:06.836444 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:06.836407 2559 generic.go:358] "Generic (PLEG): container finished" podID="9ef4a6af-17c5-4029-bdff-0e700df60edd" containerID="c147453ef77d0c989f2966ff5da0a313f7e2c8931c5b9523aa0c5f11104493b9" exitCode=0 May 21 20:27:06.836819 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:06.836482 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph" event={"ID":"9ef4a6af-17c5-4029-bdff-0e700df60edd","Type":"ContainerDied","Data":"c147453ef77d0c989f2966ff5da0a313f7e2c8931c5b9523aa0c5f11104493b9"} May 21 20:27:06.837522 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:06.837496 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj" event={"ID":"f196a1f9-f9f2-46f6-9fb0-421e8b79d27f","Type":"ContainerStarted","Data":"abf3495bd9a5fe42980c80b0e1059566bd2a40e3c8d70e888805a9496732fac8"} May 21 20:27:07.993214 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:07.993189 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph" May 21 20:27:08.018740 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:08.018707 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ef4a6af-17c5-4029-bdff-0e700df60edd-bundle\") pod \"9ef4a6af-17c5-4029-bdff-0e700df60edd\" (UID: \"9ef4a6af-17c5-4029-bdff-0e700df60edd\") " May 21 20:27:08.018966 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:08.018818 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bsb9\" (UniqueName: \"kubernetes.io/projected/9ef4a6af-17c5-4029-bdff-0e700df60edd-kube-api-access-8bsb9\") pod \"9ef4a6af-17c5-4029-bdff-0e700df60edd\" (UID: \"9ef4a6af-17c5-4029-bdff-0e700df60edd\") " May 21 20:27:08.018966 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:08.018850 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ef4a6af-17c5-4029-bdff-0e700df60edd-util\") pod \"9ef4a6af-17c5-4029-bdff-0e700df60edd\" (UID: \"9ef4a6af-17c5-4029-bdff-0e700df60edd\") " May 21 20:27:08.019828 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:08.019780 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ef4a6af-17c5-4029-bdff-0e700df60edd-bundle" (OuterVolumeSpecName: "bundle") pod "9ef4a6af-17c5-4029-bdff-0e700df60edd" (UID: "9ef4a6af-17c5-4029-bdff-0e700df60edd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:27:08.022477 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:08.022455 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ef4a6af-17c5-4029-bdff-0e700df60edd-kube-api-access-8bsb9" (OuterVolumeSpecName: "kube-api-access-8bsb9") pod "9ef4a6af-17c5-4029-bdff-0e700df60edd" (UID: "9ef4a6af-17c5-4029-bdff-0e700df60edd"). InnerVolumeSpecName "kube-api-access-8bsb9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:27:08.026700 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:08.026678 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ef4a6af-17c5-4029-bdff-0e700df60edd-util" (OuterVolumeSpecName: "util") pod "9ef4a6af-17c5-4029-bdff-0e700df60edd" (UID: "9ef4a6af-17c5-4029-bdff-0e700df60edd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:27:08.120159 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:08.120019 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bsb9\" (UniqueName: \"kubernetes.io/projected/9ef4a6af-17c5-4029-bdff-0e700df60edd-kube-api-access-8bsb9\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:27:08.120159 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:08.120081 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ef4a6af-17c5-4029-bdff-0e700df60edd-util\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:27:08.120159 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:08.120096 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ef4a6af-17c5-4029-bdff-0e700df60edd-bundle\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:27:08.847348 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:08.847268 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph" event={"ID":"9ef4a6af-17c5-4029-bdff-0e700df60edd","Type":"ContainerDied","Data":"51f5127101ba3c64d46eaf2a0dfb4830ba38aef6d9fc5b8629f3bd620d2fd629"} May 21 20:27:08.847348 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:08.847304 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51f5127101ba3c64d46eaf2a0dfb4830ba38aef6d9fc5b8629f3bd620d2fd629" May 21 20:27:08.847348 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:08.847313 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9rvcph" May 21 20:27:09.852475 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:09.852437 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj" event={"ID":"f196a1f9-f9f2-46f6-9fb0-421e8b79d27f","Type":"ContainerStarted","Data":"7a58f721f9eb2469815059b7b9f02ca6833c4fa98fd6e73b83c724d094315d8d"} May 21 20:27:09.852922 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:09.852574 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj" May 21 20:27:09.886386 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:09.886329 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj" podStartSLOduration=1.2039750200000001 podStartE2EDuration="3.88631508s" podCreationTimestamp="2026-05-21 20:27:06 +0000 UTC" firstStartedPulling="2026-05-21 20:27:06.694453169 +0000 UTC m=+372.692842131" lastFinishedPulling="2026-05-21 20:27:09.376793215 +0000 UTC m=+375.375182191" observedRunningTime="2026-05-21 20:27:09.885864697 +0000 UTC m=+375.884253692" watchObservedRunningTime="2026-05-21 20:27:09.88631508 +0000 UTC m=+375.884704135" May 21 20:27:20.857901 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:20.857869 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj" May 21 20:27:23.684669 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.684627 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn"] May 21 20:27:23.685080 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.684925 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ef4a6af-17c5-4029-bdff-0e700df60edd" containerName="extract" May 21 20:27:23.685080 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.684935 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ef4a6af-17c5-4029-bdff-0e700df60edd" containerName="extract" May 21 20:27:23.685080 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.684946 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ef4a6af-17c5-4029-bdff-0e700df60edd" containerName="util" May 21 20:27:23.685080 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.684951 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ef4a6af-17c5-4029-bdff-0e700df60edd" containerName="util" May 21 20:27:23.685080 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.684960 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ef4a6af-17c5-4029-bdff-0e700df60edd" containerName="pull" May 21 20:27:23.685080 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.684966 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ef4a6af-17c5-4029-bdff-0e700df60edd" containerName="pull" May 21 20:27:23.685080 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.685016 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ef4a6af-17c5-4029-bdff-0e700df60edd" containerName="extract" May 21 20:27:23.687275 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.687250 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn" May 21 20:27:23.689691 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.689665 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2zshn\"" May 21 20:27:23.689795 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.689665 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 20:27:23.690512 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.690496 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 20:27:23.704159 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.704136 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn"] May 21 20:27:23.756144 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.756113 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp7v6\" (UniqueName: \"kubernetes.io/projected/ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447-kube-api-access-tp7v6\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn\" (UID: \"ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn" May 21 20:27:23.756278 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.756175 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn\" (UID: \"ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn" May 21 20:27:23.756278 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.756208 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn\" (UID: \"ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn" May 21 20:27:23.856930 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.856892 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tp7v6\" (UniqueName: \"kubernetes.io/projected/ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447-kube-api-access-tp7v6\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn\" (UID: \"ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn" May 21 20:27:23.857120 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.856969 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn\" (UID: \"ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn" May 21 20:27:23.857120 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.857009 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn\" (UID: \"ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn" May 21 20:27:23.857411 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.857382 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn\" (UID: \"ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn" May 21 20:27:23.857411 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.857394 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn\" (UID: \"ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn" May 21 20:27:23.878035 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.878004 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp7v6\" (UniqueName: \"kubernetes.io/projected/ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447-kube-api-access-tp7v6\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn\" (UID: \"ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn" May 21 20:27:23.885713 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.885688 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-547674d64f-vzj82"] May 21 20:27:23.887788 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.887774 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-547674d64f-vzj82" May 21 20:27:23.890010 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.889970 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2nwpx\"" May 21 20:27:23.890199 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.889972 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 20:27:23.890324 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.890308 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 20:27:23.900423 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.900404 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-547674d64f-vzj82"] May 21 20:27:23.957932 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.957843 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/359f3d50-d0be-4770-86c8-f47128531de7-tmp\") pod \"kube-auth-proxy-547674d64f-vzj82\" (UID: \"359f3d50-d0be-4770-86c8-f47128531de7\") " pod="openshift-ingress/kube-auth-proxy-547674d64f-vzj82" May 21 20:27:23.957932 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.957891 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfhxh\" (UniqueName: \"kubernetes.io/projected/359f3d50-d0be-4770-86c8-f47128531de7-kube-api-access-nfhxh\") pod \"kube-auth-proxy-547674d64f-vzj82\" (UID: \"359f3d50-d0be-4770-86c8-f47128531de7\") " pod="openshift-ingress/kube-auth-proxy-547674d64f-vzj82" May 21 20:27:23.958148 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.957966 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/359f3d50-d0be-4770-86c8-f47128531de7-tls-certs\") pod \"kube-auth-proxy-547674d64f-vzj82\" (UID: \"359f3d50-d0be-4770-86c8-f47128531de7\") " pod="openshift-ingress/kube-auth-proxy-547674d64f-vzj82" May 21 20:27:23.998540 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:23.998510 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn" May 21 20:27:24.058582 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:24.058557 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/359f3d50-d0be-4770-86c8-f47128531de7-tmp\") pod \"kube-auth-proxy-547674d64f-vzj82\" (UID: \"359f3d50-d0be-4770-86c8-f47128531de7\") " pod="openshift-ingress/kube-auth-proxy-547674d64f-vzj82" May 21 20:27:24.059107 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:24.059088 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nfhxh\" (UniqueName: \"kubernetes.io/projected/359f3d50-d0be-4770-86c8-f47128531de7-kube-api-access-nfhxh\") pod \"kube-auth-proxy-547674d64f-vzj82\" (UID: \"359f3d50-d0be-4770-86c8-f47128531de7\") " pod="openshift-ingress/kube-auth-proxy-547674d64f-vzj82" May 21 20:27:24.059582 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:24.059568 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/359f3d50-d0be-4770-86c8-f47128531de7-tls-certs\") pod \"kube-auth-proxy-547674d64f-vzj82\" (UID: \"359f3d50-d0be-4770-86c8-f47128531de7\") " pod="openshift-ingress/kube-auth-proxy-547674d64f-vzj82" May 21 20:27:24.061510 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:24.061478 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/359f3d50-d0be-4770-86c8-f47128531de7-tmp\") pod \"kube-auth-proxy-547674d64f-vzj82\" (UID: \"359f3d50-d0be-4770-86c8-f47128531de7\") " pod="openshift-ingress/kube-auth-proxy-547674d64f-vzj82" May 21 20:27:24.062591 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:24.062547 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/359f3d50-d0be-4770-86c8-f47128531de7-tls-certs\") pod \"kube-auth-proxy-547674d64f-vzj82\" (UID: \"359f3d50-d0be-4770-86c8-f47128531de7\") " pod="openshift-ingress/kube-auth-proxy-547674d64f-vzj82" May 21 20:27:24.074266 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:24.074247 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfhxh\" (UniqueName: \"kubernetes.io/projected/359f3d50-d0be-4770-86c8-f47128531de7-kube-api-access-nfhxh\") pod \"kube-auth-proxy-547674d64f-vzj82\" (UID: \"359f3d50-d0be-4770-86c8-f47128531de7\") " pod="openshift-ingress/kube-auth-proxy-547674d64f-vzj82" May 21 20:27:24.142397 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:24.142372 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn"] May 21 20:27:24.145275 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:27:24.145241 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac2b8ee7_8e5a_44ee_bf4d_c3fe72bdd447.slice/crio-4dcb6b525a3d952a9ed939a5d8b07e8005e5ceabf9414e7e96bd318883dbb383 WatchSource:0}: Error finding container 4dcb6b525a3d952a9ed939a5d8b07e8005e5ceabf9414e7e96bd318883dbb383: Status 404 returned error can't find the container with id 4dcb6b525a3d952a9ed939a5d8b07e8005e5ceabf9414e7e96bd318883dbb383 May 21 20:27:24.197462 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:24.197443 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-547674d64f-vzj82" May 21 20:27:24.333194 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:24.333168 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-547674d64f-vzj82"] May 21 20:27:24.335673 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:27:24.335625 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod359f3d50_d0be_4770_86c8_f47128531de7.slice/crio-8873cf6cf67cf5c34523bd6b644e17a201510ea5296dc6971e1e10ec291114f0 WatchSource:0}: Error finding container 8873cf6cf67cf5c34523bd6b644e17a201510ea5296dc6971e1e10ec291114f0: Status 404 returned error can't find the container with id 8873cf6cf67cf5c34523bd6b644e17a201510ea5296dc6971e1e10ec291114f0 May 21 20:27:24.911865 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:24.911823 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-547674d64f-vzj82" event={"ID":"359f3d50-d0be-4770-86c8-f47128531de7","Type":"ContainerStarted","Data":"8873cf6cf67cf5c34523bd6b644e17a201510ea5296dc6971e1e10ec291114f0"} May 21 20:27:24.913640 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:24.913608 2559 generic.go:358] "Generic (PLEG): container finished" podID="ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447" containerID="5a553405d2fb162487d96d90c36d97e80edc555f8cd08cd75cbb9202f05e70ee" exitCode=0 May 21 20:27:24.913782 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:24.913683 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn" event={"ID":"ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447","Type":"ContainerDied","Data":"5a553405d2fb162487d96d90c36d97e80edc555f8cd08cd75cbb9202f05e70ee"} May 21 20:27:24.913782 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:24.913724 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn" event={"ID":"ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447","Type":"ContainerStarted","Data":"4dcb6b525a3d952a9ed939a5d8b07e8005e5ceabf9414e7e96bd318883dbb383"} May 21 20:27:26.922813 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:26.922733 2559 generic.go:358] "Generic (PLEG): container finished" podID="ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447" containerID="3b8066a595dcaf12823da55ed923a964be4763fc31f253c3fcf065ea301448ce" exitCode=0 May 21 20:27:26.922813 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:26.922786 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn" event={"ID":"ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447","Type":"ContainerDied","Data":"3b8066a595dcaf12823da55ed923a964be4763fc31f253c3fcf065ea301448ce"} May 21 20:27:27.928790 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:27.928753 2559 generic.go:358] "Generic (PLEG): container finished" podID="ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447" containerID="8a994ede45ec969ec704d4657032b806eb172020c3a650ec756bda88ab773581" exitCode=0 May 21 20:27:27.929263 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:27.928831 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn" event={"ID":"ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447","Type":"ContainerDied","Data":"8a994ede45ec969ec704d4657032b806eb172020c3a650ec756bda88ab773581"} May 21 20:27:27.930387 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:27.930363 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-547674d64f-vzj82" event={"ID":"359f3d50-d0be-4770-86c8-f47128531de7","Type":"ContainerStarted","Data":"a8f8c910e977e0216e31068f525040d335d2f59831947f5fe465775afbb3c43b"} May 21 20:27:27.973683 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:27.973636 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-547674d64f-vzj82" podStartSLOduration=1.789832799 podStartE2EDuration="4.973623262s" podCreationTimestamp="2026-05-21 20:27:23 +0000 UTC" firstStartedPulling="2026-05-21 20:27:24.337546585 +0000 UTC m=+390.335935546" lastFinishedPulling="2026-05-21 20:27:27.521337044 +0000 UTC m=+393.519726009" observedRunningTime="2026-05-21 20:27:27.973380366 +0000 UTC m=+393.971769370" watchObservedRunningTime="2026-05-21 20:27:27.973623262 +0000 UTC m=+393.972012244" May 21 20:27:28.091928 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:28.091893 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-6xsd5"] May 21 20:27:28.094086 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:28.094069 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-6xsd5" May 21 20:27:28.096490 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:28.096464 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 21 20:27:28.096605 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:28.096531 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-hs77q\"" May 21 20:27:28.104835 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:28.104813 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-6xsd5"] May 21 20:27:28.197303 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:28.197206 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c5fed31-7e58-45bb-aeed-3fcbe924088e-cert\") pod \"odh-model-controller-858dbf95b8-6xsd5\" (UID: \"5c5fed31-7e58-45bb-aeed-3fcbe924088e\") " pod="opendatahub/odh-model-controller-858dbf95b8-6xsd5" May 21 20:27:28.197303 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:28.197282 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s87j\" (UniqueName: \"kubernetes.io/projected/5c5fed31-7e58-45bb-aeed-3fcbe924088e-kube-api-access-2s87j\") pod \"odh-model-controller-858dbf95b8-6xsd5\" (UID: \"5c5fed31-7e58-45bb-aeed-3fcbe924088e\") " pod="opendatahub/odh-model-controller-858dbf95b8-6xsd5" May 21 20:27:28.297977 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:28.297928 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2s87j\" (UniqueName: \"kubernetes.io/projected/5c5fed31-7e58-45bb-aeed-3fcbe924088e-kube-api-access-2s87j\") pod \"odh-model-controller-858dbf95b8-6xsd5\" (UID: \"5c5fed31-7e58-45bb-aeed-3fcbe924088e\") " pod="opendatahub/odh-model-controller-858dbf95b8-6xsd5" May 21 20:27:28.298179 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:28.298014 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c5fed31-7e58-45bb-aeed-3fcbe924088e-cert\") pod \"odh-model-controller-858dbf95b8-6xsd5\" (UID: \"5c5fed31-7e58-45bb-aeed-3fcbe924088e\") " pod="opendatahub/odh-model-controller-858dbf95b8-6xsd5" May 21 20:27:28.298270 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:27:28.298172 2559 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 21 20:27:28.298270 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:27:28.298239 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c5fed31-7e58-45bb-aeed-3fcbe924088e-cert podName:5c5fed31-7e58-45bb-aeed-3fcbe924088e nodeName:}" failed. No retries permitted until 2026-05-21 20:27:28.798219342 +0000 UTC m=+394.796608307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5c5fed31-7e58-45bb-aeed-3fcbe924088e-cert") pod "odh-model-controller-858dbf95b8-6xsd5" (UID: "5c5fed31-7e58-45bb-aeed-3fcbe924088e") : secret "odh-model-controller-webhook-cert" not found May 21 20:27:28.307132 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:28.307102 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s87j\" (UniqueName: \"kubernetes.io/projected/5c5fed31-7e58-45bb-aeed-3fcbe924088e-kube-api-access-2s87j\") pod \"odh-model-controller-858dbf95b8-6xsd5\" (UID: \"5c5fed31-7e58-45bb-aeed-3fcbe924088e\") " pod="opendatahub/odh-model-controller-858dbf95b8-6xsd5" May 21 20:27:28.802819 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:28.802788 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c5fed31-7e58-45bb-aeed-3fcbe924088e-cert\") pod \"odh-model-controller-858dbf95b8-6xsd5\" (UID: \"5c5fed31-7e58-45bb-aeed-3fcbe924088e\") " pod="opendatahub/odh-model-controller-858dbf95b8-6xsd5" May 21 20:27:28.803024 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:27:28.802933 2559 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 21 20:27:28.803024 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:27:28.803001 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c5fed31-7e58-45bb-aeed-3fcbe924088e-cert podName:5c5fed31-7e58-45bb-aeed-3fcbe924088e nodeName:}" failed. No retries permitted until 2026-05-21 20:27:29.802984301 +0000 UTC m=+395.801373262 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5c5fed31-7e58-45bb-aeed-3fcbe924088e-cert") pod "odh-model-controller-858dbf95b8-6xsd5" (UID: "5c5fed31-7e58-45bb-aeed-3fcbe924088e") : secret "odh-model-controller-webhook-cert" not found May 21 20:27:29.062740 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:29.062686 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn" May 21 20:27:29.206407 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:29.206369 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447-bundle\") pod \"ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447\" (UID: \"ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447\") " May 21 20:27:29.206600 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:29.206418 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447-util\") pod \"ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447\" (UID: \"ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447\") " May 21 20:27:29.206600 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:29.206465 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tp7v6\" (UniqueName: \"kubernetes.io/projected/ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447-kube-api-access-tp7v6\") pod \"ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447\" (UID: \"ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447\") " May 21 20:27:29.207292 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:29.207260 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447-bundle" (OuterVolumeSpecName: "bundle") pod "ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447" (UID: "ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:27:29.208726 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:29.208701 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447-kube-api-access-tp7v6" (OuterVolumeSpecName: "kube-api-access-tp7v6") pod "ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447" (UID: "ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447"). InnerVolumeSpecName "kube-api-access-tp7v6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:27:29.211277 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:29.211246 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447-util" (OuterVolumeSpecName: "util") pod "ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447" (UID: "ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:27:29.307442 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:29.307407 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447-bundle\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:27:29.307442 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:29.307436 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447-util\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:27:29.307442 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:29.307449 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp7v6\" (UniqueName: \"kubernetes.io/projected/ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447-kube-api-access-tp7v6\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:27:29.812272 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:29.812229 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c5fed31-7e58-45bb-aeed-3fcbe924088e-cert\") pod \"odh-model-controller-858dbf95b8-6xsd5\" (UID: \"5c5fed31-7e58-45bb-aeed-3fcbe924088e\") " pod="opendatahub/odh-model-controller-858dbf95b8-6xsd5" May 21 20:27:29.814819 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:29.814794 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c5fed31-7e58-45bb-aeed-3fcbe924088e-cert\") pod \"odh-model-controller-858dbf95b8-6xsd5\" (UID: \"5c5fed31-7e58-45bb-aeed-3fcbe924088e\") " pod="opendatahub/odh-model-controller-858dbf95b8-6xsd5" May 21 20:27:29.904846 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:29.904813 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-6xsd5" May 21 20:27:29.940094 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:29.940037 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn" event={"ID":"ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447","Type":"ContainerDied","Data":"4dcb6b525a3d952a9ed939a5d8b07e8005e5ceabf9414e7e96bd318883dbb383"} May 21 20:27:29.940221 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:29.940105 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4dcb6b525a3d952a9ed939a5d8b07e8005e5ceabf9414e7e96bd318883dbb383" May 21 20:27:29.940221 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:29.940067 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48358wmfn" May 21 20:27:30.032855 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:30.032830 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-6xsd5"] May 21 20:27:30.035184 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:27:30.035154 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c5fed31_7e58_45bb_aeed_3fcbe924088e.slice/crio-98eb4937dde584caab3e7c7707ed1e22447d4433caecb11b4d1cf1faf4abbef2 WatchSource:0}: Error finding container 98eb4937dde584caab3e7c7707ed1e22447d4433caecb11b4d1cf1faf4abbef2: Status 404 returned error can't find the container with id 98eb4937dde584caab3e7c7707ed1e22447d4433caecb11b4d1cf1faf4abbef2 May 21 20:27:30.954373 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:30.954329 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-6xsd5" event={"ID":"5c5fed31-7e58-45bb-aeed-3fcbe924088e","Type":"ContainerStarted","Data":"98eb4937dde584caab3e7c7707ed1e22447d4433caecb11b4d1cf1faf4abbef2"} May 21 20:27:32.963516 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:32.963476 2559 generic.go:358] "Generic (PLEG): container finished" podID="5c5fed31-7e58-45bb-aeed-3fcbe924088e" containerID="a9968ea257752942fd741f307d8335ae2877e5a9bc23ba6747a99ca4ae65f652" exitCode=1 May 21 20:27:32.963936 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:32.963544 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-6xsd5" event={"ID":"5c5fed31-7e58-45bb-aeed-3fcbe924088e","Type":"ContainerDied","Data":"a9968ea257752942fd741f307d8335ae2877e5a9bc23ba6747a99ca4ae65f652"} May 21 20:27:32.963936 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:32.963770 2559 scope.go:117] "RemoveContainer" containerID="a9968ea257752942fd741f307d8335ae2877e5a9bc23ba6747a99ca4ae65f652" May 21 20:27:33.968783 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:33.968744 2559 generic.go:358] "Generic (PLEG): container finished" podID="5c5fed31-7e58-45bb-aeed-3fcbe924088e" containerID="504824f56b64c5fd7fb2636392f3300c7e6b410b9ee0bc46f0ab3eb046784a06" exitCode=1 May 21 20:27:33.969195 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:33.968808 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-6xsd5" event={"ID":"5c5fed31-7e58-45bb-aeed-3fcbe924088e","Type":"ContainerDied","Data":"504824f56b64c5fd7fb2636392f3300c7e6b410b9ee0bc46f0ab3eb046784a06"} May 21 20:27:33.969195 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:33.968849 2559 scope.go:117] "RemoveContainer" containerID="a9968ea257752942fd741f307d8335ae2877e5a9bc23ba6747a99ca4ae65f652" May 21 20:27:33.969195 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:33.969073 2559 scope.go:117] "RemoveContainer" containerID="504824f56b64c5fd7fb2636392f3300c7e6b410b9ee0bc46f0ab3eb046784a06" May 21 20:27:33.969318 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:27:33.969268 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-6xsd5_opendatahub(5c5fed31-7e58-45bb-aeed-3fcbe924088e)\"" pod="opendatahub/odh-model-controller-858dbf95b8-6xsd5" podUID="5c5fed31-7e58-45bb-aeed-3fcbe924088e" May 21 20:27:34.083510 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:34.083478 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-xb4fw"] May 21 20:27:34.083783 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:34.083770 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447" containerName="util" May 21 20:27:34.083820 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:34.083785 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447" containerName="util" May 21 20:27:34.083820 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:34.083798 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447" containerName="pull" May 21 20:27:34.083820 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:34.083803 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447" containerName="pull" May 21 20:27:34.083820 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:34.083817 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447" containerName="extract" May 21 20:27:34.083956 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:34.083822 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447" containerName="extract" May 21 20:27:34.083956 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:34.083868 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac2b8ee7-8e5a-44ee-bf4d-c3fe72bdd447" containerName="extract" May 21 20:27:34.087891 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:34.087870 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-xb4fw" May 21 20:27:34.090279 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:34.090258 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 21 20:27:34.090384 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:34.090279 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-m6svv\"" May 21 20:27:34.097557 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:34.097529 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-xb4fw"] May 21 20:27:34.253027 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:34.252935 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37e66772-12f6-4f55-bdad-8a5721bfa24c-cert\") pod \"kserve-controller-manager-856948b99f-xb4fw\" (UID: \"37e66772-12f6-4f55-bdad-8a5721bfa24c\") " pod="opendatahub/kserve-controller-manager-856948b99f-xb4fw" May 21 20:27:34.253027 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:34.252973 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ghld\" (UniqueName: \"kubernetes.io/projected/37e66772-12f6-4f55-bdad-8a5721bfa24c-kube-api-access-8ghld\") pod \"kserve-controller-manager-856948b99f-xb4fw\" (UID: \"37e66772-12f6-4f55-bdad-8a5721bfa24c\") " pod="opendatahub/kserve-controller-manager-856948b99f-xb4fw" May 21 20:27:34.353960 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:34.353927 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37e66772-12f6-4f55-bdad-8a5721bfa24c-cert\") pod \"kserve-controller-manager-856948b99f-xb4fw\" (UID: \"37e66772-12f6-4f55-bdad-8a5721bfa24c\") " pod="opendatahub/kserve-controller-manager-856948b99f-xb4fw" May 21 20:27:34.353960 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:34.353964 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ghld\" (UniqueName: \"kubernetes.io/projected/37e66772-12f6-4f55-bdad-8a5721bfa24c-kube-api-access-8ghld\") pod \"kserve-controller-manager-856948b99f-xb4fw\" (UID: \"37e66772-12f6-4f55-bdad-8a5721bfa24c\") " pod="opendatahub/kserve-controller-manager-856948b99f-xb4fw" May 21 20:27:34.354213 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:27:34.354098 2559 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 21 20:27:34.354213 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:27:34.354165 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37e66772-12f6-4f55-bdad-8a5721bfa24c-cert podName:37e66772-12f6-4f55-bdad-8a5721bfa24c nodeName:}" failed. No retries permitted until 2026-05-21 20:27:34.854146831 +0000 UTC m=+400.852535791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/37e66772-12f6-4f55-bdad-8a5721bfa24c-cert") pod "kserve-controller-manager-856948b99f-xb4fw" (UID: "37e66772-12f6-4f55-bdad-8a5721bfa24c") : secret "kserve-webhook-server-cert" not found May 21 20:27:34.370067 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:34.370032 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ghld\" (UniqueName: \"kubernetes.io/projected/37e66772-12f6-4f55-bdad-8a5721bfa24c-kube-api-access-8ghld\") pod \"kserve-controller-manager-856948b99f-xb4fw\" (UID: \"37e66772-12f6-4f55-bdad-8a5721bfa24c\") " pod="opendatahub/kserve-controller-manager-856948b99f-xb4fw" May 21 20:27:34.858705 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:34.858667 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37e66772-12f6-4f55-bdad-8a5721bfa24c-cert\") pod \"kserve-controller-manager-856948b99f-xb4fw\" (UID: \"37e66772-12f6-4f55-bdad-8a5721bfa24c\") " pod="opendatahub/kserve-controller-manager-856948b99f-xb4fw" May 21 20:27:34.861252 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:34.861230 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37e66772-12f6-4f55-bdad-8a5721bfa24c-cert\") pod \"kserve-controller-manager-856948b99f-xb4fw\" (UID: \"37e66772-12f6-4f55-bdad-8a5721bfa24c\") " pod="opendatahub/kserve-controller-manager-856948b99f-xb4fw" May 21 20:27:34.973936 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:34.973906 2559 scope.go:117] "RemoveContainer" containerID="504824f56b64c5fd7fb2636392f3300c7e6b410b9ee0bc46f0ab3eb046784a06" May 21 20:27:34.974321 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:27:34.974104 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-6xsd5_opendatahub(5c5fed31-7e58-45bb-aeed-3fcbe924088e)\"" pod="opendatahub/odh-model-controller-858dbf95b8-6xsd5" podUID="5c5fed31-7e58-45bb-aeed-3fcbe924088e" May 21 20:27:34.999153 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:34.999121 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-xb4fw" May 21 20:27:35.129657 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:35.129602 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-xb4fw"] May 21 20:27:35.131798 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:27:35.131770 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e66772_12f6_4f55_bdad_8a5721bfa24c.slice/crio-cd36f52376d131a528dbabeda694c34678a686d3d1ab367021fe22d10b8d7d89 WatchSource:0}: Error finding container cd36f52376d131a528dbabeda694c34678a686d3d1ab367021fe22d10b8d7d89: Status 404 returned error can't find the container with id cd36f52376d131a528dbabeda694c34678a686d3d1ab367021fe22d10b8d7d89 May 21 20:27:35.978830 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:35.978796 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-xb4fw" event={"ID":"37e66772-12f6-4f55-bdad-8a5721bfa24c","Type":"ContainerStarted","Data":"cd36f52376d131a528dbabeda694c34678a686d3d1ab367021fe22d10b8d7d89"} May 21 20:27:38.272795 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:38.272745 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs"] May 21 20:27:38.277981 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:38.277949 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs" May 21 20:27:38.280784 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:38.280759 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2zshn\"" May 21 20:27:38.281329 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:38.281308 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 20:27:38.281585 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:38.281561 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 20:27:38.288459 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:38.288434 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs"] May 21 20:27:38.388490 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:38.388449 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9153b8c3-232e-4f19-adf7-73f52ae460e3-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs\" (UID: \"9153b8c3-232e-4f19-adf7-73f52ae460e3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs" May 21 20:27:38.388673 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:38.388542 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8z2h\" (UniqueName: \"kubernetes.io/projected/9153b8c3-232e-4f19-adf7-73f52ae460e3-kube-api-access-k8z2h\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs\" (UID: \"9153b8c3-232e-4f19-adf7-73f52ae460e3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs" May 21 20:27:38.388673 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:38.388589 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9153b8c3-232e-4f19-adf7-73f52ae460e3-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs\" (UID: \"9153b8c3-232e-4f19-adf7-73f52ae460e3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs" May 21 20:27:38.490047 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:38.490019 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9153b8c3-232e-4f19-adf7-73f52ae460e3-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs\" (UID: \"9153b8c3-232e-4f19-adf7-73f52ae460e3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs" May 21 20:27:38.490175 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:38.490120 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8z2h\" (UniqueName: \"kubernetes.io/projected/9153b8c3-232e-4f19-adf7-73f52ae460e3-kube-api-access-k8z2h\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs\" (UID: \"9153b8c3-232e-4f19-adf7-73f52ae460e3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs" May 21 20:27:38.490175 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:38.490165 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9153b8c3-232e-4f19-adf7-73f52ae460e3-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs\" (UID: \"9153b8c3-232e-4f19-adf7-73f52ae460e3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs" May 21 20:27:38.490360 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:38.490342 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9153b8c3-232e-4f19-adf7-73f52ae460e3-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs\" (UID: \"9153b8c3-232e-4f19-adf7-73f52ae460e3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs" May 21 20:27:38.490546 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:38.490518 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9153b8c3-232e-4f19-adf7-73f52ae460e3-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs\" (UID: \"9153b8c3-232e-4f19-adf7-73f52ae460e3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs" May 21 20:27:38.503966 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:38.503942 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8z2h\" (UniqueName: \"kubernetes.io/projected/9153b8c3-232e-4f19-adf7-73f52ae460e3-kube-api-access-k8z2h\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs\" (UID: \"9153b8c3-232e-4f19-adf7-73f52ae460e3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs" May 21 20:27:38.590866 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:38.590839 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs" May 21 20:27:38.767362 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:38.767328 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs"] May 21 20:27:38.774164 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:27:38.774127 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9153b8c3_232e_4f19_adf7_73f52ae460e3.slice/crio-725fe4020669cafdc3adb84df989555a2083df829c4cba1a5513aa3898dc4fd4 WatchSource:0}: Error finding container 725fe4020669cafdc3adb84df989555a2083df829c4cba1a5513aa3898dc4fd4: Status 404 returned error can't find the container with id 725fe4020669cafdc3adb84df989555a2083df829c4cba1a5513aa3898dc4fd4 May 21 20:27:38.993905 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:38.993869 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-xb4fw" event={"ID":"37e66772-12f6-4f55-bdad-8a5721bfa24c","Type":"ContainerStarted","Data":"f81efce4bb8d3773dbeea76d88523bd3100701b97c62913ae830e7b492dd572f"} May 21 20:27:38.994107 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:38.994010 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-xb4fw" May 21 20:27:38.995457 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:38.995434 2559 generic.go:358] "Generic (PLEG): container finished" podID="9153b8c3-232e-4f19-adf7-73f52ae460e3" containerID="3f910dc038af1a73a814f2de04a444f40cf8f807b9c93ea6dacdd684383b15ca" exitCode=0 May 21 20:27:38.995550 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:38.995464 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs" event={"ID":"9153b8c3-232e-4f19-adf7-73f52ae460e3","Type":"ContainerDied","Data":"3f910dc038af1a73a814f2de04a444f40cf8f807b9c93ea6dacdd684383b15ca"} May 21 20:27:38.995550 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:38.995481 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs" event={"ID":"9153b8c3-232e-4f19-adf7-73f52ae460e3","Type":"ContainerStarted","Data":"725fe4020669cafdc3adb84df989555a2083df829c4cba1a5513aa3898dc4fd4"} May 21 20:27:39.020808 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:39.020771 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-xb4fw" podStartSLOduration=1.6913708920000001 podStartE2EDuration="5.020759519s" podCreationTimestamp="2026-05-21 20:27:34 +0000 UTC" firstStartedPulling="2026-05-21 20:27:35.133137211 +0000 UTC m=+401.131526176" lastFinishedPulling="2026-05-21 20:27:38.462525825 +0000 UTC m=+404.460914803" observedRunningTime="2026-05-21 20:27:39.019607999 +0000 UTC m=+405.017996996" watchObservedRunningTime="2026-05-21 20:27:39.020759519 +0000 UTC m=+405.019148502" May 21 20:27:39.242036 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:39.241996 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-nrgqt"] May 21 20:27:39.252023 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:39.251981 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-nrgqt" May 21 20:27:39.259810 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:39.259783 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-pjxdn\"" May 21 20:27:39.259948 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:39.259790 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 21 20:27:39.260175 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:39.260131 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 21 20:27:39.263572 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:39.263536 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-nrgqt"] May 21 20:27:39.398570 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:39.398532 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/d274e9a0-eaa8-4fa4-a048-e6aa68a2fe3a-operator-config\") pod \"servicemesh-operator3-55f49c5f94-nrgqt\" (UID: \"d274e9a0-eaa8-4fa4-a048-e6aa68a2fe3a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-nrgqt" May 21 20:27:39.398570 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:39.398571 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fznbp\" (UniqueName: \"kubernetes.io/projected/d274e9a0-eaa8-4fa4-a048-e6aa68a2fe3a-kube-api-access-fznbp\") pod \"servicemesh-operator3-55f49c5f94-nrgqt\" (UID: \"d274e9a0-eaa8-4fa4-a048-e6aa68a2fe3a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-nrgqt" May 21 20:27:39.500100 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:39.500027 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/d274e9a0-eaa8-4fa4-a048-e6aa68a2fe3a-operator-config\") pod \"servicemesh-operator3-55f49c5f94-nrgqt\" (UID: \"d274e9a0-eaa8-4fa4-a048-e6aa68a2fe3a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-nrgqt" May 21 20:27:39.500100 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:39.500087 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fznbp\" (UniqueName: \"kubernetes.io/projected/d274e9a0-eaa8-4fa4-a048-e6aa68a2fe3a-kube-api-access-fznbp\") pod \"servicemesh-operator3-55f49c5f94-nrgqt\" (UID: \"d274e9a0-eaa8-4fa4-a048-e6aa68a2fe3a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-nrgqt" May 21 20:27:39.502681 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:39.502657 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/d274e9a0-eaa8-4fa4-a048-e6aa68a2fe3a-operator-config\") pod \"servicemesh-operator3-55f49c5f94-nrgqt\" (UID: \"d274e9a0-eaa8-4fa4-a048-e6aa68a2fe3a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-nrgqt" May 21 20:27:39.514263 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:39.514239 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fznbp\" (UniqueName: \"kubernetes.io/projected/d274e9a0-eaa8-4fa4-a048-e6aa68a2fe3a-kube-api-access-fznbp\") pod \"servicemesh-operator3-55f49c5f94-nrgqt\" (UID: \"d274e9a0-eaa8-4fa4-a048-e6aa68a2fe3a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-nrgqt" May 21 20:27:39.562218 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:39.562188 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-nrgqt" May 21 20:27:39.704143 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:39.704112 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-nrgqt"] May 21 20:27:39.705893 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:27:39.705863 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd274e9a0_eaa8_4fa4_a048_e6aa68a2fe3a.slice/crio-c37d51546116e30fc6c46f0bb3999329710655d56a86b5cffe81a81f383f2524 WatchSource:0}: Error finding container c37d51546116e30fc6c46f0bb3999329710655d56a86b5cffe81a81f383f2524: Status 404 returned error can't find the container with id c37d51546116e30fc6c46f0bb3999329710655d56a86b5cffe81a81f383f2524 May 21 20:27:39.905543 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:39.905509 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-6xsd5" May 21 20:27:39.905922 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:39.905907 2559 scope.go:117] "RemoveContainer" containerID="504824f56b64c5fd7fb2636392f3300c7e6b410b9ee0bc46f0ab3eb046784a06" May 21 20:27:39.906130 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:27:39.906111 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-6xsd5_opendatahub(5c5fed31-7e58-45bb-aeed-3fcbe924088e)\"" pod="opendatahub/odh-model-controller-858dbf95b8-6xsd5" podUID="5c5fed31-7e58-45bb-aeed-3fcbe924088e" May 21 20:27:40.002229 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:40.002200 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-nrgqt" event={"ID":"d274e9a0-eaa8-4fa4-a048-e6aa68a2fe3a","Type":"ContainerStarted","Data":"c37d51546116e30fc6c46f0bb3999329710655d56a86b5cffe81a81f383f2524"} May 21 20:27:41.014733 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:41.014686 2559 generic.go:358] "Generic (PLEG): container finished" podID="9153b8c3-232e-4f19-adf7-73f52ae460e3" containerID="03cd0cbf13f5307129aeb0a1bfa63778ad6a5febabbd8a11aebb12876a2a8f1e" exitCode=0 May 21 20:27:41.015231 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:41.014802 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs" event={"ID":"9153b8c3-232e-4f19-adf7-73f52ae460e3","Type":"ContainerDied","Data":"03cd0cbf13f5307129aeb0a1bfa63778ad6a5febabbd8a11aebb12876a2a8f1e"} May 21 20:27:42.020795 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:42.020760 2559 generic.go:358] "Generic (PLEG): container finished" podID="9153b8c3-232e-4f19-adf7-73f52ae460e3" containerID="6be211bfc38b9d275e39372cee3e0a7575e710be61f988c0706caea2bf77a3aa" exitCode=0 May 21 20:27:42.021264 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:42.020866 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs" event={"ID":"9153b8c3-232e-4f19-adf7-73f52ae460e3","Type":"ContainerDied","Data":"6be211bfc38b9d275e39372cee3e0a7575e710be61f988c0706caea2bf77a3aa"} May 21 20:27:43.027007 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:43.026955 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-nrgqt" event={"ID":"d274e9a0-eaa8-4fa4-a048-e6aa68a2fe3a","Type":"ContainerStarted","Data":"2e81ea1e6a751c49a3711df42207494c00c30400e2fcd62b9242aa3619295051"} May 21 20:27:43.027436 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:43.027037 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-nrgqt" May 21 20:27:43.060413 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:43.060268 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-nrgqt" podStartSLOduration=0.974541668 podStartE2EDuration="4.060249523s" podCreationTimestamp="2026-05-21 20:27:39 +0000 UTC" firstStartedPulling="2026-05-21 20:27:39.708293907 +0000 UTC m=+405.706682868" lastFinishedPulling="2026-05-21 20:27:42.794001759 +0000 UTC m=+408.792390723" observedRunningTime="2026-05-21 20:27:43.057004792 +0000 UTC m=+409.055393777" watchObservedRunningTime="2026-05-21 20:27:43.060249523 +0000 UTC m=+409.058638506" May 21 20:27:43.177702 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:43.177680 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs" May 21 20:27:43.339698 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:43.339665 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9153b8c3-232e-4f19-adf7-73f52ae460e3-util\") pod \"9153b8c3-232e-4f19-adf7-73f52ae460e3\" (UID: \"9153b8c3-232e-4f19-adf7-73f52ae460e3\") " May 21 20:27:43.339698 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:43.339705 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8z2h\" (UniqueName: \"kubernetes.io/projected/9153b8c3-232e-4f19-adf7-73f52ae460e3-kube-api-access-k8z2h\") pod \"9153b8c3-232e-4f19-adf7-73f52ae460e3\" (UID: \"9153b8c3-232e-4f19-adf7-73f52ae460e3\") " May 21 20:27:43.339947 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:43.339725 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9153b8c3-232e-4f19-adf7-73f52ae460e3-bundle\") pod \"9153b8c3-232e-4f19-adf7-73f52ae460e3\" (UID: \"9153b8c3-232e-4f19-adf7-73f52ae460e3\") " May 21 20:27:43.341010 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:43.340976 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9153b8c3-232e-4f19-adf7-73f52ae460e3-bundle" (OuterVolumeSpecName: "bundle") pod "9153b8c3-232e-4f19-adf7-73f52ae460e3" (UID: "9153b8c3-232e-4f19-adf7-73f52ae460e3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:27:43.342112 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:43.342084 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9153b8c3-232e-4f19-adf7-73f52ae460e3-kube-api-access-k8z2h" (OuterVolumeSpecName: "kube-api-access-k8z2h") pod "9153b8c3-232e-4f19-adf7-73f52ae460e3" (UID: "9153b8c3-232e-4f19-adf7-73f52ae460e3"). InnerVolumeSpecName "kube-api-access-k8z2h". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:27:43.347258 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:43.347233 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9153b8c3-232e-4f19-adf7-73f52ae460e3-util" (OuterVolumeSpecName: "util") pod "9153b8c3-232e-4f19-adf7-73f52ae460e3" (UID: "9153b8c3-232e-4f19-adf7-73f52ae460e3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:27:43.441329 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:43.441287 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9153b8c3-232e-4f19-adf7-73f52ae460e3-util\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:27:43.441329 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:43.441330 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8z2h\" (UniqueName: \"kubernetes.io/projected/9153b8c3-232e-4f19-adf7-73f52ae460e3-kube-api-access-k8z2h\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:27:43.441582 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:43.441346 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9153b8c3-232e-4f19-adf7-73f52ae460e3-bundle\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:27:44.034129 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.034090 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs" event={"ID":"9153b8c3-232e-4f19-adf7-73f52ae460e3","Type":"ContainerDied","Data":"725fe4020669cafdc3adb84df989555a2083df829c4cba1a5513aa3898dc4fd4"} May 21 20:27:44.034129 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.034135 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="725fe4020669cafdc3adb84df989555a2083df829c4cba1a5513aa3898dc4fd4" May 21 20:27:44.034531 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.034114 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762andbvs" May 21 20:27:44.691983 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.691941 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g"] May 21 20:27:44.692296 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.692283 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9153b8c3-232e-4f19-adf7-73f52ae460e3" containerName="extract" May 21 20:27:44.692340 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.692299 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9153b8c3-232e-4f19-adf7-73f52ae460e3" containerName="extract" May 21 20:27:44.692340 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.692312 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9153b8c3-232e-4f19-adf7-73f52ae460e3" containerName="pull" May 21 20:27:44.692340 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.692318 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9153b8c3-232e-4f19-adf7-73f52ae460e3" containerName="pull" May 21 20:27:44.692340 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.692330 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9153b8c3-232e-4f19-adf7-73f52ae460e3" containerName="util" May 21 20:27:44.692340 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.692335 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9153b8c3-232e-4f19-adf7-73f52ae460e3" containerName="util" May 21 20:27:44.692485 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.692390 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="9153b8c3-232e-4f19-adf7-73f52ae460e3" containerName="extract" May 21 20:27:44.694296 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.694280 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:44.696828 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.696790 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 21 20:27:44.696828 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.696809 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 21 20:27:44.697285 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.697225 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 21 20:27:44.697509 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.697488 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 21 20:27:44.697598 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.697541 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jn9jp\"" May 21 20:27:44.713302 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.713274 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g"] May 21 20:27:44.750930 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.750894 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/38d35562-7801-494e-8853-417c5d5a1fbb-cacerts\") pod \"istiod-openshift-gateway-798958bb55-mjx7g\" (UID: \"38d35562-7801-494e-8853-417c5d5a1fbb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:44.750930 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.750930 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/38d35562-7801-494e-8853-417c5d5a1fbb-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-mjx7g\" (UID: \"38d35562-7801-494e-8853-417c5d5a1fbb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:44.751140 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.750955 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/38d35562-7801-494e-8853-417c5d5a1fbb-local-certs\") pod \"istiod-openshift-gateway-798958bb55-mjx7g\" (UID: \"38d35562-7801-494e-8853-417c5d5a1fbb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:44.751140 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.751067 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/38d35562-7801-494e-8853-417c5d5a1fbb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-mjx7g\" (UID: \"38d35562-7801-494e-8853-417c5d5a1fbb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:44.751140 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.751111 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/38d35562-7801-494e-8853-417c5d5a1fbb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-mjx7g\" (UID: \"38d35562-7801-494e-8853-417c5d5a1fbb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:44.751140 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.751139 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgxcr\" (UniqueName: \"kubernetes.io/projected/38d35562-7801-494e-8853-417c5d5a1fbb-kube-api-access-xgxcr\") pod \"istiod-openshift-gateway-798958bb55-mjx7g\" (UID: \"38d35562-7801-494e-8853-417c5d5a1fbb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:44.751276 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.751168 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38d35562-7801-494e-8853-417c5d5a1fbb-istio-token\") pod \"istiod-openshift-gateway-798958bb55-mjx7g\" (UID: \"38d35562-7801-494e-8853-417c5d5a1fbb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:44.851762 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.851724 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/38d35562-7801-494e-8853-417c5d5a1fbb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-mjx7g\" (UID: \"38d35562-7801-494e-8853-417c5d5a1fbb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:44.851961 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.851770 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/38d35562-7801-494e-8853-417c5d5a1fbb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-mjx7g\" (UID: \"38d35562-7801-494e-8853-417c5d5a1fbb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:44.852104 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.852076 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xgxcr\" (UniqueName: \"kubernetes.io/projected/38d35562-7801-494e-8853-417c5d5a1fbb-kube-api-access-xgxcr\") pod \"istiod-openshift-gateway-798958bb55-mjx7g\" (UID: \"38d35562-7801-494e-8853-417c5d5a1fbb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:44.852170 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.852140 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38d35562-7801-494e-8853-417c5d5a1fbb-istio-token\") pod \"istiod-openshift-gateway-798958bb55-mjx7g\" (UID: \"38d35562-7801-494e-8853-417c5d5a1fbb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:44.852254 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.852238 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/38d35562-7801-494e-8853-417c5d5a1fbb-cacerts\") pod \"istiod-openshift-gateway-798958bb55-mjx7g\" (UID: \"38d35562-7801-494e-8853-417c5d5a1fbb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:44.852314 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.852269 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/38d35562-7801-494e-8853-417c5d5a1fbb-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-mjx7g\" (UID: \"38d35562-7801-494e-8853-417c5d5a1fbb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:44.852314 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.852306 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/38d35562-7801-494e-8853-417c5d5a1fbb-local-certs\") pod \"istiod-openshift-gateway-798958bb55-mjx7g\" (UID: \"38d35562-7801-494e-8853-417c5d5a1fbb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:44.852460 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.852437 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/38d35562-7801-494e-8853-417c5d5a1fbb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-mjx7g\" (UID: \"38d35562-7801-494e-8853-417c5d5a1fbb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:44.854723 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.854695 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/38d35562-7801-494e-8853-417c5d5a1fbb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-mjx7g\" (UID: \"38d35562-7801-494e-8853-417c5d5a1fbb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:44.854951 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.854934 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/38d35562-7801-494e-8853-417c5d5a1fbb-local-certs\") pod \"istiod-openshift-gateway-798958bb55-mjx7g\" (UID: \"38d35562-7801-494e-8853-417c5d5a1fbb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:44.855091 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.855074 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/38d35562-7801-494e-8853-417c5d5a1fbb-cacerts\") pod \"istiod-openshift-gateway-798958bb55-mjx7g\" (UID: \"38d35562-7801-494e-8853-417c5d5a1fbb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:44.855174 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.855154 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/38d35562-7801-494e-8853-417c5d5a1fbb-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-mjx7g\" (UID: \"38d35562-7801-494e-8853-417c5d5a1fbb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:44.861865 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.861833 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgxcr\" (UniqueName: \"kubernetes.io/projected/38d35562-7801-494e-8853-417c5d5a1fbb-kube-api-access-xgxcr\") pod \"istiod-openshift-gateway-798958bb55-mjx7g\" (UID: \"38d35562-7801-494e-8853-417c5d5a1fbb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:44.862567 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:44.862521 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38d35562-7801-494e-8853-417c5d5a1fbb-istio-token\") pod \"istiod-openshift-gateway-798958bb55-mjx7g\" (UID: \"38d35562-7801-494e-8853-417c5d5a1fbb\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:45.003502 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:45.003399 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:45.147748 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:45.147717 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g"] May 21 20:27:45.151103 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:27:45.151046 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d35562_7801_494e_8853_417c5d5a1fbb.slice/crio-fa8533c85dceb17702fbbe3b5341e7e9ea11343a5dffaf58bd924ff73a731baf WatchSource:0}: Error finding container fa8533c85dceb17702fbbe3b5341e7e9ea11343a5dffaf58bd924ff73a731baf: Status 404 returned error can't find the container with id fa8533c85dceb17702fbbe3b5341e7e9ea11343a5dffaf58bd924ff73a731baf May 21 20:27:46.044044 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:46.043964 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" event={"ID":"38d35562-7801-494e-8853-417c5d5a1fbb","Type":"ContainerStarted","Data":"fa8533c85dceb17702fbbe3b5341e7e9ea11343a5dffaf58bd924ff73a731baf"} May 21 20:27:47.944671 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:47.944628 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} May 21 20:27:47.944933 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:47.944719 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} May 21 20:27:48.053531 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:48.053497 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" event={"ID":"38d35562-7801-494e-8853-417c5d5a1fbb","Type":"ContainerStarted","Data":"d69290fa158cf2c72dabad95abaf4484a088c2e4d0c763d69193e3fcc3ed4762"} May 21 20:27:48.053678 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:48.053573 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:48.075740 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:48.075690 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" podStartSLOduration=1.284750498 podStartE2EDuration="4.075676229s" podCreationTimestamp="2026-05-21 20:27:44 +0000 UTC" firstStartedPulling="2026-05-21 20:27:45.153434402 +0000 UTC m=+411.151823370" lastFinishedPulling="2026-05-21 20:27:47.944360121 +0000 UTC m=+413.942749101" observedRunningTime="2026-05-21 20:27:48.073844597 +0000 UTC m=+414.072233584" watchObservedRunningTime="2026-05-21 20:27:48.075676229 +0000 UTC m=+414.074065211" May 21 20:27:49.061207 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:49.061177 2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-mjx7g container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= May 21 20:27:49.061601 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:49.061231 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" podUID="38d35562-7801-494e-8853-417c5d5a1fbb" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 20:27:49.905105 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:49.905070 2559 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-6xsd5" May 21 20:27:49.905448 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:49.905434 2559 scope.go:117] "RemoveContainer" containerID="504824f56b64c5fd7fb2636392f3300c7e6b410b9ee0bc46f0ab3eb046784a06" May 21 20:27:51.068275 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:51.068236 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-6xsd5" event={"ID":"5c5fed31-7e58-45bb-aeed-3fcbe924088e","Type":"ContainerStarted","Data":"e5fa85b2eaf8b3f7eb2acce9c32cf0bbe612c46cbdb525377edd2afadb6e0bc6"} May 21 20:27:51.068684 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:51.068481 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-6xsd5" May 21 20:27:52.059784 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:52.059754 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mjx7g" May 21 20:27:52.081965 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:52.081912 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-6xsd5" podStartSLOduration=3.8274657960000003 podStartE2EDuration="24.081898468s" podCreationTimestamp="2026-05-21 20:27:28 +0000 UTC" firstStartedPulling="2026-05-21 20:27:30.037163896 +0000 UTC m=+396.035552857" lastFinishedPulling="2026-05-21 20:27:50.291596555 +0000 UTC m=+416.289985529" observedRunningTime="2026-05-21 20:27:51.086465661 +0000 UTC m=+417.084854645" watchObservedRunningTime="2026-05-21 20:27:52.081898468 +0000 UTC m=+418.080287466" May 21 20:27:54.037377 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:27:54.037345 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-nrgqt" May 21 20:28:02.073754 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:02.073722 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-6xsd5" May 21 20:28:10.007277 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:10.007244 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-xb4fw" May 21 20:28:39.336617 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.336578 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l"] May 21 20:28:39.349573 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.349539 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l"] May 21 20:28:39.349741 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.349673 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l" May 21 20:28:39.352194 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.352165 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 20:28:39.352341 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.352222 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 20:28:39.353010 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.352987 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kgdrv\"" May 21 20:28:39.404756 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.404727 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c13328d-4ea3-43e1-8042-11356a03b1c0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l\" (UID: \"7c13328d-4ea3-43e1-8042-11356a03b1c0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l" May 21 20:28:39.404917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.404763 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c13328d-4ea3-43e1-8042-11356a03b1c0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l\" (UID: \"7c13328d-4ea3-43e1-8042-11356a03b1c0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l" May 21 20:28:39.404917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.404788 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9f75\" (UniqueName: \"kubernetes.io/projected/7c13328d-4ea3-43e1-8042-11356a03b1c0-kube-api-access-l9f75\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l\" (UID: \"7c13328d-4ea3-43e1-8042-11356a03b1c0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l" May 21 20:28:39.505753 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.505721 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c13328d-4ea3-43e1-8042-11356a03b1c0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l\" (UID: \"7c13328d-4ea3-43e1-8042-11356a03b1c0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l" May 21 20:28:39.505895 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.505778 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l9f75\" (UniqueName: \"kubernetes.io/projected/7c13328d-4ea3-43e1-8042-11356a03b1c0-kube-api-access-l9f75\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l\" (UID: \"7c13328d-4ea3-43e1-8042-11356a03b1c0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l" May 21 20:28:39.505895 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.505859 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c13328d-4ea3-43e1-8042-11356a03b1c0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l\" (UID: \"7c13328d-4ea3-43e1-8042-11356a03b1c0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l" May 21 20:28:39.506112 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.506091 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c13328d-4ea3-43e1-8042-11356a03b1c0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l\" (UID: \"7c13328d-4ea3-43e1-8042-11356a03b1c0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l" May 21 20:28:39.506157 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.506145 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c13328d-4ea3-43e1-8042-11356a03b1c0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l\" (UID: \"7c13328d-4ea3-43e1-8042-11356a03b1c0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l" May 21 20:28:39.514216 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.514198 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9f75\" (UniqueName: \"kubernetes.io/projected/7c13328d-4ea3-43e1-8042-11356a03b1c0-kube-api-access-l9f75\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l\" (UID: \"7c13328d-4ea3-43e1-8042-11356a03b1c0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l" May 21 20:28:39.661208 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.661130 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l" May 21 20:28:39.739229 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.739202 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc"] May 21 20:28:39.744211 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.744192 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc" May 21 20:28:39.755933 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.755314 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc"] May 21 20:28:39.802300 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.802275 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l"] May 21 20:28:39.803975 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:28:39.803944 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c13328d_4ea3_43e1_8042_11356a03b1c0.slice/crio-00f57709c64d190ad6386b77291e83eb0810b550478fa8a881232fbfc892db38 WatchSource:0}: Error finding container 00f57709c64d190ad6386b77291e83eb0810b550478fa8a881232fbfc892db38: Status 404 returned error can't find the container with id 00f57709c64d190ad6386b77291e83eb0810b550478fa8a881232fbfc892db38 May 21 20:28:39.807981 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.807960 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae9c2707-c0f3-4cc9-89fc-a2b06773bd32-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc\" (UID: \"ae9c2707-c0f3-4cc9-89fc-a2b06773bd32\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc" May 21 20:28:39.808103 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.807990 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22bvp\" (UniqueName: \"kubernetes.io/projected/ae9c2707-c0f3-4cc9-89fc-a2b06773bd32-kube-api-access-22bvp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc\" (UID: \"ae9c2707-c0f3-4cc9-89fc-a2b06773bd32\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc" May 21 20:28:39.808103 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.808021 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae9c2707-c0f3-4cc9-89fc-a2b06773bd32-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc\" (UID: \"ae9c2707-c0f3-4cc9-89fc-a2b06773bd32\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc" May 21 20:28:39.909012 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.908983 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-22bvp\" (UniqueName: \"kubernetes.io/projected/ae9c2707-c0f3-4cc9-89fc-a2b06773bd32-kube-api-access-22bvp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc\" (UID: \"ae9c2707-c0f3-4cc9-89fc-a2b06773bd32\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc" May 21 20:28:39.909139 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.909023 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae9c2707-c0f3-4cc9-89fc-a2b06773bd32-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc\" (UID: \"ae9c2707-c0f3-4cc9-89fc-a2b06773bd32\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc" May 21 20:28:39.909206 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.909164 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae9c2707-c0f3-4cc9-89fc-a2b06773bd32-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc\" (UID: \"ae9c2707-c0f3-4cc9-89fc-a2b06773bd32\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc" May 21 20:28:39.909450 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.909429 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae9c2707-c0f3-4cc9-89fc-a2b06773bd32-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc\" (UID: \"ae9c2707-c0f3-4cc9-89fc-a2b06773bd32\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc" May 21 20:28:39.909503 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.909454 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae9c2707-c0f3-4cc9-89fc-a2b06773bd32-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc\" (UID: \"ae9c2707-c0f3-4cc9-89fc-a2b06773bd32\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc" May 21 20:28:39.917215 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:39.917170 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22bvp\" (UniqueName: \"kubernetes.io/projected/ae9c2707-c0f3-4cc9-89fc-a2b06773bd32-kube-api-access-22bvp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc\" (UID: \"ae9c2707-c0f3-4cc9-89fc-a2b06773bd32\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc" May 21 20:28:40.058201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.058172 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc" May 21 20:28:40.132562 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.132530 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc"] May 21 20:28:40.137685 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.137649 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc" May 21 20:28:40.143608 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.143583 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc"] May 21 20:28:40.195487 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.195457 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc"] May 21 20:28:40.197035 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:28:40.197013 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae9c2707_c0f3_4cc9_89fc_a2b06773bd32.slice/crio-36a39fa60c201ea60c9fe5efde575f42a2fc28c4d48911dde30e6c59f315e780 WatchSource:0}: Error finding container 36a39fa60c201ea60c9fe5efde575f42a2fc28c4d48911dde30e6c59f315e780: Status 404 returned error can't find the container with id 36a39fa60c201ea60c9fe5efde575f42a2fc28c4d48911dde30e6c59f315e780 May 21 20:28:40.211632 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.211612 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21c98c21-a322-429f-8464-df803100f899-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc\" (UID: \"21c98c21-a322-429f-8464-df803100f899\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc" May 21 20:28:40.211708 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.211664 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21c98c21-a322-429f-8464-df803100f899-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc\" (UID: \"21c98c21-a322-429f-8464-df803100f899\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc" May 21 20:28:40.211756 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.211733 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvbz8\" (UniqueName: \"kubernetes.io/projected/21c98c21-a322-429f-8464-df803100f899-kube-api-access-kvbz8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc\" (UID: \"21c98c21-a322-429f-8464-df803100f899\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc" May 21 20:28:40.241709 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.241684 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc" event={"ID":"ae9c2707-c0f3-4cc9-89fc-a2b06773bd32","Type":"ContainerStarted","Data":"36a39fa60c201ea60c9fe5efde575f42a2fc28c4d48911dde30e6c59f315e780"} May 21 20:28:40.243119 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.243099 2559 generic.go:358] "Generic (PLEG): container finished" podID="7c13328d-4ea3-43e1-8042-11356a03b1c0" containerID="c96fc2e656ecb232564f8b081e4250e1f129899a4aa531ecb03fad65e88aee49" exitCode=0 May 21 20:28:40.243229 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.243182 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l" event={"ID":"7c13328d-4ea3-43e1-8042-11356a03b1c0","Type":"ContainerDied","Data":"c96fc2e656ecb232564f8b081e4250e1f129899a4aa531ecb03fad65e88aee49"} May 21 20:28:40.243229 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.243206 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l" event={"ID":"7c13328d-4ea3-43e1-8042-11356a03b1c0","Type":"ContainerStarted","Data":"00f57709c64d190ad6386b77291e83eb0810b550478fa8a881232fbfc892db38"} May 21 20:28:40.312814 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.312785 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kvbz8\" (UniqueName: \"kubernetes.io/projected/21c98c21-a322-429f-8464-df803100f899-kube-api-access-kvbz8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc\" (UID: \"21c98c21-a322-429f-8464-df803100f899\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc" May 21 20:28:40.312947 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.312853 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21c98c21-a322-429f-8464-df803100f899-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc\" (UID: \"21c98c21-a322-429f-8464-df803100f899\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc" May 21 20:28:40.312947 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.312899 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21c98c21-a322-429f-8464-df803100f899-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc\" (UID: \"21c98c21-a322-429f-8464-df803100f899\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc" May 21 20:28:40.313232 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.313212 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21c98c21-a322-429f-8464-df803100f899-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc\" (UID: \"21c98c21-a322-429f-8464-df803100f899\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc" May 21 20:28:40.313300 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.313242 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21c98c21-a322-429f-8464-df803100f899-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc\" (UID: \"21c98c21-a322-429f-8464-df803100f899\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc" May 21 20:28:40.321006 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.320988 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvbz8\" (UniqueName: \"kubernetes.io/projected/21c98c21-a322-429f-8464-df803100f899-kube-api-access-kvbz8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc\" (UID: \"21c98c21-a322-429f-8464-df803100f899\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc" May 21 20:28:40.450385 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.450313 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc" May 21 20:28:40.541359 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.541331 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv"] May 21 20:28:40.546195 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.546173 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv" May 21 20:28:40.552351 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.552316 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv"] May 21 20:28:40.586457 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.586436 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc"] May 21 20:28:40.588548 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:28:40.588513 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c98c21_a322_429f_8464_df803100f899.slice/crio-0f7c632156825bdb9d5391ae2f1519357aa89d627aba872363088056751455ff WatchSource:0}: Error finding container 0f7c632156825bdb9d5391ae2f1519357aa89d627aba872363088056751455ff: Status 404 returned error can't find the container with id 0f7c632156825bdb9d5391ae2f1519357aa89d627aba872363088056751455ff May 21 20:28:40.614948 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.614925 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb86z\" (UniqueName: \"kubernetes.io/projected/d56d7d8f-5577-4bab-8543-7a73bd2a7067-kube-api-access-tb86z\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv\" (UID: \"d56d7d8f-5577-4bab-8543-7a73bd2a7067\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv" May 21 20:28:40.615074 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.614956 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d56d7d8f-5577-4bab-8543-7a73bd2a7067-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv\" (UID: \"d56d7d8f-5577-4bab-8543-7a73bd2a7067\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv" May 21 20:28:40.615144 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.615075 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d56d7d8f-5577-4bab-8543-7a73bd2a7067-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv\" (UID: \"d56d7d8f-5577-4bab-8543-7a73bd2a7067\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv" May 21 20:28:40.715657 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.715601 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tb86z\" (UniqueName: \"kubernetes.io/projected/d56d7d8f-5577-4bab-8543-7a73bd2a7067-kube-api-access-tb86z\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv\" (UID: \"d56d7d8f-5577-4bab-8543-7a73bd2a7067\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv" May 21 20:28:40.715657 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.715637 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d56d7d8f-5577-4bab-8543-7a73bd2a7067-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv\" (UID: \"d56d7d8f-5577-4bab-8543-7a73bd2a7067\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv" May 21 20:28:40.715785 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.715690 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d56d7d8f-5577-4bab-8543-7a73bd2a7067-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv\" (UID: \"d56d7d8f-5577-4bab-8543-7a73bd2a7067\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv" May 21 20:28:40.716033 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.716016 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d56d7d8f-5577-4bab-8543-7a73bd2a7067-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv\" (UID: \"d56d7d8f-5577-4bab-8543-7a73bd2a7067\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv" May 21 20:28:40.716136 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.716103 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d56d7d8f-5577-4bab-8543-7a73bd2a7067-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv\" (UID: \"d56d7d8f-5577-4bab-8543-7a73bd2a7067\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv" May 21 20:28:40.724689 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.724670 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb86z\" (UniqueName: \"kubernetes.io/projected/d56d7d8f-5577-4bab-8543-7a73bd2a7067-kube-api-access-tb86z\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv\" (UID: \"d56d7d8f-5577-4bab-8543-7a73bd2a7067\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv" May 21 20:28:40.857670 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.857632 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv" May 21 20:28:40.990243 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:40.990220 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv"] May 21 20:28:41.022815 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:28:41.022778 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd56d7d8f_5577_4bab_8543_7a73bd2a7067.slice/crio-e9ceafbc7c7fba73c9a6c1136acdc862e1d408673b229531bce0603d156d35e2 WatchSource:0}: Error finding container e9ceafbc7c7fba73c9a6c1136acdc862e1d408673b229531bce0603d156d35e2: Status 404 returned error can't find the container with id e9ceafbc7c7fba73c9a6c1136acdc862e1d408673b229531bce0603d156d35e2 May 21 20:28:41.248255 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:41.248178 2559 generic.go:358] "Generic (PLEG): container finished" podID="d56d7d8f-5577-4bab-8543-7a73bd2a7067" containerID="97e9198ef7ed135ef34376b967aedbb5cc1c73daa2402d706f7c70eb6c511755" exitCode=0 May 21 20:28:41.248393 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:41.248272 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv" event={"ID":"d56d7d8f-5577-4bab-8543-7a73bd2a7067","Type":"ContainerDied","Data":"97e9198ef7ed135ef34376b967aedbb5cc1c73daa2402d706f7c70eb6c511755"} May 21 20:28:41.248393 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:41.248308 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv" event={"ID":"d56d7d8f-5577-4bab-8543-7a73bd2a7067","Type":"ContainerStarted","Data":"e9ceafbc7c7fba73c9a6c1136acdc862e1d408673b229531bce0603d156d35e2"} May 21 20:28:41.249684 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:41.249658 2559 generic.go:358] "Generic (PLEG): container finished" podID="ae9c2707-c0f3-4cc9-89fc-a2b06773bd32" containerID="bdeec2756c2d1e29bb718017ee649e5b4e0e45991012e7c3eeb077883d44905e" exitCode=0 May 21 20:28:41.249793 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:41.249726 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc" event={"ID":"ae9c2707-c0f3-4cc9-89fc-a2b06773bd32","Type":"ContainerDied","Data":"bdeec2756c2d1e29bb718017ee649e5b4e0e45991012e7c3eeb077883d44905e"} May 21 20:28:41.251163 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:41.251145 2559 generic.go:358] "Generic (PLEG): container finished" podID="21c98c21-a322-429f-8464-df803100f899" containerID="f5428487cad98781e198f9f76011ada5c065ff96a16d79ff7f9719093d0b9b5d" exitCode=0 May 21 20:28:41.251264 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:41.251208 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc" event={"ID":"21c98c21-a322-429f-8464-df803100f899","Type":"ContainerDied","Data":"f5428487cad98781e198f9f76011ada5c065ff96a16d79ff7f9719093d0b9b5d"} May 21 20:28:41.251264 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:41.251236 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc" event={"ID":"21c98c21-a322-429f-8464-df803100f899","Type":"ContainerStarted","Data":"0f7c632156825bdb9d5391ae2f1519357aa89d627aba872363088056751455ff"} May 21 20:28:41.253178 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:41.253147 2559 generic.go:358] "Generic (PLEG): container finished" podID="7c13328d-4ea3-43e1-8042-11356a03b1c0" containerID="5642ac63d922518b7d26d4a5c71997dd84f0063173de787f254a139bac43f098" exitCode=0 May 21 20:28:41.253261 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:41.253186 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l" event={"ID":"7c13328d-4ea3-43e1-8042-11356a03b1c0","Type":"ContainerDied","Data":"5642ac63d922518b7d26d4a5c71997dd84f0063173de787f254a139bac43f098"} May 21 20:28:42.259218 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:42.259183 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc" event={"ID":"ae9c2707-c0f3-4cc9-89fc-a2b06773bd32","Type":"ContainerStarted","Data":"e0faaebbbc53962da9872ead31d66e48b84ed6e4ff0a07adc04aa9905946d995"} May 21 20:28:42.262126 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:42.261749 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc" event={"ID":"21c98c21-a322-429f-8464-df803100f899","Type":"ContainerStarted","Data":"e72797436a625f4b7cf39518fc1bddcc924ad009e044f38df2294603b9077c58"} May 21 20:28:42.264637 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:42.264607 2559 generic.go:358] "Generic (PLEG): container finished" podID="7c13328d-4ea3-43e1-8042-11356a03b1c0" containerID="d02960780c376fb770983772f5ce4c54ad64cc849ea867ea5969eff31987791d" exitCode=0 May 21 20:28:42.264765 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:42.264670 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l" event={"ID":"7c13328d-4ea3-43e1-8042-11356a03b1c0","Type":"ContainerDied","Data":"d02960780c376fb770983772f5ce4c54ad64cc849ea867ea5969eff31987791d"} May 21 20:28:42.266804 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:42.266779 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv" event={"ID":"d56d7d8f-5577-4bab-8543-7a73bd2a7067","Type":"ContainerStarted","Data":"621c1d4b9f4e34ca8ad72ba02c44f81faad91d106fe4aa65986de43ad70b298d"} May 21 20:28:43.272114 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:43.272076 2559 generic.go:358] "Generic (PLEG): container finished" podID="ae9c2707-c0f3-4cc9-89fc-a2b06773bd32" containerID="e0faaebbbc53962da9872ead31d66e48b84ed6e4ff0a07adc04aa9905946d995" exitCode=0 May 21 20:28:43.272114 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:43.272097 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc" event={"ID":"ae9c2707-c0f3-4cc9-89fc-a2b06773bd32","Type":"ContainerDied","Data":"e0faaebbbc53962da9872ead31d66e48b84ed6e4ff0a07adc04aa9905946d995"} May 21 20:28:43.273890 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:43.273763 2559 generic.go:358] "Generic (PLEG): container finished" podID="21c98c21-a322-429f-8464-df803100f899" containerID="e72797436a625f4b7cf39518fc1bddcc924ad009e044f38df2294603b9077c58" exitCode=0 May 21 20:28:43.273890 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:43.273846 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc" event={"ID":"21c98c21-a322-429f-8464-df803100f899","Type":"ContainerDied","Data":"e72797436a625f4b7cf39518fc1bddcc924ad009e044f38df2294603b9077c58"} May 21 20:28:43.275499 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:43.275478 2559 generic.go:358] "Generic (PLEG): container finished" podID="d56d7d8f-5577-4bab-8543-7a73bd2a7067" containerID="621c1d4b9f4e34ca8ad72ba02c44f81faad91d106fe4aa65986de43ad70b298d" exitCode=0 May 21 20:28:43.275614 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:43.275574 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv" event={"ID":"d56d7d8f-5577-4bab-8543-7a73bd2a7067","Type":"ContainerDied","Data":"621c1d4b9f4e34ca8ad72ba02c44f81faad91d106fe4aa65986de43ad70b298d"} May 21 20:28:43.421712 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:43.421680 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l" May 21 20:28:43.441013 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:43.440979 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c13328d-4ea3-43e1-8042-11356a03b1c0-util\") pod \"7c13328d-4ea3-43e1-8042-11356a03b1c0\" (UID: \"7c13328d-4ea3-43e1-8042-11356a03b1c0\") " May 21 20:28:43.441146 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:43.441124 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c13328d-4ea3-43e1-8042-11356a03b1c0-bundle\") pod \"7c13328d-4ea3-43e1-8042-11356a03b1c0\" (UID: \"7c13328d-4ea3-43e1-8042-11356a03b1c0\") " May 21 20:28:43.441294 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:43.441182 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9f75\" (UniqueName: \"kubernetes.io/projected/7c13328d-4ea3-43e1-8042-11356a03b1c0-kube-api-access-l9f75\") pod \"7c13328d-4ea3-43e1-8042-11356a03b1c0\" (UID: \"7c13328d-4ea3-43e1-8042-11356a03b1c0\") " May 21 20:28:43.442466 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:43.442405 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c13328d-4ea3-43e1-8042-11356a03b1c0-bundle" (OuterVolumeSpecName: "bundle") pod "7c13328d-4ea3-43e1-8042-11356a03b1c0" (UID: "7c13328d-4ea3-43e1-8042-11356a03b1c0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:28:43.444212 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:43.444172 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c13328d-4ea3-43e1-8042-11356a03b1c0-kube-api-access-l9f75" (OuterVolumeSpecName: "kube-api-access-l9f75") pod "7c13328d-4ea3-43e1-8042-11356a03b1c0" (UID: "7c13328d-4ea3-43e1-8042-11356a03b1c0"). InnerVolumeSpecName "kube-api-access-l9f75". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:28:43.449191 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:43.449152 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c13328d-4ea3-43e1-8042-11356a03b1c0-util" (OuterVolumeSpecName: "util") pod "7c13328d-4ea3-43e1-8042-11356a03b1c0" (UID: "7c13328d-4ea3-43e1-8042-11356a03b1c0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:28:43.541985 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:43.541952 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c13328d-4ea3-43e1-8042-11356a03b1c0-bundle\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:28:43.541985 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:43.541985 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9f75\" (UniqueName: \"kubernetes.io/projected/7c13328d-4ea3-43e1-8042-11356a03b1c0-kube-api-access-l9f75\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:28:43.542146 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:43.541997 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c13328d-4ea3-43e1-8042-11356a03b1c0-util\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:28:44.281460 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:44.281426 2559 generic.go:358] "Generic (PLEG): container finished" podID="ae9c2707-c0f3-4cc9-89fc-a2b06773bd32" containerID="7c2e4a37ab574b2b2886cb4f160e1adbdf57653a0e088e672a5dcd61d2723623" exitCode=0 May 21 20:28:44.281880 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:44.281511 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc" event={"ID":"ae9c2707-c0f3-4cc9-89fc-a2b06773bd32","Type":"ContainerDied","Data":"7c2e4a37ab574b2b2886cb4f160e1adbdf57653a0e088e672a5dcd61d2723623"} May 21 20:28:44.283270 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:44.283251 2559 generic.go:358] "Generic (PLEG): container finished" podID="21c98c21-a322-429f-8464-df803100f899" containerID="bbed6cacdd39876e4d2345b58903ee4444d3f22ceda9ca035de7c82b894ac7c3" exitCode=0 May 21 20:28:44.283344 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:44.283323 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc" event={"ID":"21c98c21-a322-429f-8464-df803100f899","Type":"ContainerDied","Data":"bbed6cacdd39876e4d2345b58903ee4444d3f22ceda9ca035de7c82b894ac7c3"} May 21 20:28:44.284873 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:44.284843 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l" event={"ID":"7c13328d-4ea3-43e1-8042-11356a03b1c0","Type":"ContainerDied","Data":"00f57709c64d190ad6386b77291e83eb0810b550478fa8a881232fbfc892db38"} May 21 20:28:44.284873 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:44.284866 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00f57709c64d190ad6386b77291e83eb0810b550478fa8a881232fbfc892db38" May 21 20:28:44.284873 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:44.284869 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l" May 21 20:28:44.286755 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:44.286733 2559 generic.go:358] "Generic (PLEG): container finished" podID="d56d7d8f-5577-4bab-8543-7a73bd2a7067" containerID="323fda7f226b9f66a43838b953ee56a29e08b0f5f2a358c5d8aa4388d95d1011" exitCode=0 May 21 20:28:44.286859 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:44.286784 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv" event={"ID":"d56d7d8f-5577-4bab-8543-7a73bd2a7067","Type":"ContainerDied","Data":"323fda7f226b9f66a43838b953ee56a29e08b0f5f2a358c5d8aa4388d95d1011"} May 21 20:28:45.467182 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.467161 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc" May 21 20:28:45.470651 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.470632 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv" May 21 20:28:45.473798 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.473780 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc" May 21 20:28:45.561440 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.561358 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae9c2707-c0f3-4cc9-89fc-a2b06773bd32-bundle\") pod \"ae9c2707-c0f3-4cc9-89fc-a2b06773bd32\" (UID: \"ae9c2707-c0f3-4cc9-89fc-a2b06773bd32\") " May 21 20:28:45.561440 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.561403 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21c98c21-a322-429f-8464-df803100f899-util\") pod \"21c98c21-a322-429f-8464-df803100f899\" (UID: \"21c98c21-a322-429f-8464-df803100f899\") " May 21 20:28:45.561440 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.561431 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d56d7d8f-5577-4bab-8543-7a73bd2a7067-util\") pod \"d56d7d8f-5577-4bab-8543-7a73bd2a7067\" (UID: \"d56d7d8f-5577-4bab-8543-7a73bd2a7067\") " May 21 20:28:45.561702 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.561458 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d56d7d8f-5577-4bab-8543-7a73bd2a7067-bundle\") pod \"d56d7d8f-5577-4bab-8543-7a73bd2a7067\" (UID: \"d56d7d8f-5577-4bab-8543-7a73bd2a7067\") " May 21 20:28:45.561702 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.561503 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21c98c21-a322-429f-8464-df803100f899-bundle\") pod \"21c98c21-a322-429f-8464-df803100f899\" (UID: \"21c98c21-a322-429f-8464-df803100f899\") " May 21 20:28:45.561702 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.561557 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tb86z\" (UniqueName: \"kubernetes.io/projected/d56d7d8f-5577-4bab-8543-7a73bd2a7067-kube-api-access-tb86z\") pod \"d56d7d8f-5577-4bab-8543-7a73bd2a7067\" (UID: \"d56d7d8f-5577-4bab-8543-7a73bd2a7067\") " May 21 20:28:45.561702 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.561586 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae9c2707-c0f3-4cc9-89fc-a2b06773bd32-util\") pod \"ae9c2707-c0f3-4cc9-89fc-a2b06773bd32\" (UID: \"ae9c2707-c0f3-4cc9-89fc-a2b06773bd32\") " May 21 20:28:45.561702 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.561627 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22bvp\" (UniqueName: \"kubernetes.io/projected/ae9c2707-c0f3-4cc9-89fc-a2b06773bd32-kube-api-access-22bvp\") pod \"ae9c2707-c0f3-4cc9-89fc-a2b06773bd32\" (UID: \"ae9c2707-c0f3-4cc9-89fc-a2b06773bd32\") " May 21 20:28:45.561702 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.561673 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvbz8\" (UniqueName: \"kubernetes.io/projected/21c98c21-a322-429f-8464-df803100f899-kube-api-access-kvbz8\") pod \"21c98c21-a322-429f-8464-df803100f899\" (UID: \"21c98c21-a322-429f-8464-df803100f899\") " May 21 20:28:45.562316 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.562285 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae9c2707-c0f3-4cc9-89fc-a2b06773bd32-bundle" (OuterVolumeSpecName: "bundle") pod "ae9c2707-c0f3-4cc9-89fc-a2b06773bd32" (UID: "ae9c2707-c0f3-4cc9-89fc-a2b06773bd32"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:28:45.562448 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.562409 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21c98c21-a322-429f-8464-df803100f899-bundle" (OuterVolumeSpecName: "bundle") pod "21c98c21-a322-429f-8464-df803100f899" (UID: "21c98c21-a322-429f-8464-df803100f899"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:28:45.562506 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.562451 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d56d7d8f-5577-4bab-8543-7a73bd2a7067-bundle" (OuterVolumeSpecName: "bundle") pod "d56d7d8f-5577-4bab-8543-7a73bd2a7067" (UID: "d56d7d8f-5577-4bab-8543-7a73bd2a7067"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:28:45.564498 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.564474 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae9c2707-c0f3-4cc9-89fc-a2b06773bd32-kube-api-access-22bvp" (OuterVolumeSpecName: "kube-api-access-22bvp") pod "ae9c2707-c0f3-4cc9-89fc-a2b06773bd32" (UID: "ae9c2707-c0f3-4cc9-89fc-a2b06773bd32"). InnerVolumeSpecName "kube-api-access-22bvp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:28:45.564622 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.564607 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21c98c21-a322-429f-8464-df803100f899-kube-api-access-kvbz8" (OuterVolumeSpecName: "kube-api-access-kvbz8") pod "21c98c21-a322-429f-8464-df803100f899" (UID: "21c98c21-a322-429f-8464-df803100f899"). InnerVolumeSpecName "kube-api-access-kvbz8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:28:45.565342 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.565316 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d56d7d8f-5577-4bab-8543-7a73bd2a7067-kube-api-access-tb86z" (OuterVolumeSpecName: "kube-api-access-tb86z") pod "d56d7d8f-5577-4bab-8543-7a73bd2a7067" (UID: "d56d7d8f-5577-4bab-8543-7a73bd2a7067"). InnerVolumeSpecName "kube-api-access-tb86z". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:28:45.567898 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.567875 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21c98c21-a322-429f-8464-df803100f899-util" (OuterVolumeSpecName: "util") pod "21c98c21-a322-429f-8464-df803100f899" (UID: "21c98c21-a322-429f-8464-df803100f899"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:28:45.568240 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.568213 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d56d7d8f-5577-4bab-8543-7a73bd2a7067-util" (OuterVolumeSpecName: "util") pod "d56d7d8f-5577-4bab-8543-7a73bd2a7067" (UID: "d56d7d8f-5577-4bab-8543-7a73bd2a7067"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:28:45.653823 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.653789 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae9c2707-c0f3-4cc9-89fc-a2b06773bd32-util" (OuterVolumeSpecName: "util") pod "ae9c2707-c0f3-4cc9-89fc-a2b06773bd32" (UID: "ae9c2707-c0f3-4cc9-89fc-a2b06773bd32"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:28:45.662677 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.662651 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvbz8\" (UniqueName: \"kubernetes.io/projected/21c98c21-a322-429f-8464-df803100f899-kube-api-access-kvbz8\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:28:45.662677 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.662674 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae9c2707-c0f3-4cc9-89fc-a2b06773bd32-bundle\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:28:45.662778 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.662684 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21c98c21-a322-429f-8464-df803100f899-util\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:28:45.662778 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.662692 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d56d7d8f-5577-4bab-8543-7a73bd2a7067-util\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:28:45.662778 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.662700 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d56d7d8f-5577-4bab-8543-7a73bd2a7067-bundle\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:28:45.662778 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.662708 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21c98c21-a322-429f-8464-df803100f899-bundle\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:28:45.662778 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.662716 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tb86z\" (UniqueName: \"kubernetes.io/projected/d56d7d8f-5577-4bab-8543-7a73bd2a7067-kube-api-access-tb86z\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:28:45.662778 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.662726 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae9c2707-c0f3-4cc9-89fc-a2b06773bd32-util\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:28:45.662778 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:45.662734 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22bvp\" (UniqueName: \"kubernetes.io/projected/ae9c2707-c0f3-4cc9-89fc-a2b06773bd32-kube-api-access-22bvp\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:28:46.295896 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:46.295859 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc" event={"ID":"ae9c2707-c0f3-4cc9-89fc-a2b06773bd32","Type":"ContainerDied","Data":"36a39fa60c201ea60c9fe5efde575f42a2fc28c4d48911dde30e6c59f315e780"} May 21 20:28:46.295896 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:46.295891 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36a39fa60c201ea60c9fe5efde575f42a2fc28c4d48911dde30e6c59f315e780" May 21 20:28:46.296176 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:46.295902 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc" May 21 20:28:46.297572 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:46.297545 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc" event={"ID":"21c98c21-a322-429f-8464-df803100f899","Type":"ContainerDied","Data":"0f7c632156825bdb9d5391ae2f1519357aa89d627aba872363088056751455ff"} May 21 20:28:46.297678 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:46.297585 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f7c632156825bdb9d5391ae2f1519357aa89d627aba872363088056751455ff" May 21 20:28:46.297678 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:46.297552 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc" May 21 20:28:46.299260 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:46.299242 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv" May 21 20:28:46.299367 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:46.299261 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv" event={"ID":"d56d7d8f-5577-4bab-8543-7a73bd2a7067","Type":"ContainerDied","Data":"e9ceafbc7c7fba73c9a6c1136acdc862e1d408673b229531bce0603d156d35e2"} May 21 20:28:46.299367 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:46.299282 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9ceafbc7c7fba73c9a6c1136acdc862e1d408673b229531bce0603d156d35e2" May 21 20:28:59.466178 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466144 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-5wgvf"] May 21 20:28:59.466517 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466439 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae9c2707-c0f3-4cc9-89fc-a2b06773bd32" containerName="pull" May 21 20:28:59.466517 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466450 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae9c2707-c0f3-4cc9-89fc-a2b06773bd32" containerName="pull" May 21 20:28:59.466517 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466462 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21c98c21-a322-429f-8464-df803100f899" containerName="extract" May 21 20:28:59.466517 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466468 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="21c98c21-a322-429f-8464-df803100f899" containerName="extract" May 21 20:28:59.466517 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466481 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d56d7d8f-5577-4bab-8543-7a73bd2a7067" containerName="util" May 21 20:28:59.466517 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466486 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d56d7d8f-5577-4bab-8543-7a73bd2a7067" containerName="util" May 21 20:28:59.466517 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466491 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d56d7d8f-5577-4bab-8543-7a73bd2a7067" containerName="pull" May 21 20:28:59.466517 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466496 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d56d7d8f-5577-4bab-8543-7a73bd2a7067" containerName="pull" May 21 20:28:59.466517 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466503 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21c98c21-a322-429f-8464-df803100f899" containerName="util" May 21 20:28:59.466517 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466507 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="21c98c21-a322-429f-8464-df803100f899" containerName="util" May 21 20:28:59.466517 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466513 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21c98c21-a322-429f-8464-df803100f899" containerName="pull" May 21 20:28:59.466517 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466518 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="21c98c21-a322-429f-8464-df803100f899" containerName="pull" May 21 20:28:59.466517 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466524 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c13328d-4ea3-43e1-8042-11356a03b1c0" containerName="util" May 21 20:28:59.466917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466529 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c13328d-4ea3-43e1-8042-11356a03b1c0" containerName="util" May 21 20:28:59.466917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466537 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae9c2707-c0f3-4cc9-89fc-a2b06773bd32" containerName="util" May 21 20:28:59.466917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466542 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae9c2707-c0f3-4cc9-89fc-a2b06773bd32" containerName="util" May 21 20:28:59.466917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466550 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c13328d-4ea3-43e1-8042-11356a03b1c0" containerName="pull" May 21 20:28:59.466917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466555 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c13328d-4ea3-43e1-8042-11356a03b1c0" containerName="pull" May 21 20:28:59.466917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466562 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d56d7d8f-5577-4bab-8543-7a73bd2a7067" containerName="extract" May 21 20:28:59.466917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466567 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d56d7d8f-5577-4bab-8543-7a73bd2a7067" containerName="extract" May 21 20:28:59.466917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466575 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae9c2707-c0f3-4cc9-89fc-a2b06773bd32" containerName="extract" May 21 20:28:59.466917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466580 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae9c2707-c0f3-4cc9-89fc-a2b06773bd32" containerName="extract" May 21 20:28:59.466917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466586 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c13328d-4ea3-43e1-8042-11356a03b1c0" containerName="extract" May 21 20:28:59.466917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466593 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c13328d-4ea3-43e1-8042-11356a03b1c0" containerName="extract" May 21 20:28:59.466917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466639 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="21c98c21-a322-429f-8464-df803100f899" containerName="extract" May 21 20:28:59.466917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466649 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="d56d7d8f-5577-4bab-8543-7a73bd2a7067" containerName="extract" May 21 20:28:59.466917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466654 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="ae9c2707-c0f3-4cc9-89fc-a2b06773bd32" containerName="extract" May 21 20:28:59.466917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.466660 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="7c13328d-4ea3-43e1-8042-11356a03b1c0" containerName="extract" May 21 20:28:59.470992 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.470974 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-5wgvf" May 21 20:28:59.473653 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.473630 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-tc4kp\"" May 21 20:28:59.473754 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.473683 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 20:28:59.474808 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.474790 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 20:28:59.485193 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.485170 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-5wgvf"] May 21 20:28:59.578225 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.578191 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6cpl\" (UniqueName: \"kubernetes.io/projected/920fa6fe-b27b-4b51-a30c-0d840f6e6017-kube-api-access-q6cpl\") pod \"authorino-operator-657f44b778-5wgvf\" (UID: \"920fa6fe-b27b-4b51-a30c-0d840f6e6017\") " pod="kuadrant-system/authorino-operator-657f44b778-5wgvf" May 21 20:28:59.678755 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.678722 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q6cpl\" (UniqueName: \"kubernetes.io/projected/920fa6fe-b27b-4b51-a30c-0d840f6e6017-kube-api-access-q6cpl\") pod \"authorino-operator-657f44b778-5wgvf\" (UID: \"920fa6fe-b27b-4b51-a30c-0d840f6e6017\") " pod="kuadrant-system/authorino-operator-657f44b778-5wgvf" May 21 20:28:59.690967 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.690941 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6cpl\" (UniqueName: \"kubernetes.io/projected/920fa6fe-b27b-4b51-a30c-0d840f6e6017-kube-api-access-q6cpl\") pod \"authorino-operator-657f44b778-5wgvf\" (UID: \"920fa6fe-b27b-4b51-a30c-0d840f6e6017\") " pod="kuadrant-system/authorino-operator-657f44b778-5wgvf" May 21 20:28:59.781418 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.781338 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-5wgvf" May 21 20:28:59.924701 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:28:59.924676 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-5wgvf"] May 21 20:28:59.926391 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:28:59.926366 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod920fa6fe_b27b_4b51_a30c_0d840f6e6017.slice/crio-8e01f40fac78eeeae614c507d26801404337e20064bf73dc2f3c110cfeec8675 WatchSource:0}: Error finding container 8e01f40fac78eeeae614c507d26801404337e20064bf73dc2f3c110cfeec8675: Status 404 returned error can't find the container with id 8e01f40fac78eeeae614c507d26801404337e20064bf73dc2f3c110cfeec8675 May 21 20:29:00.353158 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:00.353123 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-5wgvf" event={"ID":"920fa6fe-b27b-4b51-a30c-0d840f6e6017","Type":"ContainerStarted","Data":"8e01f40fac78eeeae614c507d26801404337e20064bf73dc2f3c110cfeec8675"} May 21 20:29:02.363282 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:02.363250 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-5wgvf" event={"ID":"920fa6fe-b27b-4b51-a30c-0d840f6e6017","Type":"ContainerStarted","Data":"48871f601e7d96172286e3885f11648090be85144267dfae595c33816c88a6a5"} May 21 20:29:02.363683 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:02.363292 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-5wgvf" May 21 20:29:02.406375 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:02.406325 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-5wgvf" podStartSLOduration=1.491217657 podStartE2EDuration="3.406305993s" podCreationTimestamp="2026-05-21 20:28:59 +0000 UTC" firstStartedPulling="2026-05-21 20:28:59.928320594 +0000 UTC m=+485.926709576" lastFinishedPulling="2026-05-21 20:29:01.843408949 +0000 UTC m=+487.841797912" observedRunningTime="2026-05-21 20:29:02.40415199 +0000 UTC m=+488.402540974" watchObservedRunningTime="2026-05-21 20:29:02.406305993 +0000 UTC m=+488.404695010" May 21 20:29:13.369691 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:13.369662 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-5wgvf" May 21 20:29:15.644773 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:15.644743 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gz26x"] May 21 20:29:15.650412 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:15.650387 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gz26x" May 21 20:29:15.654413 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:15.654390 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ggdlz\"" May 21 20:29:15.666304 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:15.666283 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gz26x"] May 21 20:29:15.721807 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:15.721779 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc9hk\" (UniqueName: \"kubernetes.io/projected/8d14bf5a-31dc-4775-a7d6-2b72387df87b-kube-api-access-fc9hk\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-gz26x\" (UID: \"8d14bf5a-31dc-4775-a7d6-2b72387df87b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gz26x" May 21 20:29:15.721948 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:15.721841 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d14bf5a-31dc-4775-a7d6-2b72387df87b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-gz26x\" (UID: \"8d14bf5a-31dc-4775-a7d6-2b72387df87b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gz26x" May 21 20:29:15.823029 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:15.822997 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d14bf5a-31dc-4775-a7d6-2b72387df87b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-gz26x\" (UID: \"8d14bf5a-31dc-4775-a7d6-2b72387df87b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gz26x" May 21 20:29:15.823198 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:15.823105 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fc9hk\" (UniqueName: \"kubernetes.io/projected/8d14bf5a-31dc-4775-a7d6-2b72387df87b-kube-api-access-fc9hk\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-gz26x\" (UID: \"8d14bf5a-31dc-4775-a7d6-2b72387df87b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gz26x" May 21 20:29:15.823450 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:15.823431 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d14bf5a-31dc-4775-a7d6-2b72387df87b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-gz26x\" (UID: \"8d14bf5a-31dc-4775-a7d6-2b72387df87b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gz26x" May 21 20:29:15.834745 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:15.834717 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc9hk\" (UniqueName: \"kubernetes.io/projected/8d14bf5a-31dc-4775-a7d6-2b72387df87b-kube-api-access-fc9hk\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-gz26x\" (UID: \"8d14bf5a-31dc-4775-a7d6-2b72387df87b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gz26x" May 21 20:29:15.961504 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:15.961428 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gz26x" May 21 20:29:16.119202 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:16.119171 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gz26x"] May 21 20:29:16.120701 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:29:16.120660 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d14bf5a_31dc_4775_a7d6_2b72387df87b.slice/crio-4bc5d37c596b4cf137cb3ca279fcb99f7deb1bf3878ce118b4cead7f124cca3e WatchSource:0}: Error finding container 4bc5d37c596b4cf137cb3ca279fcb99f7deb1bf3878ce118b4cead7f124cca3e: Status 404 returned error can't find the container with id 4bc5d37c596b4cf137cb3ca279fcb99f7deb1bf3878ce118b4cead7f124cca3e May 21 20:29:16.416755 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:16.416722 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gz26x" event={"ID":"8d14bf5a-31dc-4775-a7d6-2b72387df87b","Type":"ContainerStarted","Data":"4bc5d37c596b4cf137cb3ca279fcb99f7deb1bf3878ce118b4cead7f124cca3e"} May 21 20:29:21.445454 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:21.445416 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gz26x" event={"ID":"8d14bf5a-31dc-4775-a7d6-2b72387df87b","Type":"ContainerStarted","Data":"c90e5aa2c38ad6cd94a6e196caec4701d9ad6cd05660b6607bffe6b8cee7257b"} May 21 20:29:21.445909 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:21.445559 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gz26x" May 21 20:29:21.466725 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:21.466678 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gz26x" podStartSLOduration=1.8857705139999998 podStartE2EDuration="6.466666448s" podCreationTimestamp="2026-05-21 20:29:15 +0000 UTC" firstStartedPulling="2026-05-21 20:29:16.123026275 +0000 UTC m=+502.121415236" lastFinishedPulling="2026-05-21 20:29:20.703922201 +0000 UTC m=+506.702311170" observedRunningTime="2026-05-21 20:29:21.464497303 +0000 UTC m=+507.462886286" watchObservedRunningTime="2026-05-21 20:29:21.466666448 +0000 UTC m=+507.465055430" May 21 20:29:32.451797 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:32.451764 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gz26x" May 21 20:29:40.031470 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:40.031436 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gz26x"] May 21 20:29:40.031876 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:40.031656 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gz26x" podUID="8d14bf5a-31dc-4775-a7d6-2b72387df87b" containerName="manager" containerID="cri-o://c90e5aa2c38ad6cd94a6e196caec4701d9ad6cd05660b6607bffe6b8cee7257b" gracePeriod=10 May 21 20:29:40.276201 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:40.276177 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gz26x" May 21 20:29:40.326362 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:40.326287 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d14bf5a-31dc-4775-a7d6-2b72387df87b-extensions-socket-volume\") pod \"8d14bf5a-31dc-4775-a7d6-2b72387df87b\" (UID: \"8d14bf5a-31dc-4775-a7d6-2b72387df87b\") " May 21 20:29:40.326362 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:40.326356 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fc9hk\" (UniqueName: \"kubernetes.io/projected/8d14bf5a-31dc-4775-a7d6-2b72387df87b-kube-api-access-fc9hk\") pod \"8d14bf5a-31dc-4775-a7d6-2b72387df87b\" (UID: \"8d14bf5a-31dc-4775-a7d6-2b72387df87b\") " May 21 20:29:40.326770 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:40.326746 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d14bf5a-31dc-4775-a7d6-2b72387df87b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8d14bf5a-31dc-4775-a7d6-2b72387df87b" (UID: "8d14bf5a-31dc-4775-a7d6-2b72387df87b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:29:40.328598 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:40.328575 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d14bf5a-31dc-4775-a7d6-2b72387df87b-kube-api-access-fc9hk" (OuterVolumeSpecName: "kube-api-access-fc9hk") pod "8d14bf5a-31dc-4775-a7d6-2b72387df87b" (UID: "8d14bf5a-31dc-4775-a7d6-2b72387df87b"). InnerVolumeSpecName "kube-api-access-fc9hk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:29:40.427694 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:40.427667 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d14bf5a-31dc-4775-a7d6-2b72387df87b-extensions-socket-volume\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:29:40.427694 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:40.427692 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fc9hk\" (UniqueName: \"kubernetes.io/projected/8d14bf5a-31dc-4775-a7d6-2b72387df87b-kube-api-access-fc9hk\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:29:40.514632 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:40.514596 2559 generic.go:358] "Generic (PLEG): container finished" podID="8d14bf5a-31dc-4775-a7d6-2b72387df87b" containerID="c90e5aa2c38ad6cd94a6e196caec4701d9ad6cd05660b6607bffe6b8cee7257b" exitCode=0 May 21 20:29:40.514791 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:40.514676 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gz26x" event={"ID":"8d14bf5a-31dc-4775-a7d6-2b72387df87b","Type":"ContainerDied","Data":"c90e5aa2c38ad6cd94a6e196caec4701d9ad6cd05660b6607bffe6b8cee7257b"} May 21 20:29:40.514791 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:40.514699 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gz26x" May 21 20:29:40.514791 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:40.514715 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gz26x" event={"ID":"8d14bf5a-31dc-4775-a7d6-2b72387df87b","Type":"ContainerDied","Data":"4bc5d37c596b4cf137cb3ca279fcb99f7deb1bf3878ce118b4cead7f124cca3e"} May 21 20:29:40.514791 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:40.514756 2559 scope.go:117] "RemoveContainer" containerID="c90e5aa2c38ad6cd94a6e196caec4701d9ad6cd05660b6607bffe6b8cee7257b" May 21 20:29:40.524662 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:40.524638 2559 scope.go:117] "RemoveContainer" containerID="c90e5aa2c38ad6cd94a6e196caec4701d9ad6cd05660b6607bffe6b8cee7257b" May 21 20:29:40.524961 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:29:40.524941 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c90e5aa2c38ad6cd94a6e196caec4701d9ad6cd05660b6607bffe6b8cee7257b\": container with ID starting with c90e5aa2c38ad6cd94a6e196caec4701d9ad6cd05660b6607bffe6b8cee7257b not found: ID does not exist" containerID="c90e5aa2c38ad6cd94a6e196caec4701d9ad6cd05660b6607bffe6b8cee7257b" May 21 20:29:40.525016 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:40.524971 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c90e5aa2c38ad6cd94a6e196caec4701d9ad6cd05660b6607bffe6b8cee7257b"} err="failed to get container status \"c90e5aa2c38ad6cd94a6e196caec4701d9ad6cd05660b6607bffe6b8cee7257b\": rpc error: code = NotFound desc = could not find container \"c90e5aa2c38ad6cd94a6e196caec4701d9ad6cd05660b6607bffe6b8cee7257b\": container with ID starting with c90e5aa2c38ad6cd94a6e196caec4701d9ad6cd05660b6607bffe6b8cee7257b not found: ID does not exist" May 21 20:29:40.548039 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:40.548014 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gz26x"] May 21 20:29:40.560897 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:40.560867 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-gz26x"] May 21 20:29:40.576192 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:40.576167 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d14bf5a-31dc-4775-a7d6-2b72387df87b" path="/var/lib/kubelet/pods/8d14bf5a-31dc-4775-a7d6-2b72387df87b/volumes" May 21 20:29:56.251501 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.251466 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w"] May 21 20:29:56.252141 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.252091 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d14bf5a-31dc-4775-a7d6-2b72387df87b" containerName="manager" May 21 20:29:56.252141 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.252119 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d14bf5a-31dc-4775-a7d6-2b72387df87b" containerName="manager" May 21 20:29:56.252328 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.252236 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d14bf5a-31dc-4775-a7d6-2b72387df87b" containerName="manager" May 21 20:29:56.256809 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.256738 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.260478 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.260452 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-cn7sr\"" May 21 20:29:56.271824 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.271803 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w"] May 21 20:29:56.373292 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.373257 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b417779c-cde2-4085-b26f-53e753c62b73-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.373440 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.373300 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b417779c-cde2-4085-b26f-53e753c62b73-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.373440 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.373323 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tgqr\" (UniqueName: \"kubernetes.io/projected/b417779c-cde2-4085-b26f-53e753c62b73-kube-api-access-6tgqr\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.373440 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.373395 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b417779c-cde2-4085-b26f-53e753c62b73-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.373574 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.373448 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b417779c-cde2-4085-b26f-53e753c62b73-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.373574 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.373472 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b417779c-cde2-4085-b26f-53e753c62b73-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.373574 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.373488 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b417779c-cde2-4085-b26f-53e753c62b73-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.373574 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.373505 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b417779c-cde2-4085-b26f-53e753c62b73-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.373693 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.373572 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b417779c-cde2-4085-b26f-53e753c62b73-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.474563 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.474526 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b417779c-cde2-4085-b26f-53e753c62b73-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.474563 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.474567 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b417779c-cde2-4085-b26f-53e753c62b73-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.474776 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.474583 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b417779c-cde2-4085-b26f-53e753c62b73-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.474776 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.474701 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b417779c-cde2-4085-b26f-53e753c62b73-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.474897 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.474778 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b417779c-cde2-4085-b26f-53e753c62b73-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.474897 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.474824 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b417779c-cde2-4085-b26f-53e753c62b73-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.474897 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.474865 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b417779c-cde2-4085-b26f-53e753c62b73-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.475081 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.475037 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6tgqr\" (UniqueName: \"kubernetes.io/projected/b417779c-cde2-4085-b26f-53e753c62b73-kube-api-access-6tgqr\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.475146 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.474885 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b417779c-cde2-4085-b26f-53e753c62b73-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.475146 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.475129 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b417779c-cde2-4085-b26f-53e753c62b73-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.475248 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.475164 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b417779c-cde2-4085-b26f-53e753c62b73-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.475248 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.474975 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b417779c-cde2-4085-b26f-53e753c62b73-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.475248 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.475193 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b417779c-cde2-4085-b26f-53e753c62b73-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.475443 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.475417 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b417779c-cde2-4085-b26f-53e753c62b73-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.477294 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.477263 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b417779c-cde2-4085-b26f-53e753c62b73-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.477514 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.477492 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b417779c-cde2-4085-b26f-53e753c62b73-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.483895 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.483872 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b417779c-cde2-4085-b26f-53e753c62b73-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.484181 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.484119 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tgqr\" (UniqueName: \"kubernetes.io/projected/b417779c-cde2-4085-b26f-53e753c62b73-kube-api-access-6tgqr\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-8mm2w\" (UID: \"b417779c-cde2-4085-b26f-53e753c62b73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.574331 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.574250 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:29:56.713241 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:56.713217 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w"] May 21 20:29:56.715506 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:29:56.715481 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb417779c_cde2_4085_b26f_53e753c62b73.slice/crio-bfa11f4debfe13c7e935ddee1f237cc60db1573aa5c0822bb4945d963e1de287 WatchSource:0}: Error finding container bfa11f4debfe13c7e935ddee1f237cc60db1573aa5c0822bb4945d963e1de287: Status 404 returned error can't find the container with id bfa11f4debfe13c7e935ddee1f237cc60db1573aa5c0822bb4945d963e1de287 May 21 20:29:57.584359 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:57.584314 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" event={"ID":"b417779c-cde2-4085-b26f-53e753c62b73","Type":"ContainerStarted","Data":"bfa11f4debfe13c7e935ddee1f237cc60db1573aa5c0822bb4945d963e1de287"} May 21 20:29:59.271124 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:59.271088 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} May 21 20:29:59.271387 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:59.271156 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} May 21 20:29:59.271387 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:59.271181 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} May 21 20:29:59.592518 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:59.592486 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" event={"ID":"b417779c-cde2-4085-b26f-53e753c62b73","Type":"ContainerStarted","Data":"2ee67f0fd804c19103df43ba9d3a64af95f2eb610ad5972edbd26db2ea2eabe7"} May 21 20:29:59.610766 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:29:59.610711 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" podStartSLOduration=1.057876066 podStartE2EDuration="3.610695834s" podCreationTimestamp="2026-05-21 20:29:56 +0000 UTC" firstStartedPulling="2026-05-21 20:29:56.718003447 +0000 UTC m=+542.716392408" lastFinishedPulling="2026-05-21 20:29:59.270823202 +0000 UTC m=+545.269212176" observedRunningTime="2026-05-21 20:29:59.609675791 +0000 UTC m=+545.608064774" watchObservedRunningTime="2026-05-21 20:29:59.610695834 +0000 UTC m=+545.609084820" May 21 20:30:00.576100 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:00.576067 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:30:00.579618 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:00.579595 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:30:00.596139 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:00.596114 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:30:00.596784 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:00.596764 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-8mm2w" May 21 20:30:02.081731 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:02.081695 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:30:02.084129 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:02.084110 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-vzjpt" May 21 20:30:02.086406 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:02.086379 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kgdrv\"" May 21 20:30:02.086542 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:02.086444 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 21 20:30:02.091813 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:02.091791 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:30:02.122365 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:02.122340 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:30:02.229684 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:02.229656 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8b15b509-f924-45fe-a8de-60d7dfe03577-config-file\") pod \"limitador-limitador-78c99df468-vzjpt\" (UID: \"8b15b509-f924-45fe-a8de-60d7dfe03577\") " pod="kuadrant-system/limitador-limitador-78c99df468-vzjpt" May 21 20:30:02.229814 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:02.229735 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvdbv\" (UniqueName: \"kubernetes.io/projected/8b15b509-f924-45fe-a8de-60d7dfe03577-kube-api-access-rvdbv\") pod \"limitador-limitador-78c99df468-vzjpt\" (UID: \"8b15b509-f924-45fe-a8de-60d7dfe03577\") " pod="kuadrant-system/limitador-limitador-78c99df468-vzjpt" May 21 20:30:02.331005 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:02.330974 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rvdbv\" (UniqueName: \"kubernetes.io/projected/8b15b509-f924-45fe-a8de-60d7dfe03577-kube-api-access-rvdbv\") pod \"limitador-limitador-78c99df468-vzjpt\" (UID: \"8b15b509-f924-45fe-a8de-60d7dfe03577\") " pod="kuadrant-system/limitador-limitador-78c99df468-vzjpt" May 21 20:30:02.331005 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:02.331022 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8b15b509-f924-45fe-a8de-60d7dfe03577-config-file\") pod \"limitador-limitador-78c99df468-vzjpt\" (UID: \"8b15b509-f924-45fe-a8de-60d7dfe03577\") " pod="kuadrant-system/limitador-limitador-78c99df468-vzjpt" May 21 20:30:02.331650 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:02.331628 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8b15b509-f924-45fe-a8de-60d7dfe03577-config-file\") pod \"limitador-limitador-78c99df468-vzjpt\" (UID: \"8b15b509-f924-45fe-a8de-60d7dfe03577\") " pod="kuadrant-system/limitador-limitador-78c99df468-vzjpt" May 21 20:30:02.340716 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:02.340662 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvdbv\" (UniqueName: \"kubernetes.io/projected/8b15b509-f924-45fe-a8de-60d7dfe03577-kube-api-access-rvdbv\") pod \"limitador-limitador-78c99df468-vzjpt\" (UID: \"8b15b509-f924-45fe-a8de-60d7dfe03577\") " pod="kuadrant-system/limitador-limitador-78c99df468-vzjpt" May 21 20:30:02.394909 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:02.394884 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-vzjpt" May 21 20:30:02.539917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:02.539895 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:30:02.542082 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:30:02.542026 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b15b509_f924_45fe_a8de_60d7dfe03577.slice/crio-72c5ed129b7a28bd5770a1f7d8bc781e881c05a2823569b41b92d3ab874e1000 WatchSource:0}: Error finding container 72c5ed129b7a28bd5770a1f7d8bc781e881c05a2823569b41b92d3ab874e1000: Status 404 returned error can't find the container with id 72c5ed129b7a28bd5770a1f7d8bc781e881c05a2823569b41b92d3ab874e1000 May 21 20:30:02.603973 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:02.603900 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-vzjpt" event={"ID":"8b15b509-f924-45fe-a8de-60d7dfe03577","Type":"ContainerStarted","Data":"72c5ed129b7a28bd5770a1f7d8bc781e881c05a2823569b41b92d3ab874e1000"} May 21 20:30:05.619887 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:05.619851 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-vzjpt" event={"ID":"8b15b509-f924-45fe-a8de-60d7dfe03577","Type":"ContainerStarted","Data":"b27fc5a5d86b6db979005267aef5c879541d5e711def64c6574bf1649bb4407c"} May 21 20:30:05.620280 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:05.619971 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-vzjpt" May 21 20:30:05.636583 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:05.636529 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-vzjpt" podStartSLOduration=1.078141973 podStartE2EDuration="3.636515676s" podCreationTimestamp="2026-05-21 20:30:02 +0000 UTC" firstStartedPulling="2026-05-21 20:30:02.54419416 +0000 UTC m=+548.542583130" lastFinishedPulling="2026-05-21 20:30:05.102567864 +0000 UTC m=+551.100956833" observedRunningTime="2026-05-21 20:30:05.634465801 +0000 UTC m=+551.632854804" watchObservedRunningTime="2026-05-21 20:30:05.636515676 +0000 UTC m=+551.634904658" May 21 20:30:16.624800 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:16.624769 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-vzjpt" May 21 20:30:31.552718 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:31.552675 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7"] May 21 20:30:31.559627 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:31.559601 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7" May 21 20:30:31.561735 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:31.561709 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7"] May 21 20:30:31.562214 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:31.562196 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 20:30:31.562321 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:31.562196 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2zshn\"" May 21 20:30:31.562938 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:31.562923 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 20:30:31.683020 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:31.682981 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7\" (UID: \"b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7" May 21 20:30:31.683020 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:31.683022 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7\" (UID: \"b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7" May 21 20:30:31.683303 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:31.683189 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdk56\" (UniqueName: \"kubernetes.io/projected/b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967-kube-api-access-bdk56\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7\" (UID: \"b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7" May 21 20:30:31.784558 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:31.784473 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7\" (UID: \"b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7" May 21 20:30:31.784558 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:31.784514 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7\" (UID: \"b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7" May 21 20:30:31.784735 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:31.784575 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bdk56\" (UniqueName: \"kubernetes.io/projected/b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967-kube-api-access-bdk56\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7\" (UID: \"b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7" May 21 20:30:31.784925 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:31.784903 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7\" (UID: \"b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7" May 21 20:30:31.784966 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:31.784911 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7\" (UID: \"b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7" May 21 20:30:31.793365 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:31.793341 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdk56\" (UniqueName: \"kubernetes.io/projected/b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967-kube-api-access-bdk56\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7\" (UID: \"b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7" May 21 20:30:31.869805 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:31.869774 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7" May 21 20:30:32.005210 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:32.005177 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7"] May 21 20:30:32.006419 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:30:32.006390 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6a8ae17_f9b3_4632_a4f6_78cfb3ba0967.slice/crio-25aa213132f7283a56e46e1aa78f3c487106f736f311464d3c0bf72bb5d5a8bb WatchSource:0}: Error finding container 25aa213132f7283a56e46e1aa78f3c487106f736f311464d3c0bf72bb5d5a8bb: Status 404 returned error can't find the container with id 25aa213132f7283a56e46e1aa78f3c487106f736f311464d3c0bf72bb5d5a8bb May 21 20:30:32.716918 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:32.716887 2559 generic.go:358] "Generic (PLEG): container finished" podID="b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967" containerID="fc03d5dd60f478b97f3bf5d859eeddecda6bf144550c5242b5408fcce3513b0f" exitCode=0 May 21 20:30:32.717299 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:32.716969 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7" event={"ID":"b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967","Type":"ContainerDied","Data":"fc03d5dd60f478b97f3bf5d859eeddecda6bf144550c5242b5408fcce3513b0f"} May 21 20:30:32.717299 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:32.717001 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7" event={"ID":"b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967","Type":"ContainerStarted","Data":"25aa213132f7283a56e46e1aa78f3c487106f736f311464d3c0bf72bb5d5a8bb"} May 21 20:30:33.722110 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:33.722012 2559 generic.go:358] "Generic (PLEG): container finished" podID="b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967" containerID="5bf097a03043c133d90550af5c05259ae0a184d7d89fbae6300ba119fc3ac0d8" exitCode=0 May 21 20:30:33.722463 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:33.722100 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7" event={"ID":"b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967","Type":"ContainerDied","Data":"5bf097a03043c133d90550af5c05259ae0a184d7d89fbae6300ba119fc3ac0d8"} May 21 20:30:34.727132 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:34.727089 2559 generic.go:358] "Generic (PLEG): container finished" podID="b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967" containerID="c16c112a9857308822a50ef4d9a16db705a4d57af0b5f4817b9f306341a32680" exitCode=0 May 21 20:30:34.727502 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:34.727165 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7" event={"ID":"b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967","Type":"ContainerDied","Data":"c16c112a9857308822a50ef4d9a16db705a4d57af0b5f4817b9f306341a32680"} May 21 20:30:35.861602 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:35.861580 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7" May 21 20:30:35.920885 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:35.920857 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967-bundle\") pod \"b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967\" (UID: \"b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967\") " May 21 20:30:35.921043 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:35.920948 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967-util\") pod \"b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967\" (UID: \"b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967\") " May 21 20:30:35.921043 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:35.921016 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdk56\" (UniqueName: \"kubernetes.io/projected/b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967-kube-api-access-bdk56\") pod \"b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967\" (UID: \"b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967\") " May 21 20:30:35.921417 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:35.921393 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967-bundle" (OuterVolumeSpecName: "bundle") pod "b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967" (UID: "b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:30:35.923259 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:35.923233 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967-kube-api-access-bdk56" (OuterVolumeSpecName: "kube-api-access-bdk56") pod "b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967" (UID: "b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967"). InnerVolumeSpecName "kube-api-access-bdk56". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:30:35.926377 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:35.926355 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967-util" (OuterVolumeSpecName: "util") pod "b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967" (UID: "b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 20:30:36.022381 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:36.022307 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967-util\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:30:36.022381 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:36.022337 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdk56\" (UniqueName: \"kubernetes.io/projected/b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967-kube-api-access-bdk56\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:30:36.022381 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:36.022348 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967-bundle\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:30:36.736570 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:36.736531 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7" event={"ID":"b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967","Type":"ContainerDied","Data":"25aa213132f7283a56e46e1aa78f3c487106f736f311464d3c0bf72bb5d5a8bb"} May 21 20:30:36.736570 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:36.736565 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70krwr7" May 21 20:30:36.736570 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:30:36.736571 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25aa213132f7283a56e46e1aa78f3c487106f736f311464d3c0bf72bb5d5a8bb" May 21 20:31:31.547301 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.547271 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7df575f8c9-pnlpb"] May 21 20:31:31.547971 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.547630 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967" containerName="util" May 21 20:31:31.547971 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.547643 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967" containerName="util" May 21 20:31:31.547971 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.547653 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967" containerName="extract" May 21 20:31:31.547971 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.547658 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967" containerName="extract" May 21 20:31:31.547971 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.547671 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967" containerName="pull" May 21 20:31:31.547971 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.547675 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967" containerName="pull" May 21 20:31:31.547971 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.547727 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="b6a8ae17-f9b3-4632-a4f6-78cfb3ba0967" containerName="extract" May 21 20:31:31.549786 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.549765 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-pnlpb" May 21 20:31:31.552448 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.552427 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 20:31:31.552448 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.552438 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-m25cs\"" May 21 20:31:31.559742 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.559720 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-pnlpb"] May 21 20:31:31.700045 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.700005 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-674f9974dc-2l457"] May 21 20:31:31.708949 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.708923 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-674f9974dc-2l457" May 21 20:31:31.710537 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.710513 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-674f9974dc-2l457"] May 21 20:31:31.713794 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.713770 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ckgp\" (UniqueName: \"kubernetes.io/projected/5b235ab8-a92d-4b99-abbd-7f8d049cfd2e-kube-api-access-4ckgp\") pod \"maas-controller-7df575f8c9-pnlpb\" (UID: \"5b235ab8-a92d-4b99-abbd-7f8d049cfd2e\") " pod="opendatahub/maas-controller-7df575f8c9-pnlpb" May 21 20:31:31.814635 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.814537 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5szj\" (UniqueName: \"kubernetes.io/projected/bb922c31-75c3-4e64-8189-3304aac21132-kube-api-access-g5szj\") pod \"maas-controller-674f9974dc-2l457\" (UID: \"bb922c31-75c3-4e64-8189-3304aac21132\") " pod="opendatahub/maas-controller-674f9974dc-2l457" May 21 20:31:31.814635 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.814596 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4ckgp\" (UniqueName: \"kubernetes.io/projected/5b235ab8-a92d-4b99-abbd-7f8d049cfd2e-kube-api-access-4ckgp\") pod \"maas-controller-7df575f8c9-pnlpb\" (UID: \"5b235ab8-a92d-4b99-abbd-7f8d049cfd2e\") " pod="opendatahub/maas-controller-7df575f8c9-pnlpb" May 21 20:31:31.822880 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.822840 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ckgp\" (UniqueName: \"kubernetes.io/projected/5b235ab8-a92d-4b99-abbd-7f8d049cfd2e-kube-api-access-4ckgp\") pod \"maas-controller-7df575f8c9-pnlpb\" (UID: \"5b235ab8-a92d-4b99-abbd-7f8d049cfd2e\") " pod="opendatahub/maas-controller-7df575f8c9-pnlpb" May 21 20:31:31.826267 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.826238 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-674f9974dc-2l457"] May 21 20:31:31.826527 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:31:31.826507 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-g5szj], unattached volumes=[], failed to process volumes=[]: context canceled" pod="opendatahub/maas-controller-674f9974dc-2l457" podUID="bb922c31-75c3-4e64-8189-3304aac21132" May 21 20:31:31.861142 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.861109 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-pnlpb" May 21 20:31:31.915958 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.915821 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5szj\" (UniqueName: \"kubernetes.io/projected/bb922c31-75c3-4e64-8189-3304aac21132-kube-api-access-g5szj\") pod \"maas-controller-674f9974dc-2l457\" (UID: \"bb922c31-75c3-4e64-8189-3304aac21132\") " pod="opendatahub/maas-controller-674f9974dc-2l457" May 21 20:31:31.924987 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.924949 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5szj\" (UniqueName: \"kubernetes.io/projected/bb922c31-75c3-4e64-8189-3304aac21132-kube-api-access-g5szj\") pod \"maas-controller-674f9974dc-2l457\" (UID: \"bb922c31-75c3-4e64-8189-3304aac21132\") " pod="opendatahub/maas-controller-674f9974dc-2l457" May 21 20:31:31.946877 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.946847 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-674f9974dc-2l457" May 21 20:31:31.953207 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.953182 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-674f9974dc-2l457" May 21 20:31:31.999954 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:31.999930 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-pnlpb"] May 21 20:31:32.006376 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:31:32.002558 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b235ab8_a92d_4b99_abbd_7f8d049cfd2e.slice/crio-20f8141bd74eea5a85f83b8f0423ef7cbaaed225e35030f4e0fd997145e18f09 WatchSource:0}: Error finding container 20f8141bd74eea5a85f83b8f0423ef7cbaaed225e35030f4e0fd997145e18f09: Status 404 returned error can't find the container with id 20f8141bd74eea5a85f83b8f0423ef7cbaaed225e35030f4e0fd997145e18f09 May 21 20:31:32.006376 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:32.004010 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 20:31:32.118011 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:32.117972 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5szj\" (UniqueName: \"kubernetes.io/projected/bb922c31-75c3-4e64-8189-3304aac21132-kube-api-access-g5szj\") pod \"bb922c31-75c3-4e64-8189-3304aac21132\" (UID: \"bb922c31-75c3-4e64-8189-3304aac21132\") " May 21 20:31:32.120339 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:32.120308 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb922c31-75c3-4e64-8189-3304aac21132-kube-api-access-g5szj" (OuterVolumeSpecName: "kube-api-access-g5szj") pod "bb922c31-75c3-4e64-8189-3304aac21132" (UID: "bb922c31-75c3-4e64-8189-3304aac21132"). InnerVolumeSpecName "kube-api-access-g5szj". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:31:32.219531 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:32.219496 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5szj\" (UniqueName: \"kubernetes.io/projected/bb922c31-75c3-4e64-8189-3304aac21132-kube-api-access-g5szj\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:31:32.953162 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:32.953073 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df575f8c9-pnlpb" event={"ID":"5b235ab8-a92d-4b99-abbd-7f8d049cfd2e","Type":"ContainerStarted","Data":"20f8141bd74eea5a85f83b8f0423ef7cbaaed225e35030f4e0fd997145e18f09"} May 21 20:31:32.953162 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:32.953117 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-674f9974dc-2l457" May 21 20:31:33.004207 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:33.004168 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-674f9974dc-2l457"] May 21 20:31:33.010493 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:33.010462 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-674f9974dc-2l457"] May 21 20:31:34.577735 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:34.577698 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb922c31-75c3-4e64-8189-3304aac21132" path="/var/lib/kubelet/pods/bb922c31-75c3-4e64-8189-3304aac21132/volumes" May 21 20:31:34.963291 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:34.963253 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df575f8c9-pnlpb" event={"ID":"5b235ab8-a92d-4b99-abbd-7f8d049cfd2e","Type":"ContainerStarted","Data":"faf362eb13eb41ea659a19e33dcd7dc2270821f666b84b8fe5b8f35d459dfb65"} May 21 20:31:34.963470 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:34.963414 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7df575f8c9-pnlpb" May 21 20:31:34.995525 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:34.995477 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7df575f8c9-pnlpb" podStartSLOduration=1.551768372 podStartE2EDuration="3.995463731s" podCreationTimestamp="2026-05-21 20:31:31 +0000 UTC" firstStartedPulling="2026-05-21 20:31:32.004235287 +0000 UTC m=+638.002624251" lastFinishedPulling="2026-05-21 20:31:34.44793065 +0000 UTC m=+640.446319610" observedRunningTime="2026-05-21 20:31:34.993886042 +0000 UTC m=+640.992275050" watchObservedRunningTime="2026-05-21 20:31:34.995463731 +0000 UTC m=+640.993852766" May 21 20:31:45.974018 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:45.973991 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7df575f8c9-pnlpb" May 21 20:31:46.467250 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:46.467203 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-pnlpb"] May 21 20:31:46.467491 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:46.467452 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7df575f8c9-pnlpb" podUID="5b235ab8-a92d-4b99-abbd-7f8d049cfd2e" containerName="manager" containerID="cri-o://faf362eb13eb41ea659a19e33dcd7dc2270821f666b84b8fe5b8f35d459dfb65" gracePeriod=30 May 21 20:31:46.643549 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:46.643514 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b56d58d6b-ncfrx"] May 21 20:31:46.646377 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:46.646357 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b56d58d6b-ncfrx" May 21 20:31:46.656167 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:46.656142 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b56d58d6b-ncfrx"] May 21 20:31:46.707025 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:46.707002 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-pnlpb" May 21 20:31:46.738692 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:46.738625 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdrj6\" (UniqueName: \"kubernetes.io/projected/01569fed-c89b-460a-ba9e-93c6652d5838-kube-api-access-tdrj6\") pod \"maas-controller-6b56d58d6b-ncfrx\" (UID: \"01569fed-c89b-460a-ba9e-93c6652d5838\") " pod="opendatahub/maas-controller-6b56d58d6b-ncfrx" May 21 20:31:46.839236 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:46.839203 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ckgp\" (UniqueName: \"kubernetes.io/projected/5b235ab8-a92d-4b99-abbd-7f8d049cfd2e-kube-api-access-4ckgp\") pod \"5b235ab8-a92d-4b99-abbd-7f8d049cfd2e\" (UID: \"5b235ab8-a92d-4b99-abbd-7f8d049cfd2e\") " May 21 20:31:46.839377 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:46.839309 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tdrj6\" (UniqueName: \"kubernetes.io/projected/01569fed-c89b-460a-ba9e-93c6652d5838-kube-api-access-tdrj6\") pod \"maas-controller-6b56d58d6b-ncfrx\" (UID: \"01569fed-c89b-460a-ba9e-93c6652d5838\") " pod="opendatahub/maas-controller-6b56d58d6b-ncfrx" May 21 20:31:46.841487 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:46.841462 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b235ab8-a92d-4b99-abbd-7f8d049cfd2e-kube-api-access-4ckgp" (OuterVolumeSpecName: "kube-api-access-4ckgp") pod "5b235ab8-a92d-4b99-abbd-7f8d049cfd2e" (UID: "5b235ab8-a92d-4b99-abbd-7f8d049cfd2e"). InnerVolumeSpecName "kube-api-access-4ckgp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:31:46.847654 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:46.847630 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdrj6\" (UniqueName: \"kubernetes.io/projected/01569fed-c89b-460a-ba9e-93c6652d5838-kube-api-access-tdrj6\") pod \"maas-controller-6b56d58d6b-ncfrx\" (UID: \"01569fed-c89b-460a-ba9e-93c6652d5838\") " pod="opendatahub/maas-controller-6b56d58d6b-ncfrx" May 21 20:31:46.939861 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:46.939832 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ckgp\" (UniqueName: \"kubernetes.io/projected/5b235ab8-a92d-4b99-abbd-7f8d049cfd2e-kube-api-access-4ckgp\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:31:46.960193 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:46.960170 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b56d58d6b-ncfrx" May 21 20:31:47.015881 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:47.015138 2559 generic.go:358] "Generic (PLEG): container finished" podID="5b235ab8-a92d-4b99-abbd-7f8d049cfd2e" containerID="faf362eb13eb41ea659a19e33dcd7dc2270821f666b84b8fe5b8f35d459dfb65" exitCode=0 May 21 20:31:47.015881 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:47.015222 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-pnlpb" May 21 20:31:47.015881 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:47.015324 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df575f8c9-pnlpb" event={"ID":"5b235ab8-a92d-4b99-abbd-7f8d049cfd2e","Type":"ContainerDied","Data":"faf362eb13eb41ea659a19e33dcd7dc2270821f666b84b8fe5b8f35d459dfb65"} May 21 20:31:47.015881 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:47.015356 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df575f8c9-pnlpb" event={"ID":"5b235ab8-a92d-4b99-abbd-7f8d049cfd2e","Type":"ContainerDied","Data":"20f8141bd74eea5a85f83b8f0423ef7cbaaed225e35030f4e0fd997145e18f09"} May 21 20:31:47.015881 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:47.015377 2559 scope.go:117] "RemoveContainer" containerID="faf362eb13eb41ea659a19e33dcd7dc2270821f666b84b8fe5b8f35d459dfb65" May 21 20:31:47.025017 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:47.024927 2559 scope.go:117] "RemoveContainer" containerID="faf362eb13eb41ea659a19e33dcd7dc2270821f666b84b8fe5b8f35d459dfb65" May 21 20:31:47.025291 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:31:47.025262 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"faf362eb13eb41ea659a19e33dcd7dc2270821f666b84b8fe5b8f35d459dfb65\": container with ID starting with faf362eb13eb41ea659a19e33dcd7dc2270821f666b84b8fe5b8f35d459dfb65 not found: ID does not exist" containerID="faf362eb13eb41ea659a19e33dcd7dc2270821f666b84b8fe5b8f35d459dfb65" May 21 20:31:47.025387 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:47.025302 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faf362eb13eb41ea659a19e33dcd7dc2270821f666b84b8fe5b8f35d459dfb65"} err="failed to get container status \"faf362eb13eb41ea659a19e33dcd7dc2270821f666b84b8fe5b8f35d459dfb65\": rpc error: code = NotFound desc = could not find container \"faf362eb13eb41ea659a19e33dcd7dc2270821f666b84b8fe5b8f35d459dfb65\": container with ID starting with faf362eb13eb41ea659a19e33dcd7dc2270821f666b84b8fe5b8f35d459dfb65 not found: ID does not exist" May 21 20:31:47.040154 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:47.039870 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-pnlpb"] May 21 20:31:47.044705 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:47.044681 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-pnlpb"] May 21 20:31:47.090307 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:47.090281 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b56d58d6b-ncfrx"] May 21 20:31:47.091706 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:31:47.091679 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01569fed_c89b_460a_ba9e_93c6652d5838.slice/crio-f95dbef9bc4d2b7da0a890151434353a1afccacd8ea637a5db64b39139ec15e4 WatchSource:0}: Error finding container f95dbef9bc4d2b7da0a890151434353a1afccacd8ea637a5db64b39139ec15e4: Status 404 returned error can't find the container with id f95dbef9bc4d2b7da0a890151434353a1afccacd8ea637a5db64b39139ec15e4 May 21 20:31:48.021311 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:48.021272 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b56d58d6b-ncfrx" event={"ID":"01569fed-c89b-460a-ba9e-93c6652d5838","Type":"ContainerStarted","Data":"f95dbef9bc4d2b7da0a890151434353a1afccacd8ea637a5db64b39139ec15e4"} May 21 20:31:48.577939 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:48.577903 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b235ab8-a92d-4b99-abbd-7f8d049cfd2e" path="/var/lib/kubelet/pods/5b235ab8-a92d-4b99-abbd-7f8d049cfd2e/volumes" May 21 20:31:49.026474 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:49.026438 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b56d58d6b-ncfrx" event={"ID":"01569fed-c89b-460a-ba9e-93c6652d5838","Type":"ContainerStarted","Data":"0375a669194b83c856322ecaaf208c1ccf0806bb66e118b4ead97cb3aecabc83"} May 21 20:31:49.026851 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:49.026567 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b56d58d6b-ncfrx" May 21 20:31:49.043944 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:31:49.043896 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6b56d58d6b-ncfrx" podStartSLOduration=1.481563566 podStartE2EDuration="3.043884369s" podCreationTimestamp="2026-05-21 20:31:46 +0000 UTC" firstStartedPulling="2026-05-21 20:31:47.093091101 +0000 UTC m=+653.091480062" lastFinishedPulling="2026-05-21 20:31:48.655411901 +0000 UTC m=+654.653800865" observedRunningTime="2026-05-21 20:31:49.042086564 +0000 UTC m=+655.040475548" watchObservedRunningTime="2026-05-21 20:31:49.043884369 +0000 UTC m=+655.042273351" May 21 20:32:00.036980 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:32:00.036946 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b56d58d6b-ncfrx" May 21 20:32:07.695486 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:32:07.695451 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-8dd8d786c-q8w4f"] May 21 20:32:07.696123 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:32:07.696099 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b235ab8-a92d-4b99-abbd-7f8d049cfd2e" containerName="manager" May 21 20:32:07.696204 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:32:07.696125 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b235ab8-a92d-4b99-abbd-7f8d049cfd2e" containerName="manager" May 21 20:32:07.696257 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:32:07.696239 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="5b235ab8-a92d-4b99-abbd-7f8d049cfd2e" containerName="manager" May 21 20:32:07.701047 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:32:07.701023 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8dd8d786c-q8w4f" May 21 20:32:07.705467 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:32:07.705445 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 21 20:32:07.705584 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:32:07.705447 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-86qzh\"" May 21 20:32:07.713850 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:32:07.713829 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8dd8d786c-q8w4f"] May 21 20:32:07.798104 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:32:07.798044 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05f35afc-73f7-4f63-81a8-8f66b4851240-maas-api-tls\") pod \"maas-api-8dd8d786c-q8w4f\" (UID: \"05f35afc-73f7-4f63-81a8-8f66b4851240\") " pod="opendatahub/maas-api-8dd8d786c-q8w4f" May 21 20:32:07.798273 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:32:07.798174 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h2vj\" (UniqueName: \"kubernetes.io/projected/05f35afc-73f7-4f63-81a8-8f66b4851240-kube-api-access-2h2vj\") pod \"maas-api-8dd8d786c-q8w4f\" (UID: \"05f35afc-73f7-4f63-81a8-8f66b4851240\") " pod="opendatahub/maas-api-8dd8d786c-q8w4f" May 21 20:32:07.899365 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:32:07.899335 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2h2vj\" (UniqueName: \"kubernetes.io/projected/05f35afc-73f7-4f63-81a8-8f66b4851240-kube-api-access-2h2vj\") pod \"maas-api-8dd8d786c-q8w4f\" (UID: \"05f35afc-73f7-4f63-81a8-8f66b4851240\") " pod="opendatahub/maas-api-8dd8d786c-q8w4f" May 21 20:32:07.899533 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:32:07.899400 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05f35afc-73f7-4f63-81a8-8f66b4851240-maas-api-tls\") pod \"maas-api-8dd8d786c-q8w4f\" (UID: \"05f35afc-73f7-4f63-81a8-8f66b4851240\") " pod="opendatahub/maas-api-8dd8d786c-q8w4f" May 21 20:32:07.902033 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:32:07.902001 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05f35afc-73f7-4f63-81a8-8f66b4851240-maas-api-tls\") pod \"maas-api-8dd8d786c-q8w4f\" (UID: \"05f35afc-73f7-4f63-81a8-8f66b4851240\") " pod="opendatahub/maas-api-8dd8d786c-q8w4f" May 21 20:32:07.907845 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:32:07.907818 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h2vj\" (UniqueName: \"kubernetes.io/projected/05f35afc-73f7-4f63-81a8-8f66b4851240-kube-api-access-2h2vj\") pod \"maas-api-8dd8d786c-q8w4f\" (UID: \"05f35afc-73f7-4f63-81a8-8f66b4851240\") " pod="opendatahub/maas-api-8dd8d786c-q8w4f" May 21 20:32:08.012754 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:32:08.012664 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8dd8d786c-q8w4f" May 21 20:32:08.165422 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:32:08.165321 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8dd8d786c-q8w4f"] May 21 20:32:08.167711 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:32:08.167678 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05f35afc_73f7_4f63_81a8_8f66b4851240.slice/crio-3f0f82593a431445ff3267b31cc7fd54403db5fd718ed81cee861d3262e53712 WatchSource:0}: Error finding container 3f0f82593a431445ff3267b31cc7fd54403db5fd718ed81cee861d3262e53712: Status 404 returned error can't find the container with id 3f0f82593a431445ff3267b31cc7fd54403db5fd718ed81cee861d3262e53712 May 21 20:32:08.376481 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:32:08.376444 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:32:09.110142 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:32:09.110103 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8dd8d786c-q8w4f" event={"ID":"05f35afc-73f7-4f63-81a8-8f66b4851240","Type":"ContainerStarted","Data":"3f0f82593a431445ff3267b31cc7fd54403db5fd718ed81cee861d3262e53712"} May 21 20:32:10.115454 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:32:10.115414 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8dd8d786c-q8w4f" event={"ID":"05f35afc-73f7-4f63-81a8-8f66b4851240","Type":"ContainerStarted","Data":"a7745b44096e554bb25c2e970d6fb3ed5041a76dae614620e21d361e6012f2b2"} May 21 20:32:10.115881 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:32:10.115464 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-8dd8d786c-q8w4f" May 21 20:32:10.132079 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:32:10.132005 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-8dd8d786c-q8w4f" podStartSLOduration=1.5234295599999998 podStartE2EDuration="3.131988016s" podCreationTimestamp="2026-05-21 20:32:07 +0000 UTC" firstStartedPulling="2026-05-21 20:32:08.169413109 +0000 UTC m=+674.167802085" lastFinishedPulling="2026-05-21 20:32:09.777971578 +0000 UTC m=+675.776360541" observedRunningTime="2026-05-21 20:32:10.130855139 +0000 UTC m=+676.129244157" watchObservedRunningTime="2026-05-21 20:32:10.131988016 +0000 UTC m=+676.130377000" May 21 20:32:16.124122 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:32:16.124092 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-8dd8d786c-q8w4f" May 21 20:33:15.987443 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:15.987403 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:33:19.584011 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:19.583973 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:33:25.184783 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.184741 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229"] May 21 20:33:25.187289 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.187272 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" May 21 20:33:25.189801 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.189781 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 21 20:33:25.189898 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.189817 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 20:33:25.190583 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.190560 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 20:33:25.190673 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.190621 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2v2zc\"" May 21 20:33:25.196983 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.196963 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229"] May 21 20:33:25.283811 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.283776 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5443bb37-08da-42a2-910b-df5dfc5f5100-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-wb229\" (UID: \"5443bb37-08da-42a2-910b-df5dfc5f5100\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" May 21 20:33:25.283989 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.283824 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5443bb37-08da-42a2-910b-df5dfc5f5100-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-wb229\" (UID: \"5443bb37-08da-42a2-910b-df5dfc5f5100\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" May 21 20:33:25.283989 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.283851 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5443bb37-08da-42a2-910b-df5dfc5f5100-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-wb229\" (UID: \"5443bb37-08da-42a2-910b-df5dfc5f5100\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" May 21 20:33:25.283989 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.283931 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xnd4\" (UniqueName: \"kubernetes.io/projected/5443bb37-08da-42a2-910b-df5dfc5f5100-kube-api-access-8xnd4\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-wb229\" (UID: \"5443bb37-08da-42a2-910b-df5dfc5f5100\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" May 21 20:33:25.284153 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.284015 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5443bb37-08da-42a2-910b-df5dfc5f5100-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-wb229\" (UID: \"5443bb37-08da-42a2-910b-df5dfc5f5100\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" May 21 20:33:25.284153 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.284034 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5443bb37-08da-42a2-910b-df5dfc5f5100-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-wb229\" (UID: \"5443bb37-08da-42a2-910b-df5dfc5f5100\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" May 21 20:33:25.385246 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.385212 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5443bb37-08da-42a2-910b-df5dfc5f5100-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-wb229\" (UID: \"5443bb37-08da-42a2-910b-df5dfc5f5100\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" May 21 20:33:25.385246 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.385252 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5443bb37-08da-42a2-910b-df5dfc5f5100-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-wb229\" (UID: \"5443bb37-08da-42a2-910b-df5dfc5f5100\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" May 21 20:33:25.385489 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.385289 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5443bb37-08da-42a2-910b-df5dfc5f5100-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-wb229\" (UID: \"5443bb37-08da-42a2-910b-df5dfc5f5100\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" May 21 20:33:25.385489 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.385315 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5443bb37-08da-42a2-910b-df5dfc5f5100-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-wb229\" (UID: \"5443bb37-08da-42a2-910b-df5dfc5f5100\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" May 21 20:33:25.385489 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.385343 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5443bb37-08da-42a2-910b-df5dfc5f5100-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-wb229\" (UID: \"5443bb37-08da-42a2-910b-df5dfc5f5100\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" May 21 20:33:25.385489 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.385361 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xnd4\" (UniqueName: \"kubernetes.io/projected/5443bb37-08da-42a2-910b-df5dfc5f5100-kube-api-access-8xnd4\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-wb229\" (UID: \"5443bb37-08da-42a2-910b-df5dfc5f5100\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" May 21 20:33:25.385747 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.385723 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5443bb37-08da-42a2-910b-df5dfc5f5100-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-wb229\" (UID: \"5443bb37-08da-42a2-910b-df5dfc5f5100\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" May 21 20:33:25.385824 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.385752 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5443bb37-08da-42a2-910b-df5dfc5f5100-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-wb229\" (UID: \"5443bb37-08da-42a2-910b-df5dfc5f5100\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" May 21 20:33:25.385824 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.385779 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5443bb37-08da-42a2-910b-df5dfc5f5100-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-wb229\" (UID: \"5443bb37-08da-42a2-910b-df5dfc5f5100\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" May 21 20:33:25.387975 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.387953 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5443bb37-08da-42a2-910b-df5dfc5f5100-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-wb229\" (UID: \"5443bb37-08da-42a2-910b-df5dfc5f5100\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" May 21 20:33:25.388363 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.388336 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5443bb37-08da-42a2-910b-df5dfc5f5100-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-wb229\" (UID: \"5443bb37-08da-42a2-910b-df5dfc5f5100\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" May 21 20:33:25.394322 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.394298 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xnd4\" (UniqueName: \"kubernetes.io/projected/5443bb37-08da-42a2-910b-df5dfc5f5100-kube-api-access-8xnd4\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-wb229\" (UID: \"5443bb37-08da-42a2-910b-df5dfc5f5100\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" May 21 20:33:25.498280 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.498189 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" May 21 20:33:25.645769 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:25.645707 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229"] May 21 20:33:25.648596 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:33:25.648562 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5443bb37_08da_42a2_910b_df5dfc5f5100.slice/crio-f2418ab8c7d6a71412f408bf88fc600c8bde101d32a71d76864f61d4e6a16807 WatchSource:0}: Error finding container f2418ab8c7d6a71412f408bf88fc600c8bde101d32a71d76864f61d4e6a16807: Status 404 returned error can't find the container with id f2418ab8c7d6a71412f408bf88fc600c8bde101d32a71d76864f61d4e6a16807 May 21 20:33:26.407295 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:26.407253 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" event={"ID":"5443bb37-08da-42a2-910b-df5dfc5f5100","Type":"ContainerStarted","Data":"f2418ab8c7d6a71412f408bf88fc600c8bde101d32a71d76864f61d4e6a16807"} May 21 20:33:26.484800 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:26.484766 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:33:29.772553 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:29.772514 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx"] May 21 20:33:29.791808 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:29.791771 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx"] May 21 20:33:29.791977 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:29.791910 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" May 21 20:33:29.794699 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:29.794669 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 21 20:33:29.936274 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:29.936233 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b90ecabe-b8c8-4d15-a4c2-d3c569b033f2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwqx\" (UID: \"b90ecabe-b8c8-4d15-a4c2-d3c569b033f2\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" May 21 20:33:29.936451 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:29.936348 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b90ecabe-b8c8-4d15-a4c2-d3c569b033f2-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwqx\" (UID: \"b90ecabe-b8c8-4d15-a4c2-d3c569b033f2\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" May 21 20:33:29.936451 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:29.936429 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc8pv\" (UniqueName: \"kubernetes.io/projected/b90ecabe-b8c8-4d15-a4c2-d3c569b033f2-kube-api-access-gc8pv\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwqx\" (UID: \"b90ecabe-b8c8-4d15-a4c2-d3c569b033f2\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" May 21 20:33:29.936594 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:29.936480 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b90ecabe-b8c8-4d15-a4c2-d3c569b033f2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwqx\" (UID: \"b90ecabe-b8c8-4d15-a4c2-d3c569b033f2\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" May 21 20:33:29.936594 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:29.936560 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b90ecabe-b8c8-4d15-a4c2-d3c569b033f2-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwqx\" (UID: \"b90ecabe-b8c8-4d15-a4c2-d3c569b033f2\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" May 21 20:33:29.936693 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:29.936611 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b90ecabe-b8c8-4d15-a4c2-d3c569b033f2-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwqx\" (UID: \"b90ecabe-b8c8-4d15-a4c2-d3c569b033f2\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" May 21 20:33:30.037971 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:30.037878 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b90ecabe-b8c8-4d15-a4c2-d3c569b033f2-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwqx\" (UID: \"b90ecabe-b8c8-4d15-a4c2-d3c569b033f2\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" May 21 20:33:30.037971 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:30.037959 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gc8pv\" (UniqueName: \"kubernetes.io/projected/b90ecabe-b8c8-4d15-a4c2-d3c569b033f2-kube-api-access-gc8pv\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwqx\" (UID: \"b90ecabe-b8c8-4d15-a4c2-d3c569b033f2\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" May 21 20:33:30.038235 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:30.038009 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b90ecabe-b8c8-4d15-a4c2-d3c569b033f2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwqx\" (UID: \"b90ecabe-b8c8-4d15-a4c2-d3c569b033f2\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" May 21 20:33:30.038235 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:30.038045 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b90ecabe-b8c8-4d15-a4c2-d3c569b033f2-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwqx\" (UID: \"b90ecabe-b8c8-4d15-a4c2-d3c569b033f2\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" May 21 20:33:30.038235 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:30.038098 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b90ecabe-b8c8-4d15-a4c2-d3c569b033f2-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwqx\" (UID: \"b90ecabe-b8c8-4d15-a4c2-d3c569b033f2\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" May 21 20:33:30.038235 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:30.038153 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b90ecabe-b8c8-4d15-a4c2-d3c569b033f2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwqx\" (UID: \"b90ecabe-b8c8-4d15-a4c2-d3c569b033f2\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" May 21 20:33:30.039041 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:30.038840 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b90ecabe-b8c8-4d15-a4c2-d3c569b033f2-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwqx\" (UID: \"b90ecabe-b8c8-4d15-a4c2-d3c569b033f2\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" May 21 20:33:30.039041 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:30.038997 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b90ecabe-b8c8-4d15-a4c2-d3c569b033f2-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwqx\" (UID: \"b90ecabe-b8c8-4d15-a4c2-d3c569b033f2\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" May 21 20:33:30.039402 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:30.039360 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b90ecabe-b8c8-4d15-a4c2-d3c569b033f2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwqx\" (UID: \"b90ecabe-b8c8-4d15-a4c2-d3c569b033f2\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" May 21 20:33:30.040720 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:30.040697 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b90ecabe-b8c8-4d15-a4c2-d3c569b033f2-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwqx\" (UID: \"b90ecabe-b8c8-4d15-a4c2-d3c569b033f2\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" May 21 20:33:30.041629 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:30.041570 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b90ecabe-b8c8-4d15-a4c2-d3c569b033f2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwqx\" (UID: \"b90ecabe-b8c8-4d15-a4c2-d3c569b033f2\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" May 21 20:33:30.050481 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:30.050455 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc8pv\" (UniqueName: \"kubernetes.io/projected/b90ecabe-b8c8-4d15-a4c2-d3c569b033f2-kube-api-access-gc8pv\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwqx\" (UID: \"b90ecabe-b8c8-4d15-a4c2-d3c569b033f2\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" May 21 20:33:30.105650 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:30.105607 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" May 21 20:33:31.057095 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:31.057042 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx"] May 21 20:33:31.058403 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:33:31.058364 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb90ecabe_b8c8_4d15_a4c2_d3c569b033f2.slice/crio-339e9f71410f8b7d9458c059ecfa0301646f4051b7b1191024e3cd47a17b3279 WatchSource:0}: Error finding container 339e9f71410f8b7d9458c059ecfa0301646f4051b7b1191024e3cd47a17b3279: Status 404 returned error can't find the container with id 339e9f71410f8b7d9458c059ecfa0301646f4051b7b1191024e3cd47a17b3279 May 21 20:33:31.078774 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:31.078704 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:33:31.429817 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:31.429779 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" event={"ID":"5443bb37-08da-42a2-910b-df5dfc5f5100","Type":"ContainerStarted","Data":"6dd2a5f628926e1be849911270349c418277fb553236a3888e42053ba1a22d6b"} May 21 20:33:31.432104 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:31.432046 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" event={"ID":"b90ecabe-b8c8-4d15-a4c2-d3c569b033f2","Type":"ContainerStarted","Data":"4f8ee4219a065c5d288af383216442e05cd838c28eb2c7360a12c04d83e0ab7c"} May 21 20:33:31.432104 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:31.432104 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" event={"ID":"b90ecabe-b8c8-4d15-a4c2-d3c569b033f2","Type":"ContainerStarted","Data":"339e9f71410f8b7d9458c059ecfa0301646f4051b7b1191024e3cd47a17b3279"} May 21 20:33:37.464658 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:37.464624 2559 generic.go:358] "Generic (PLEG): container finished" podID="b90ecabe-b8c8-4d15-a4c2-d3c569b033f2" containerID="4f8ee4219a065c5d288af383216442e05cd838c28eb2c7360a12c04d83e0ab7c" exitCode=0 May 21 20:33:37.465089 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:37.464696 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" event={"ID":"b90ecabe-b8c8-4d15-a4c2-d3c569b033f2","Type":"ContainerDied","Data":"4f8ee4219a065c5d288af383216442e05cd838c28eb2c7360a12c04d83e0ab7c"} May 21 20:33:37.466259 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:37.466235 2559 generic.go:358] "Generic (PLEG): container finished" podID="5443bb37-08da-42a2-910b-df5dfc5f5100" containerID="6dd2a5f628926e1be849911270349c418277fb553236a3888e42053ba1a22d6b" exitCode=0 May 21 20:33:37.466344 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:37.466274 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" event={"ID":"5443bb37-08da-42a2-910b-df5dfc5f5100","Type":"ContainerDied","Data":"6dd2a5f628926e1be849911270349c418277fb553236a3888e42053ba1a22d6b"} May 21 20:33:39.482459 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:39.482401 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" event={"ID":"5443bb37-08da-42a2-910b-df5dfc5f5100","Type":"ContainerStarted","Data":"e92fa8655a3923e637d82485ec3e85c579bb30adfd353c6546e6097d3b29fe0f"} May 21 20:33:39.482879 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:39.482668 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" May 21 20:33:39.484033 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:39.484011 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" event={"ID":"b90ecabe-b8c8-4d15-a4c2-d3c569b033f2","Type":"ContainerStarted","Data":"4b97fd14a47a11199cdf730b198ee8f4dbcde72d25d45bb005598d46b7fa8694"} May 21 20:33:39.484241 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:39.484226 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" May 21 20:33:39.502614 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:39.502577 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" podStartSLOduration=1.213039719 podStartE2EDuration="14.502566142s" podCreationTimestamp="2026-05-21 20:33:25 +0000 UTC" firstStartedPulling="2026-05-21 20:33:25.650593008 +0000 UTC m=+751.648981969" lastFinishedPulling="2026-05-21 20:33:38.940119424 +0000 UTC m=+764.938508392" observedRunningTime="2026-05-21 20:33:39.501159935 +0000 UTC m=+765.499548936" watchObservedRunningTime="2026-05-21 20:33:39.502566142 +0000 UTC m=+765.500955162" May 21 20:33:39.519598 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:39.519547 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" podStartSLOduration=9.050110245 podStartE2EDuration="10.519538075s" podCreationTimestamp="2026-05-21 20:33:29 +0000 UTC" firstStartedPulling="2026-05-21 20:33:37.465523667 +0000 UTC m=+763.463912632" lastFinishedPulling="2026-05-21 20:33:38.934951491 +0000 UTC m=+764.933340462" observedRunningTime="2026-05-21 20:33:39.518559555 +0000 UTC m=+765.516948539" watchObservedRunningTime="2026-05-21 20:33:39.519538075 +0000 UTC m=+765.517927091" May 21 20:33:45.083879 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:45.083845 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:33:50.501047 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:50.501018 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-wb229" May 21 20:33:50.501852 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:33:50.501829 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwqx" May 21 20:35:00.374066 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:00.374014 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:35:10.377384 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:10.377346 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:35:18.679094 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:18.679039 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:35:30.085465 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:30.085430 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:35:38.976591 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:38.976551 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:35:48.776074 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:48.775981 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:35:55.693404 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:55.693352 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b56d58d6b-ncfrx"] May 21 20:35:55.693975 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:55.693683 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-6b56d58d6b-ncfrx" podUID="01569fed-c89b-460a-ba9e-93c6652d5838" containerName="manager" containerID="cri-o://0375a669194b83c856322ecaaf208c1ccf0806bb66e118b4ead97cb3aecabc83" gracePeriod=30 May 21 20:35:55.950549 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:55.950484 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b56d58d6b-ncfrx" May 21 20:35:56.016911 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:56.016875 2559 generic.go:358] "Generic (PLEG): container finished" podID="01569fed-c89b-460a-ba9e-93c6652d5838" containerID="0375a669194b83c856322ecaaf208c1ccf0806bb66e118b4ead97cb3aecabc83" exitCode=0 May 21 20:35:56.017150 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:56.016935 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b56d58d6b-ncfrx" May 21 20:35:56.017150 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:56.016956 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b56d58d6b-ncfrx" event={"ID":"01569fed-c89b-460a-ba9e-93c6652d5838","Type":"ContainerDied","Data":"0375a669194b83c856322ecaaf208c1ccf0806bb66e118b4ead97cb3aecabc83"} May 21 20:35:56.017150 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:56.017005 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b56d58d6b-ncfrx" event={"ID":"01569fed-c89b-460a-ba9e-93c6652d5838","Type":"ContainerDied","Data":"f95dbef9bc4d2b7da0a890151434353a1afccacd8ea637a5db64b39139ec15e4"} May 21 20:35:56.017150 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:56.017023 2559 scope.go:117] "RemoveContainer" containerID="0375a669194b83c856322ecaaf208c1ccf0806bb66e118b4ead97cb3aecabc83" May 21 20:35:56.025947 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:56.025925 2559 scope.go:117] "RemoveContainer" containerID="0375a669194b83c856322ecaaf208c1ccf0806bb66e118b4ead97cb3aecabc83" May 21 20:35:56.026214 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:35:56.026194 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0375a669194b83c856322ecaaf208c1ccf0806bb66e118b4ead97cb3aecabc83\": container with ID starting with 0375a669194b83c856322ecaaf208c1ccf0806bb66e118b4ead97cb3aecabc83 not found: ID does not exist" containerID="0375a669194b83c856322ecaaf208c1ccf0806bb66e118b4ead97cb3aecabc83" May 21 20:35:56.026264 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:56.026224 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0375a669194b83c856322ecaaf208c1ccf0806bb66e118b4ead97cb3aecabc83"} err="failed to get container status \"0375a669194b83c856322ecaaf208c1ccf0806bb66e118b4ead97cb3aecabc83\": rpc error: code = NotFound desc = could not find container \"0375a669194b83c856322ecaaf208c1ccf0806bb66e118b4ead97cb3aecabc83\": container with ID starting with 0375a669194b83c856322ecaaf208c1ccf0806bb66e118b4ead97cb3aecabc83 not found: ID does not exist" May 21 20:35:56.055102 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:56.055071 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdrj6\" (UniqueName: \"kubernetes.io/projected/01569fed-c89b-460a-ba9e-93c6652d5838-kube-api-access-tdrj6\") pod \"01569fed-c89b-460a-ba9e-93c6652d5838\" (UID: \"01569fed-c89b-460a-ba9e-93c6652d5838\") " May 21 20:35:56.057256 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:56.057224 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01569fed-c89b-460a-ba9e-93c6652d5838-kube-api-access-tdrj6" (OuterVolumeSpecName: "kube-api-access-tdrj6") pod "01569fed-c89b-460a-ba9e-93c6652d5838" (UID: "01569fed-c89b-460a-ba9e-93c6652d5838"). InnerVolumeSpecName "kube-api-access-tdrj6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:35:56.156180 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:56.156139 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdrj6\" (UniqueName: \"kubernetes.io/projected/01569fed-c89b-460a-ba9e-93c6652d5838-kube-api-access-tdrj6\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:35:56.339602 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:56.339559 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b56d58d6b-ncfrx"] May 21 20:35:56.342081 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:56.342045 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b56d58d6b-ncfrx"] May 21 20:35:56.576531 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:56.576448 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01569fed-c89b-460a-ba9e-93c6652d5838" path="/var/lib/kubelet/pods/01569fed-c89b-460a-ba9e-93c6652d5838/volumes" May 21 20:35:57.090529 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:57.090496 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b56d58d6b-6wx2d"] May 21 20:35:57.090956 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:57.090873 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01569fed-c89b-460a-ba9e-93c6652d5838" containerName="manager" May 21 20:35:57.090956 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:57.090884 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="01569fed-c89b-460a-ba9e-93c6652d5838" containerName="manager" May 21 20:35:57.090956 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:57.090942 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="01569fed-c89b-460a-ba9e-93c6652d5838" containerName="manager" May 21 20:35:57.095389 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:57.095371 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b56d58d6b-6wx2d" May 21 20:35:57.098002 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:57.097977 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-m25cs\"" May 21 20:35:57.100495 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:57.100470 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b56d58d6b-6wx2d"] May 21 20:35:57.166130 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:57.166092 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tzs2\" (UniqueName: \"kubernetes.io/projected/401da8f3-e0e6-4ba4-9404-3cff8879054b-kube-api-access-9tzs2\") pod \"maas-controller-6b56d58d6b-6wx2d\" (UID: \"401da8f3-e0e6-4ba4-9404-3cff8879054b\") " pod="opendatahub/maas-controller-6b56d58d6b-6wx2d" May 21 20:35:57.266785 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:57.266744 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9tzs2\" (UniqueName: \"kubernetes.io/projected/401da8f3-e0e6-4ba4-9404-3cff8879054b-kube-api-access-9tzs2\") pod \"maas-controller-6b56d58d6b-6wx2d\" (UID: \"401da8f3-e0e6-4ba4-9404-3cff8879054b\") " pod="opendatahub/maas-controller-6b56d58d6b-6wx2d" May 21 20:35:57.275708 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:57.275682 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tzs2\" (UniqueName: \"kubernetes.io/projected/401da8f3-e0e6-4ba4-9404-3cff8879054b-kube-api-access-9tzs2\") pod \"maas-controller-6b56d58d6b-6wx2d\" (UID: \"401da8f3-e0e6-4ba4-9404-3cff8879054b\") " pod="opendatahub/maas-controller-6b56d58d6b-6wx2d" May 21 20:35:57.407808 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:57.407712 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b56d58d6b-6wx2d" May 21 20:35:57.550428 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:57.550400 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b56d58d6b-6wx2d"] May 21 20:35:57.551849 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:35:57.551819 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod401da8f3_e0e6_4ba4_9404_3cff8879054b.slice/crio-291d8bf1cccc6811ae198babbdb613cc339f878de9e3460f182ac20cdd05972d WatchSource:0}: Error finding container 291d8bf1cccc6811ae198babbdb613cc339f878de9e3460f182ac20cdd05972d: Status 404 returned error can't find the container with id 291d8bf1cccc6811ae198babbdb613cc339f878de9e3460f182ac20cdd05972d May 21 20:35:58.027624 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:58.027592 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b56d58d6b-6wx2d" event={"ID":"401da8f3-e0e6-4ba4-9404-3cff8879054b","Type":"ContainerStarted","Data":"358b0a727006f2a1796bfbbb23cf993f6586a2829d41144de296b539bf88bf97"} May 21 20:35:58.027624 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:58.027629 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b56d58d6b-6wx2d" event={"ID":"401da8f3-e0e6-4ba4-9404-3cff8879054b","Type":"ContainerStarted","Data":"291d8bf1cccc6811ae198babbdb613cc339f878de9e3460f182ac20cdd05972d"} May 21 20:35:58.027828 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:58.027740 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b56d58d6b-6wx2d" May 21 20:35:58.051123 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:35:58.051070 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6b56d58d6b-6wx2d" podStartSLOduration=0.668838217 podStartE2EDuration="1.051043294s" podCreationTimestamp="2026-05-21 20:35:57 +0000 UTC" firstStartedPulling="2026-05-21 20:35:57.55357975 +0000 UTC m=+903.551968712" lastFinishedPulling="2026-05-21 20:35:57.935784813 +0000 UTC m=+903.934173789" observedRunningTime="2026-05-21 20:35:58.0476559 +0000 UTC m=+904.046044882" watchObservedRunningTime="2026-05-21 20:35:58.051043294 +0000 UTC m=+904.049432273" May 21 20:36:09.037613 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:36:09.037581 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b56d58d6b-6wx2d" May 21 20:36:20.182129 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:36:20.182093 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:36:25.881193 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:36:25.881151 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:37:02.969912 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:37:02.969871 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:37:17.873028 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:37:17.872991 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:37:56.175475 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:37:56.175442 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:38:13.374503 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:38:13.374465 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:38:28.483703 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:38:28.483666 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:38:44.070355 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:38:44.070272 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:39:38.772252 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:39:38.772210 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:39:47.269952 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:39:47.269915 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:40:04.077337 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:40:04.077298 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:40:12.669114 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:40:12.669078 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:40:29.673141 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:40:29.673108 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:40:38.075952 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:40:38.075912 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:41:10.571027 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:41:10.570988 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:41:19.575895 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:41:19.575861 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:41:27.472020 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:41:27.471986 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:41:36.375203 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:41:36.375165 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:41:44.170249 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:41:44.170166 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:42:02.171451 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:42:02.171412 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:42:12.075271 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:42:12.075237 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:42:59.472970 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:42:59.472932 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:43:05.472886 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:43:05.472843 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:43:10.377600 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:43:10.377565 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:43:19.679213 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:43:19.679178 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:43:29.481634 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:43:29.481603 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:43:37.747173 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:43:37.747134 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:43:46.276478 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:43:46.276438 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:43:54.670956 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:43:54.670919 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:44:03.938026 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:44:03.937991 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:44:12.476937 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:44:12.476900 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:44:22.369133 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:44:22.369094 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:44:30.476414 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:44:30.476378 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:44:38.771502 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:44:38.771468 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:44:47.173778 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:44:47.173682 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:44:56.775555 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:44:56.775519 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:45:04.571272 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:45:04.571233 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:45:14.173363 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:45:14.173321 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:45:22.477685 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:45:22.477648 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:47:39.568911 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:47:39.568878 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:47:44.571534 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:47:44.571449 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:48:11.076122 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:48:11.076081 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:48:17.980980 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:48:17.980937 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:48:26.377606 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:48:26.377566 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:48:37.865455 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:48:37.865417 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:48:45.772873 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:48:45.772837 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:48:57.074738 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:48:57.074690 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:49:05.267985 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:05.267947 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:49:07.116526 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:07.116490 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c64989c55-9jd5d"] May 21 20:49:15.172184 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:15.172134 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:49:24.081313 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:24.081271 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:49:32.138568 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:32.138505 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7c64989c55-9jd5d" podUID="2cc944c5-ab1d-4415-86a1-5489d616685e" containerName="console" containerID="cri-o://01c754ce2a636efd3da473ab5ea0c25ee269551ace0b7fb0cd20f3f14ae58a67" gracePeriod=15 May 21 20:49:32.393139 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:32.393082 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c64989c55-9jd5d_2cc944c5-ab1d-4415-86a1-5489d616685e/console/0.log" May 21 20:49:32.393248 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:32.393145 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:49:32.456035 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:32.456004 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cc944c5-ab1d-4415-86a1-5489d616685e-console-oauth-config\") pod \"2cc944c5-ab1d-4415-86a1-5489d616685e\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " May 21 20:49:32.456035 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:32.456038 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cc944c5-ab1d-4415-86a1-5489d616685e-console-config\") pod \"2cc944c5-ab1d-4415-86a1-5489d616685e\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " May 21 20:49:32.456267 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:32.456095 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cc944c5-ab1d-4415-86a1-5489d616685e-trusted-ca-bundle\") pod \"2cc944c5-ab1d-4415-86a1-5489d616685e\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " May 21 20:49:32.456267 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:32.456126 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtn7f\" (UniqueName: \"kubernetes.io/projected/2cc944c5-ab1d-4415-86a1-5489d616685e-kube-api-access-wtn7f\") pod \"2cc944c5-ab1d-4415-86a1-5489d616685e\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " May 21 20:49:32.456267 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:32.456168 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cc944c5-ab1d-4415-86a1-5489d616685e-console-serving-cert\") pod \"2cc944c5-ab1d-4415-86a1-5489d616685e\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " May 21 20:49:32.456419 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:32.456353 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cc944c5-ab1d-4415-86a1-5489d616685e-oauth-serving-cert\") pod \"2cc944c5-ab1d-4415-86a1-5489d616685e\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " May 21 20:49:32.456419 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:32.456407 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cc944c5-ab1d-4415-86a1-5489d616685e-service-ca\") pod \"2cc944c5-ab1d-4415-86a1-5489d616685e\" (UID: \"2cc944c5-ab1d-4415-86a1-5489d616685e\") " May 21 20:49:32.456546 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:32.456524 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cc944c5-ab1d-4415-86a1-5489d616685e-console-config" (OuterVolumeSpecName: "console-config") pod "2cc944c5-ab1d-4415-86a1-5489d616685e" (UID: "2cc944c5-ab1d-4415-86a1-5489d616685e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:49:32.456629 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:32.456598 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cc944c5-ab1d-4415-86a1-5489d616685e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2cc944c5-ab1d-4415-86a1-5489d616685e" (UID: "2cc944c5-ab1d-4415-86a1-5489d616685e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:49:32.456807 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:32.456768 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cc944c5-ab1d-4415-86a1-5489d616685e-console-config\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:49:32.456807 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:32.456793 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cc944c5-ab1d-4415-86a1-5489d616685e-trusted-ca-bundle\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:49:32.456807 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:32.456820 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cc944c5-ab1d-4415-86a1-5489d616685e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2cc944c5-ab1d-4415-86a1-5489d616685e" (UID: "2cc944c5-ab1d-4415-86a1-5489d616685e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:49:32.457347 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:32.456890 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cc944c5-ab1d-4415-86a1-5489d616685e-service-ca" (OuterVolumeSpecName: "service-ca") pod "2cc944c5-ab1d-4415-86a1-5489d616685e" (UID: "2cc944c5-ab1d-4415-86a1-5489d616685e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 20:49:32.458492 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:32.458465 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cc944c5-ab1d-4415-86a1-5489d616685e-kube-api-access-wtn7f" (OuterVolumeSpecName: "kube-api-access-wtn7f") pod "2cc944c5-ab1d-4415-86a1-5489d616685e" (UID: "2cc944c5-ab1d-4415-86a1-5489d616685e"). InnerVolumeSpecName "kube-api-access-wtn7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:49:32.458917 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:32.458899 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cc944c5-ab1d-4415-86a1-5489d616685e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2cc944c5-ab1d-4415-86a1-5489d616685e" (UID: "2cc944c5-ab1d-4415-86a1-5489d616685e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 20:49:32.458972 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:32.458936 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cc944c5-ab1d-4415-86a1-5489d616685e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2cc944c5-ab1d-4415-86a1-5489d616685e" (UID: "2cc944c5-ab1d-4415-86a1-5489d616685e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 20:49:32.558019 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:32.557988 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cc944c5-ab1d-4415-86a1-5489d616685e-console-oauth-config\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:49:32.558019 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:32.558017 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtn7f\" (UniqueName: \"kubernetes.io/projected/2cc944c5-ab1d-4415-86a1-5489d616685e-kube-api-access-wtn7f\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:49:32.558226 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:32.558030 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cc944c5-ab1d-4415-86a1-5489d616685e-console-serving-cert\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:49:32.558226 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:32.558043 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cc944c5-ab1d-4415-86a1-5489d616685e-oauth-serving-cert\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:49:32.558226 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:32.558113 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cc944c5-ab1d-4415-86a1-5489d616685e-service-ca\") on node \"ip-10-0-134-40.ec2.internal\" DevicePath \"\"" May 21 20:49:33.221010 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:33.220983 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c64989c55-9jd5d_2cc944c5-ab1d-4415-86a1-5489d616685e/console/0.log" May 21 20:49:33.221420 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:33.221023 2559 generic.go:358] "Generic (PLEG): container finished" podID="2cc944c5-ab1d-4415-86a1-5489d616685e" containerID="01c754ce2a636efd3da473ab5ea0c25ee269551ace0b7fb0cd20f3f14ae58a67" exitCode=2 May 21 20:49:33.221420 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:33.221111 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c64989c55-9jd5d" May 21 20:49:33.221420 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:33.221118 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c64989c55-9jd5d" event={"ID":"2cc944c5-ab1d-4415-86a1-5489d616685e","Type":"ContainerDied","Data":"01c754ce2a636efd3da473ab5ea0c25ee269551ace0b7fb0cd20f3f14ae58a67"} May 21 20:49:33.221420 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:33.221153 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c64989c55-9jd5d" event={"ID":"2cc944c5-ab1d-4415-86a1-5489d616685e","Type":"ContainerDied","Data":"bf437c4613ba1f5a5cf9ef2a901c78090c15fa1b9a4464708ca0e6f03b292502"} May 21 20:49:33.221420 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:33.221168 2559 scope.go:117] "RemoveContainer" containerID="01c754ce2a636efd3da473ab5ea0c25ee269551ace0b7fb0cd20f3f14ae58a67" May 21 20:49:33.230717 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:33.230701 2559 scope.go:117] "RemoveContainer" containerID="01c754ce2a636efd3da473ab5ea0c25ee269551ace0b7fb0cd20f3f14ae58a67" May 21 20:49:33.230962 ip-10-0-134-40 kubenswrapper[2559]: E0521 20:49:33.230941 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01c754ce2a636efd3da473ab5ea0c25ee269551ace0b7fb0cd20f3f14ae58a67\": container with ID starting with 01c754ce2a636efd3da473ab5ea0c25ee269551ace0b7fb0cd20f3f14ae58a67 not found: ID does not exist" containerID="01c754ce2a636efd3da473ab5ea0c25ee269551ace0b7fb0cd20f3f14ae58a67" May 21 20:49:33.231027 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:33.230970 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01c754ce2a636efd3da473ab5ea0c25ee269551ace0b7fb0cd20f3f14ae58a67"} err="failed to get container status \"01c754ce2a636efd3da473ab5ea0c25ee269551ace0b7fb0cd20f3f14ae58a67\": rpc error: code = NotFound desc = could not find container \"01c754ce2a636efd3da473ab5ea0c25ee269551ace0b7fb0cd20f3f14ae58a67\": container with ID starting with 01c754ce2a636efd3da473ab5ea0c25ee269551ace0b7fb0cd20f3f14ae58a67 not found: ID does not exist" May 21 20:49:33.240306 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:33.240283 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c64989c55-9jd5d"] May 21 20:49:33.245298 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:33.245280 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c64989c55-9jd5d"] May 21 20:49:34.576746 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:34.576715 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cc944c5-ab1d-4415-86a1-5489d616685e" path="/var/lib/kubelet/pods/2cc944c5-ab1d-4415-86a1-5489d616685e/volumes" May 21 20:49:34.672308 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:34.672270 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:49:43.972397 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:43.972361 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:49:49.979854 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:49:49.979817 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:50:16.872991 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:50:16.872954 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:51:00.867645 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:51:00.867588 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:51:08.777246 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:51:08.777207 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:51:17.278209 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:51:17.278168 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:51:26.177636 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:51:26.177601 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:51:34.781020 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:51:34.780980 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:51:48.268418 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:51:48.268379 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:51:56.281990 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:51:56.281950 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:52:04.676505 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:52:04.676470 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:52:13.070670 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:52:13.070590 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:52:20.977508 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:52:20.977473 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:52:29.173039 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:52:29.173001 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:52:40.275492 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:52:40.275447 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:52:58.074441 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:52:58.074406 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:53:06.474485 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:53:06.474443 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:53:14.971022 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:53:14.970987 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:53:22.669850 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:53:22.669814 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:53:40.286323 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:53:40.286277 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:53:48.873047 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:53:48.872962 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:53:56.871806 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:53:56.871769 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:54:05.783159 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:54:05.783120 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:54:16.071082 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:54:16.067802 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:54:22.983109 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:54:22.983073 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:54:31.876932 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:54:31.876900 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:54:43.270946 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:54:43.270904 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:54:52.373845 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:54:52.373803 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:55:06.273005 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:55:06.272964 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:55:14.369773 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:55:14.369733 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:55:22.576030 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:55:22.575994 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:55:31.977481 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:55:31.977447 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:55:38.179950 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:55:38.179913 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:55:55.367710 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:55:55.367673 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:56:04.070863 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:56:04.070816 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:56:13.272068 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:56:13.272021 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:56:21.569495 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:56:21.569455 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:56:45.778261 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:56:45.778171 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:56:57.469108 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:56:57.469066 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vzjpt"] May 21 20:57:09.600421 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:09.600390 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-xb4fw_37e66772-12f6-4f55-bdad-8a5721bfa24c/manager/0.log" May 21 20:57:09.733514 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:09.733487 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-8dd8d786c-q8w4f_05f35afc-73f7-4f63-81a8-8f66b4851240/maas-api/0.log" May 21 20:57:09.967637 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:09.967562 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6b56d58d6b-6wx2d_401da8f3-e0e6-4ba4-9404-3cff8879054b/manager/0.log" May 21 20:57:10.091227 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:10.091186 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-6xsd5_5c5fed31-7e58-45bb-aeed-3fcbe924088e/manager/2.log" May 21 20:57:10.214614 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:10.214589 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj_f196a1f9-f9f2-46f6-9fb0-421e8b79d27f/manager/0.log" May 21 20:57:11.382342 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:11.382314 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc_ae9c2707-c0f3-4cc9-89fc-a2b06773bd32/util/0.log" May 21 20:57:11.388487 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:11.388460 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc_ae9c2707-c0f3-4cc9-89fc-a2b06773bd32/pull/0.log" May 21 20:57:11.394500 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:11.394479 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc_ae9c2707-c0f3-4cc9-89fc-a2b06773bd32/extract/0.log" May 21 20:57:11.507456 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:11.507430 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc_21c98c21-a322-429f-8464-df803100f899/util/0.log" May 21 20:57:11.513267 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:11.513246 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc_21c98c21-a322-429f-8464-df803100f899/pull/0.log" May 21 20:57:11.518599 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:11.518572 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc_21c98c21-a322-429f-8464-df803100f899/extract/0.log" May 21 20:57:11.656109 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:11.656011 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv_d56d7d8f-5577-4bab-8543-7a73bd2a7067/util/0.log" May 21 20:57:11.662426 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:11.662404 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv_d56d7d8f-5577-4bab-8543-7a73bd2a7067/pull/0.log" May 21 20:57:11.668883 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:11.668864 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv_d56d7d8f-5577-4bab-8543-7a73bd2a7067/extract/0.log" May 21 20:57:11.784483 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:11.784458 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l_7c13328d-4ea3-43e1-8042-11356a03b1c0/util/0.log" May 21 20:57:11.790590 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:11.790571 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l_7c13328d-4ea3-43e1-8042-11356a03b1c0/pull/0.log" May 21 20:57:11.796246 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:11.796222 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l_7c13328d-4ea3-43e1-8042-11356a03b1c0/extract/0.log" May 21 20:57:12.035001 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:12.034919 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-5wgvf_920fa6fe-b27b-4b51-a30c-0d840f6e6017/manager/0.log" May 21 20:57:12.619546 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:12.619516 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-vzjpt_8b15b509-f924-45fe-a8de-60d7dfe03577/limitador/0.log" May 21 20:57:13.204622 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:13.204592 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-mjx7g_38d35562-7801-494e-8853-417c5d5a1fbb/discovery/0.log" May 21 20:57:13.421573 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:13.421548 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-547674d64f-vzj82_359f3d50-d0be-4770-86c8-f47128531de7/kube-auth-proxy/0.log" May 21 20:57:13.542316 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:13.542235 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-8mm2w_b417779c-cde2-4085-b26f-53e753c62b73/istio-proxy/0.log" May 21 20:57:13.761588 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:13.761558 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-576545cfb4-rlx4k_c39245e2-2433-4601-bf1b-443f5fd576e7/router/0.log" May 21 20:57:14.095565 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:14.095541 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-wb229_5443bb37-08da-42a2-910b-df5dfc5f5100/main/0.log" May 21 20:57:14.102031 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:14.102008 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-wb229_5443bb37-08da-42a2-910b-df5dfc5f5100/storage-initializer/0.log" May 21 20:57:14.323949 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:14.323914 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-pkwqx_b90ecabe-b8c8-4d15-a4c2-d3c569b033f2/storage-initializer/0.log" May 21 20:57:14.333238 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:14.333217 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-pkwqx_b90ecabe-b8c8-4d15-a4c2-d3c569b033f2/main/0.log" May 21 20:57:21.418731 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:21.418693 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vgg7n_9187c183-92eb-4a4e-a8d0-09537d81400c/global-pull-secret-syncer/0.log" May 21 20:57:21.513193 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:21.513161 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jfg8z_1df76140-3e4f-445a-b48c-c6bc241b8a58/konnectivity-agent/0.log" May 21 20:57:21.609422 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:21.609393 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-40.ec2.internal_737f2ee8a38127b7d0bda2823f387f82/haproxy/0.log" May 21 20:57:25.173692 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:25.173658 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc_ae9c2707-c0f3-4cc9-89fc-a2b06773bd32/extract/0.log" May 21 20:57:25.195172 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:25.195140 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc_ae9c2707-c0f3-4cc9-89fc-a2b06773bd32/util/0.log" May 21 20:57:25.214631 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:25.214611 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rqsbc_ae9c2707-c0f3-4cc9-89fc-a2b06773bd32/pull/0.log" May 21 20:57:25.253271 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:25.253208 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc_21c98c21-a322-429f-8464-df803100f899/extract/0.log" May 21 20:57:25.276386 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:25.276363 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc_21c98c21-a322-429f-8464-df803100f899/util/0.log" May 21 20:57:25.298793 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:25.298773 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nlvjc_21c98c21-a322-429f-8464-df803100f899/pull/0.log" May 21 20:57:25.334090 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:25.334071 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv_d56d7d8f-5577-4bab-8543-7a73bd2a7067/extract/0.log" May 21 20:57:25.363916 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:25.363892 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv_d56d7d8f-5577-4bab-8543-7a73bd2a7067/util/0.log" May 21 20:57:25.411100 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:25.411076 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h56fv_d56d7d8f-5577-4bab-8543-7a73bd2a7067/pull/0.log" May 21 20:57:25.442800 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:25.442783 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l_7c13328d-4ea3-43e1-8042-11356a03b1c0/extract/0.log" May 21 20:57:25.466340 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:25.466313 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l_7c13328d-4ea3-43e1-8042-11356a03b1c0/util/0.log" May 21 20:57:25.487480 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:25.487463 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jf4l_7c13328d-4ea3-43e1-8042-11356a03b1c0/pull/0.log" May 21 20:57:25.810523 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:25.810495 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-5wgvf_920fa6fe-b27b-4b51-a30c-0d840f6e6017/manager/0.log" May 21 20:57:26.011061 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:26.011034 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-vzjpt_8b15b509-f924-45fe-a8de-60d7dfe03577/limitador/0.log" May 21 20:57:27.659459 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:27.659421 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-9k4hs_724eb768-6856-4129-a9a0-a9d7fff49eb2/cluster-monitoring-operator/0.log" May 21 20:57:27.824847 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:27.824808 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9dlg4_9f48ea62-df33-4b7b-a63d-49688b7dd3b1/node-exporter/0.log" May 21 20:57:27.845450 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:27.845422 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9dlg4_9f48ea62-df33-4b7b-a63d-49688b7dd3b1/kube-rbac-proxy/0.log" May 21 20:57:27.865883 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:27.865855 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9dlg4_9f48ea62-df33-4b7b-a63d-49688b7dd3b1/init-textfile/0.log" May 21 20:57:30.208648 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.208618 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8xms4_b6a24522-88a4-432c-97bb-f6f2083901fd/console-operator/0.log" May 21 20:57:30.340526 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.340498 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs"] May 21 20:57:30.340903 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.340882 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cc944c5-ab1d-4415-86a1-5489d616685e" containerName="console" May 21 20:57:30.341007 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.340904 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cc944c5-ab1d-4415-86a1-5489d616685e" containerName="console" May 21 20:57:30.341084 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.341021 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="2cc944c5-ab1d-4415-86a1-5489d616685e" containerName="console" May 21 20:57:30.344010 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.343991 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs" May 21 20:57:30.346194 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.346173 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s2x8m\"/\"kube-root-ca.crt\"" May 21 20:57:30.347099 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.347080 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s2x8m\"/\"default-dockercfg-mlx6x\"" May 21 20:57:30.347348 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.347114 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s2x8m\"/\"openshift-service-ca.crt\"" May 21 20:57:30.350645 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.350623 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs"] May 21 20:57:30.478083 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.477959 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/585df17f-1d94-4f08-8ffc-c8d9626df6ae-lib-modules\") pod \"perf-node-gather-daemonset-9d2xs\" (UID: \"585df17f-1d94-4f08-8ffc-c8d9626df6ae\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs" May 21 20:57:30.478083 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.478027 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/585df17f-1d94-4f08-8ffc-c8d9626df6ae-sys\") pod \"perf-node-gather-daemonset-9d2xs\" (UID: \"585df17f-1d94-4f08-8ffc-c8d9626df6ae\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs" May 21 20:57:30.478296 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.478083 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/585df17f-1d94-4f08-8ffc-c8d9626df6ae-podres\") pod \"perf-node-gather-daemonset-9d2xs\" (UID: \"585df17f-1d94-4f08-8ffc-c8d9626df6ae\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs" May 21 20:57:30.478296 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.478143 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/585df17f-1d94-4f08-8ffc-c8d9626df6ae-proc\") pod \"perf-node-gather-daemonset-9d2xs\" (UID: \"585df17f-1d94-4f08-8ffc-c8d9626df6ae\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs" May 21 20:57:30.478296 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.478176 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcc2t\" (UniqueName: \"kubernetes.io/projected/585df17f-1d94-4f08-8ffc-c8d9626df6ae-kube-api-access-lcc2t\") pod \"perf-node-gather-daemonset-9d2xs\" (UID: \"585df17f-1d94-4f08-8ffc-c8d9626df6ae\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs" May 21 20:57:30.579279 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.579250 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/585df17f-1d94-4f08-8ffc-c8d9626df6ae-lib-modules\") pod \"perf-node-gather-daemonset-9d2xs\" (UID: \"585df17f-1d94-4f08-8ffc-c8d9626df6ae\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs" May 21 20:57:30.579476 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.579321 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/585df17f-1d94-4f08-8ffc-c8d9626df6ae-sys\") pod \"perf-node-gather-daemonset-9d2xs\" (UID: \"585df17f-1d94-4f08-8ffc-c8d9626df6ae\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs" May 21 20:57:30.579476 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.579343 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/585df17f-1d94-4f08-8ffc-c8d9626df6ae-podres\") pod \"perf-node-gather-daemonset-9d2xs\" (UID: \"585df17f-1d94-4f08-8ffc-c8d9626df6ae\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs" May 21 20:57:30.579476 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.579366 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/585df17f-1d94-4f08-8ffc-c8d9626df6ae-proc\") pod \"perf-node-gather-daemonset-9d2xs\" (UID: \"585df17f-1d94-4f08-8ffc-c8d9626df6ae\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs" May 21 20:57:30.579476 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.579395 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lcc2t\" (UniqueName: \"kubernetes.io/projected/585df17f-1d94-4f08-8ffc-c8d9626df6ae-kube-api-access-lcc2t\") pod \"perf-node-gather-daemonset-9d2xs\" (UID: \"585df17f-1d94-4f08-8ffc-c8d9626df6ae\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs" May 21 20:57:30.579476 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.579441 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/585df17f-1d94-4f08-8ffc-c8d9626df6ae-sys\") pod \"perf-node-gather-daemonset-9d2xs\" (UID: \"585df17f-1d94-4f08-8ffc-c8d9626df6ae\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs" May 21 20:57:30.579476 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.579441 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/585df17f-1d94-4f08-8ffc-c8d9626df6ae-lib-modules\") pod \"perf-node-gather-daemonset-9d2xs\" (UID: \"585df17f-1d94-4f08-8ffc-c8d9626df6ae\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs" May 21 20:57:30.579476 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.579463 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/585df17f-1d94-4f08-8ffc-c8d9626df6ae-proc\") pod \"perf-node-gather-daemonset-9d2xs\" (UID: \"585df17f-1d94-4f08-8ffc-c8d9626df6ae\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs" May 21 20:57:30.579476 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.579470 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/585df17f-1d94-4f08-8ffc-c8d9626df6ae-podres\") pod \"perf-node-gather-daemonset-9d2xs\" (UID: \"585df17f-1d94-4f08-8ffc-c8d9626df6ae\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs" May 21 20:57:30.586564 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.586545 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcc2t\" (UniqueName: \"kubernetes.io/projected/585df17f-1d94-4f08-8ffc-c8d9626df6ae-kube-api-access-lcc2t\") pod \"perf-node-gather-daemonset-9d2xs\" (UID: \"585df17f-1d94-4f08-8ffc-c8d9626df6ae\") " pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs" May 21 20:57:30.655785 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.655756 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs" May 21 20:57:30.786809 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.786782 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs"] May 21 20:57:30.788420 ip-10-0-134-40 kubenswrapper[2559]: W0521 20:57:30.788390 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod585df17f_1d94_4f08_8ffc_c8d9626df6ae.slice/crio-46be308a0215bdcfb9e48f1e257096f90084f141cad39c188c8c8077f0044d60 WatchSource:0}: Error finding container 46be308a0215bdcfb9e48f1e257096f90084f141cad39c188c8c8077f0044d60: Status 404 returned error can't find the container with id 46be308a0215bdcfb9e48f1e257096f90084f141cad39c188c8c8077f0044d60 May 21 20:57:30.789886 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:30.789868 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 20:57:31.101847 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:31.101811 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs" event={"ID":"585df17f-1d94-4f08-8ffc-c8d9626df6ae","Type":"ContainerStarted","Data":"79197aa33b819e042d1221c73dc10ec49808f25b586af4f13087cd5343ccc084"} May 21 20:57:31.101847 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:31.101849 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs" event={"ID":"585df17f-1d94-4f08-8ffc-c8d9626df6ae","Type":"ContainerStarted","Data":"46be308a0215bdcfb9e48f1e257096f90084f141cad39c188c8c8077f0044d60"} May 21 20:57:31.102078 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:31.101903 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs" May 21 20:57:31.117644 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:31.117602 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs" podStartSLOduration=1.117585997 podStartE2EDuration="1.117585997s" podCreationTimestamp="2026-05-21 20:57:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:57:31.117207844 +0000 UTC m=+2197.115596827" watchObservedRunningTime="2026-05-21 20:57:31.117585997 +0000 UTC m=+2197.115974982" May 21 20:57:31.234978 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:31.234953 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-dmbwc_db5b79c9-f8b6-47eb-8fd9-7ff9f5e14753/volume-data-source-validator/0.log" May 21 20:57:32.039354 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:32.039302 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9ppsn_8f451aeb-9e99-470f-9f53-635e5e4bea18/dns/0.log" May 21 20:57:32.060782 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:32.060726 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9ppsn_8f451aeb-9e99-470f-9f53-635e5e4bea18/kube-rbac-proxy/0.log" May 21 20:57:32.163728 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:32.163698 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f9rbz_e971a16c-8d63-4b87-b028-72941ca4388f/dns-node-resolver/0.log" May 21 20:57:32.637908 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:32.637874 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-765b5b7fbf-f2n57_1d8195ad-7810-45c5-8c9d-4121696777d7/registry/0.log" May 21 20:57:32.700936 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:32.700905 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ttlgr_9cfae7f5-193d-448f-91d1-e9992e31ea60/node-ca/0.log" May 21 20:57:33.604944 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:33.604917 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-mjx7g_38d35562-7801-494e-8853-417c5d5a1fbb/discovery/0.log" May 21 20:57:33.648652 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:33.648627 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-547674d64f-vzj82_359f3d50-d0be-4770-86c8-f47128531de7/kube-auth-proxy/0.log" May 21 20:57:33.702951 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:33.702926 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-8mm2w_b417779c-cde2-4085-b26f-53e753c62b73/istio-proxy/0.log" May 21 20:57:33.793015 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:33.792978 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-576545cfb4-rlx4k_c39245e2-2433-4601-bf1b-443f5fd576e7/router/0.log" May 21 20:57:34.345836 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:34.345808 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vrb96_20ec65f6-efea-4276-8673-ccdec1229094/serve-healthcheck-canary/0.log" May 21 20:57:34.745218 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:34.745143 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-zzz86_feb4a481-c655-4be3-ae09-4f6c8277ca62/insights-operator/0.log" May 21 20:57:34.886553 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:34.886525 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vb6w7_84e3015b-fd5e-4fe4-93a8-7a01aa8630d8/kube-rbac-proxy/0.log" May 21 20:57:34.906883 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:34.906851 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vb6w7_84e3015b-fd5e-4fe4-93a8-7a01aa8630d8/exporter/0.log" May 21 20:57:34.926353 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:34.926330 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vb6w7_84e3015b-fd5e-4fe4-93a8-7a01aa8630d8/extractor/0.log" May 21 20:57:36.763741 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:36.763708 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-xb4fw_37e66772-12f6-4f55-bdad-8a5721bfa24c/manager/0.log" May 21 20:57:36.795337 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:36.795312 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-8dd8d786c-q8w4f_05f35afc-73f7-4f63-81a8-8f66b4851240/maas-api/0.log" May 21 20:57:36.878225 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:36.878201 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6b56d58d6b-6wx2d_401da8f3-e0e6-4ba4-9404-3cff8879054b/manager/0.log" May 21 20:57:36.896817 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:36.896762 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-6xsd5_5c5fed31-7e58-45bb-aeed-3fcbe924088e/manager/1.log" May 21 20:57:36.906562 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:36.906539 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-6xsd5_5c5fed31-7e58-45bb-aeed-3fcbe924088e/manager/2.log" May 21 20:57:36.941284 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:36.941267 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64cb4d6bf5-8pzdj_f196a1f9-f9f2-46f6-9fb0-421e8b79d27f/manager/0.log" May 21 20:57:37.115758 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:37.115729 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s2x8m/perf-node-gather-daemonset-9d2xs" May 21 20:57:42.863591 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:42.863557 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-vn4g8_58270938-7043-423b-91cc-07aa70d5cb14/kube-storage-version-migrator-operator/0.log" May 21 20:57:43.896806 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:43.896777 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6q9zf_2203055e-7913-47ff-8c77-bed42b5caf84/kube-multus-additional-cni-plugins/0.log" May 21 20:57:43.916183 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:43.916160 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6q9zf_2203055e-7913-47ff-8c77-bed42b5caf84/egress-router-binary-copy/0.log" May 21 20:57:43.938010 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:43.937983 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6q9zf_2203055e-7913-47ff-8c77-bed42b5caf84/cni-plugins/0.log" May 21 20:57:43.960239 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:43.960220 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6q9zf_2203055e-7913-47ff-8c77-bed42b5caf84/bond-cni-plugin/0.log" May 21 20:57:43.980472 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:43.980451 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6q9zf_2203055e-7913-47ff-8c77-bed42b5caf84/routeoverride-cni/0.log" May 21 20:57:44.000200 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:44.000168 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6q9zf_2203055e-7913-47ff-8c77-bed42b5caf84/whereabouts-cni-bincopy/0.log" May 21 20:57:44.019631 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:44.019604 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6q9zf_2203055e-7913-47ff-8c77-bed42b5caf84/whereabouts-cni/0.log" May 21 20:57:44.345727 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:44.345696 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-j7565_54d14f03-ea58-4ea8-ade6-0bc0f72b254a/kube-multus/0.log" May 21 20:57:44.391238 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:44.391211 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5nnzg_f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2/network-metrics-daemon/0.log" May 21 20:57:44.409046 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:44.409015 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5nnzg_f8eaaa97-1ea9-4939-9f92-b63f2a33d4d2/kube-rbac-proxy/0.log" May 21 20:57:45.562139 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:45.562109 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6tkgs_61df691b-d720-4813-9647-631228bc7521/ovn-controller/0.log" May 21 20:57:45.590081 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:45.589567 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6tkgs_61df691b-d720-4813-9647-631228bc7521/ovn-acl-logging/0.log" May 21 20:57:45.605411 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:45.605379 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6tkgs_61df691b-d720-4813-9647-631228bc7521/kube-rbac-proxy-node/0.log" May 21 20:57:45.625378 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:45.625356 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6tkgs_61df691b-d720-4813-9647-631228bc7521/kube-rbac-proxy-ovn-metrics/0.log" May 21 20:57:45.643648 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:45.643631 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6tkgs_61df691b-d720-4813-9647-631228bc7521/northd/0.log" May 21 20:57:45.663644 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:45.663620 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6tkgs_61df691b-d720-4813-9647-631228bc7521/nbdb/0.log" May 21 20:57:45.682537 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:45.682508 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6tkgs_61df691b-d720-4813-9647-631228bc7521/sbdb/0.log" May 21 20:57:45.788377 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:45.788344 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6tkgs_61df691b-d720-4813-9647-631228bc7521/ovnkube-controller/0.log" May 21 20:57:47.182406 ip-10-0-134-40 kubenswrapper[2559]: I0521 20:57:47.182383 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-h9lxq_ecaedb39-3cf7-450d-8e42-f508c68a92b8/network-check-target-container/0.log"