May 27 14:05:17.516614 ip-10-0-141-132 systemd[1]: Starting Kubernetes Kubelet... May 27 14:05:18.021606 ip-10-0-141-132 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 14:05:18.021606 ip-10-0-141-132 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 27 14:05:18.021606 ip-10-0-141-132 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 14:05:18.021606 ip-10-0-141-132 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 27 14:05:18.021606 ip-10-0-141-132 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 14:05:18.025375 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.025213 2576 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 27 14:05:18.032637 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032617 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 14:05:18.032637 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032634 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 14:05:18.032637 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032638 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 14:05:18.032637 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032641 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 14:05:18.032637 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032644 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 14:05:18.032824 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032647 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 14:05:18.032824 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032650 2576 feature_gate.go:328] unrecognized feature gate: Example2 May 27 14:05:18.032824 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032653 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 14:05:18.032824 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032656 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 14:05:18.032824 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032659 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 14:05:18.032824 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032662 2576 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 14:05:18.032824 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032665 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 14:05:18.032824 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032668 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 14:05:18.032824 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032671 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 14:05:18.032824 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032674 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 14:05:18.032824 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032676 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 14:05:18.032824 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032679 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 14:05:18.032824 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032681 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 14:05:18.032824 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032684 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 14:05:18.032824 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032687 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 14:05:18.032824 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032690 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 14:05:18.032824 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032693 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 14:05:18.032824 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032695 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 14:05:18.032824 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032698 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 14:05:18.032824 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032701 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 14:05:18.033310 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032703 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 14:05:18.033310 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032713 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 14:05:18.033310 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032716 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 14:05:18.033310 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032718 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 14:05:18.033310 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032721 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 14:05:18.033310 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032724 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 14:05:18.033310 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032726 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 14:05:18.033310 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032729 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 14:05:18.033310 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032731 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 14:05:18.033310 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032734 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 14:05:18.033310 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032737 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 14:05:18.033310 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032739 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 14:05:18.033310 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032742 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 14:05:18.033310 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032745 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 14:05:18.033310 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032748 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 14:05:18.033310 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032751 2576 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 14:05:18.033310 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032753 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 14:05:18.033310 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032758 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 14:05:18.033310 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032762 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 14:05:18.033310 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032766 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 14:05:18.033823 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032768 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 14:05:18.033823 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032772 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 14:05:18.033823 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032775 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 14:05:18.033823 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032778 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 14:05:18.033823 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032780 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 14:05:18.033823 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032783 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 14:05:18.033823 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032785 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 14:05:18.033823 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032788 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 14:05:18.033823 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032791 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 14:05:18.033823 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032793 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 14:05:18.033823 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032796 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 14:05:18.033823 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032799 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 14:05:18.033823 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032801 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 14:05:18.033823 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032804 2576 feature_gate.go:328] unrecognized feature gate: Example May 27 14:05:18.033823 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032806 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 14:05:18.033823 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032809 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 14:05:18.033823 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032812 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 14:05:18.033823 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032816 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 14:05:18.033823 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032819 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 14:05:18.034286 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032822 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 14:05:18.034286 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032825 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 14:05:18.034286 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032827 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 14:05:18.034286 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032830 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 14:05:18.034286 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032834 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 14:05:18.034286 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032837 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 14:05:18.034286 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032840 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 14:05:18.034286 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032843 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 14:05:18.034286 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032846 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 14:05:18.034286 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032849 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 14:05:18.034286 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032851 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 14:05:18.034286 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032854 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 14:05:18.034286 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032856 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 14:05:18.034286 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032859 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 14:05:18.034286 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032905 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 14:05:18.034286 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032909 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 14:05:18.034286 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032913 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 14:05:18.034286 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032916 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 14:05:18.034286 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032919 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 14:05:18.034286 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032922 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 14:05:18.034797 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032925 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 14:05:18.034797 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.032928 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 14:05:18.035834 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035822 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 14:05:18.035834 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035833 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 14:05:18.035897 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035836 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 14:05:18.035897 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035840 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 14:05:18.035897 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035842 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 14:05:18.035897 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035845 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 14:05:18.035897 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035848 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 14:05:18.035897 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035851 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 14:05:18.035897 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035854 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 14:05:18.035897 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035859 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 14:05:18.035897 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035862 2576 feature_gate.go:328] unrecognized feature gate: Example2 May 27 14:05:18.035897 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035865 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 14:05:18.035897 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035868 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 14:05:18.035897 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035870 2576 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 14:05:18.035897 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035873 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 14:05:18.035897 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035875 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 14:05:18.035897 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035878 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 14:05:18.035897 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035881 2576 feature_gate.go:328] unrecognized feature gate: Example May 27 14:05:18.035897 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035884 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 14:05:18.035897 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035887 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 14:05:18.035897 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035889 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 14:05:18.035897 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035892 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 14:05:18.036392 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035894 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 14:05:18.036392 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035897 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 14:05:18.036392 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035900 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 14:05:18.036392 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035903 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 14:05:18.036392 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035906 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 14:05:18.036392 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035909 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 14:05:18.036392 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035912 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 14:05:18.036392 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035914 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 14:05:18.036392 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035917 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 14:05:18.036392 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035919 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 14:05:18.036392 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035922 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 14:05:18.036392 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035924 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 14:05:18.036392 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035927 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 14:05:18.036392 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035931 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 14:05:18.036392 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035933 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 14:05:18.036392 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035935 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 14:05:18.036392 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035938 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 14:05:18.036392 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035940 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 14:05:18.036392 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035943 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 14:05:18.036392 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035945 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 14:05:18.036891 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035948 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 14:05:18.036891 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035951 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 14:05:18.036891 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035954 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 14:05:18.036891 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035957 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 14:05:18.036891 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035959 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 14:05:18.036891 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035962 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 14:05:18.036891 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035965 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 14:05:18.036891 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035967 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 14:05:18.036891 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035970 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 14:05:18.036891 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035972 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 14:05:18.036891 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035974 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 14:05:18.036891 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035977 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 14:05:18.036891 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035979 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 14:05:18.036891 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035984 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 14:05:18.036891 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035986 2576 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 14:05:18.036891 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035991 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 14:05:18.036891 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035993 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 14:05:18.036891 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035996 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 14:05:18.036891 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.035998 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 14:05:18.036891 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036001 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 14:05:18.037404 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036004 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 14:05:18.037404 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036006 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 14:05:18.037404 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036009 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 14:05:18.037404 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036011 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 14:05:18.037404 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036015 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 14:05:18.037404 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036017 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 14:05:18.037404 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036020 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 14:05:18.037404 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036022 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 14:05:18.037404 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036025 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 14:05:18.037404 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036027 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 14:05:18.037404 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036030 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 14:05:18.037404 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036032 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 14:05:18.037404 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036035 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 14:05:18.037404 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036038 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 14:05:18.037404 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036040 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 14:05:18.037404 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036043 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 14:05:18.037404 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036045 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 14:05:18.037404 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036048 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 14:05:18.037404 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036050 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 14:05:18.037879 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036053 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 14:05:18.037879 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036055 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 14:05:18.037879 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036058 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 14:05:18.037879 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036060 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 14:05:18.037879 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036063 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 14:05:18.037879 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036129 2576 flags.go:64] FLAG: --address="0.0.0.0" May 27 14:05:18.037879 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036136 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 27 14:05:18.037879 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036143 2576 flags.go:64] FLAG: --anonymous-auth="true" May 27 14:05:18.037879 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036158 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" May 27 14:05:18.037879 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036163 2576 flags.go:64] FLAG: --authentication-token-webhook="false" May 27 14:05:18.037879 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036166 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 27 14:05:18.037879 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036171 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 27 14:05:18.037879 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036176 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 27 14:05:18.037879 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036179 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 27 14:05:18.037879 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036182 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 27 14:05:18.037879 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036187 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 27 14:05:18.037879 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036190 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 27 14:05:18.037879 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036193 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 27 14:05:18.037879 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036196 2576 flags.go:64] FLAG: --cgroup-root="" May 27 14:05:18.037879 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036199 2576 flags.go:64] FLAG: --cgroups-per-qos="true" May 27 14:05:18.037879 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036202 2576 flags.go:64] FLAG: --client-ca-file="" May 27 14:05:18.037879 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036205 2576 flags.go:64] FLAG: --cloud-config="" May 27 14:05:18.037879 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036208 2576 flags.go:64] FLAG: --cloud-provider="external" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036211 2576 flags.go:64] FLAG: --cluster-dns="[]" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036215 2576 flags.go:64] FLAG: --cluster-domain="" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036218 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036222 2576 flags.go:64] FLAG: --config-dir="" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036224 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036228 2576 flags.go:64] FLAG: --container-log-max-files="5" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036236 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036240 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036243 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036247 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036250 2576 flags.go:64] FLAG: --contention-profiling="false" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036253 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036256 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036260 2576 flags.go:64] FLAG: --cpu-manager-policy="none" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036263 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036267 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036270 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036273 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036275 2576 flags.go:64] FLAG: --enable-load-reader="false" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036279 2576 flags.go:64] FLAG: --enable-server="true" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036282 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036286 2576 flags.go:64] FLAG: --event-burst="100" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036290 2576 flags.go:64] FLAG: --event-qps="50" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036293 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 27 14:05:18.038454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036296 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 27 14:05:18.039080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036299 2576 flags.go:64] FLAG: --eviction-hard="" May 27 14:05:18.039080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036303 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 27 14:05:18.039080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036306 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 27 14:05:18.039080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036309 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 27 14:05:18.039080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036312 2576 flags.go:64] FLAG: --eviction-soft="" May 27 14:05:18.039080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036315 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" May 27 14:05:18.039080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036318 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" May 27 14:05:18.039080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036336 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 27 14:05:18.039080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036340 2576 flags.go:64] FLAG: --experimental-mounter-path="" May 27 14:05:18.039080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036343 2576 flags.go:64] FLAG: --fail-cgroupv1="false" May 27 14:05:18.039080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036346 2576 flags.go:64] FLAG: --fail-swap-on="true" May 27 14:05:18.039080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036349 2576 flags.go:64] FLAG: --feature-gates="" May 27 14:05:18.039080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036354 2576 flags.go:64] FLAG: --file-check-frequency="20s" May 27 14:05:18.039080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036357 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 27 14:05:18.039080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036360 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 27 14:05:18.039080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036364 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 27 14:05:18.039080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036368 2576 flags.go:64] FLAG: --healthz-port="10248" May 27 14:05:18.039080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036371 2576 flags.go:64] FLAG: --help="false" May 27 14:05:18.039080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036374 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-141-132.ec2.internal" May 27 14:05:18.039080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036377 2576 flags.go:64] FLAG: --housekeeping-interval="10s" May 27 14:05:18.039080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036380 2576 flags.go:64] FLAG: --http-check-frequency="20s" May 27 14:05:18.039080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036383 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 27 14:05:18.039080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036386 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 27 14:05:18.039080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036390 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036393 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036396 2576 flags.go:64] FLAG: --image-service-endpoint="" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036399 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036402 2576 flags.go:64] FLAG: --kube-api-burst="100" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036406 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036409 2576 flags.go:64] FLAG: --kube-api-qps="50" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036412 2576 flags.go:64] FLAG: --kube-reserved="" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036415 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036418 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036421 2576 flags.go:64] FLAG: --kubelet-cgroups="" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036424 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036427 2576 flags.go:64] FLAG: --lock-file="" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036429 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036432 2576 flags.go:64] FLAG: --log-flush-frequency="5s" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036438 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036444 2576 flags.go:64] FLAG: --log-json-split-stream="false" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036447 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036450 2576 flags.go:64] FLAG: --log-text-split-stream="false" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036453 2576 flags.go:64] FLAG: --logging-format="text" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036456 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036459 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036462 2576 flags.go:64] FLAG: --manifest-url="" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036465 2576 flags.go:64] FLAG: --manifest-url-header="" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036470 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 27 14:05:18.039678 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036473 2576 flags.go:64] FLAG: --max-open-files="1000000" May 27 14:05:18.040287 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036477 2576 flags.go:64] FLAG: --max-pods="110" May 27 14:05:18.040287 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036480 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" May 27 14:05:18.040287 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036483 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 27 14:05:18.040287 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036486 2576 flags.go:64] FLAG: --memory-manager-policy="None" May 27 14:05:18.040287 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036489 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 27 14:05:18.040287 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036492 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 27 14:05:18.040287 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036495 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" May 27 14:05:18.040287 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036498 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 27 14:05:18.040287 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036505 2576 flags.go:64] FLAG: --node-status-max-images="50" May 27 14:05:18.040287 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036508 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" May 27 14:05:18.040287 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036511 2576 flags.go:64] FLAG: --oom-score-adj="-999" May 27 14:05:18.040287 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036515 2576 flags.go:64] FLAG: --pod-cidr="" May 27 14:05:18.040287 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036518 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 27 14:05:18.040287 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036523 2576 flags.go:64] FLAG: --pod-manifest-path="" May 27 14:05:18.040287 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036526 2576 flags.go:64] FLAG: --pod-max-pids="-1" May 27 14:05:18.040287 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036529 2576 flags.go:64] FLAG: --pods-per-core="0" May 27 14:05:18.040287 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036532 2576 flags.go:64] FLAG: --port="10250" May 27 14:05:18.040287 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036535 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" May 27 14:05:18.040287 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036538 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01c977fdfe8b9bd15" May 27 14:05:18.040287 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036541 2576 flags.go:64] FLAG: --qos-reserved="" May 27 14:05:18.040287 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036544 2576 flags.go:64] FLAG: --read-only-port="10255" May 27 14:05:18.040287 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036549 2576 flags.go:64] FLAG: --register-node="true" May 27 14:05:18.040287 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036552 2576 flags.go:64] FLAG: --register-schedulable="true" May 27 14:05:18.040287 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036555 2576 flags.go:64] FLAG: --register-with-taints="" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036558 2576 flags.go:64] FLAG: --registry-burst="10" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036561 2576 flags.go:64] FLAG: --registry-qps="5" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036564 2576 flags.go:64] FLAG: --reserved-cpus="" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036567 2576 flags.go:64] FLAG: --reserved-memory="" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036570 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036574 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036576 2576 flags.go:64] FLAG: --rotate-certificates="false" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036583 2576 flags.go:64] FLAG: --rotate-server-certificates="false" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036586 2576 flags.go:64] FLAG: --runonce="false" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036589 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036592 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036595 2576 flags.go:64] FLAG: --seccomp-default="false" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036598 2576 flags.go:64] FLAG: --serialize-image-pulls="true" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036601 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036604 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036607 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036610 2576 flags.go:64] FLAG: --storage-driver-password="root" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036614 2576 flags.go:64] FLAG: --storage-driver-secure="false" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036616 2576 flags.go:64] FLAG: --storage-driver-table="stats" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036619 2576 flags.go:64] FLAG: --storage-driver-user="root" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036623 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036626 2576 flags.go:64] FLAG: --sync-frequency="1m0s" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036629 2576 flags.go:64] FLAG: --system-cgroups="" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036632 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 27 14:05:18.040919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036637 2576 flags.go:64] FLAG: --system-reserved-cgroup="" May 27 14:05:18.041553 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036640 2576 flags.go:64] FLAG: --tls-cert-file="" May 27 14:05:18.041553 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036643 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" May 27 14:05:18.041553 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036647 2576 flags.go:64] FLAG: --tls-min-version="" May 27 14:05:18.041553 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036650 2576 flags.go:64] FLAG: --tls-private-key-file="" May 27 14:05:18.041553 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036654 2576 flags.go:64] FLAG: --topology-manager-policy="none" May 27 14:05:18.041553 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036656 2576 flags.go:64] FLAG: --topology-manager-policy-options="" May 27 14:05:18.041553 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036659 2576 flags.go:64] FLAG: --topology-manager-scope="container" May 27 14:05:18.041553 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036662 2576 flags.go:64] FLAG: --v="2" May 27 14:05:18.041553 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036667 2576 flags.go:64] FLAG: --version="false" May 27 14:05:18.041553 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036671 2576 flags.go:64] FLAG: --vmodule="" May 27 14:05:18.041553 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036675 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 27 14:05:18.041553 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.036678 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 27 14:05:18.041553 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036767 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 14:05:18.041553 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036771 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 14:05:18.041553 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036776 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 14:05:18.041553 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036778 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 14:05:18.041553 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036782 2576 feature_gate.go:328] unrecognized feature gate: Example May 27 14:05:18.041553 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036784 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 14:05:18.041553 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036787 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 14:05:18.041553 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036790 2576 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 14:05:18.041553 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036792 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 14:05:18.041553 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036795 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 14:05:18.041553 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036798 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 14:05:18.042103 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036800 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 14:05:18.042103 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036803 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 14:05:18.042103 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036806 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 14:05:18.042103 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036809 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 14:05:18.042103 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036811 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 14:05:18.042103 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036815 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 14:05:18.042103 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036817 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 14:05:18.042103 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036820 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 14:05:18.042103 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036823 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 14:05:18.042103 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036825 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 14:05:18.042103 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036828 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 14:05:18.042103 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036830 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 14:05:18.042103 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036833 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 14:05:18.042103 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036837 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 14:05:18.042103 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036841 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 14:05:18.042103 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036844 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 14:05:18.042103 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036847 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 14:05:18.042103 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036850 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 14:05:18.042103 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036853 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 14:05:18.042604 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036855 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 14:05:18.042604 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036858 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 14:05:18.042604 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036861 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 14:05:18.042604 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036863 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 14:05:18.042604 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036867 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 14:05:18.042604 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036870 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 14:05:18.042604 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036872 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 14:05:18.042604 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036875 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 14:05:18.042604 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036878 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 14:05:18.042604 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036880 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 14:05:18.042604 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036882 2576 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 14:05:18.042604 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036885 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 14:05:18.042604 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036887 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 14:05:18.042604 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036890 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 14:05:18.042604 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036893 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 14:05:18.042604 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036896 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 14:05:18.042604 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036899 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 14:05:18.042604 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036901 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 14:05:18.042604 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036904 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 14:05:18.042604 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036907 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 14:05:18.043101 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036910 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 14:05:18.043101 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036913 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 14:05:18.043101 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036915 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 14:05:18.043101 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036918 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 14:05:18.043101 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036921 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 14:05:18.043101 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036923 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 14:05:18.043101 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036926 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 14:05:18.043101 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036929 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 14:05:18.043101 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036932 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 14:05:18.043101 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036934 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 14:05:18.043101 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036937 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 14:05:18.043101 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036939 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 14:05:18.043101 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036942 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 14:05:18.043101 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036944 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 14:05:18.043101 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036947 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 14:05:18.043101 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036950 2576 feature_gate.go:328] unrecognized feature gate: Example2 May 27 14:05:18.043101 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036954 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 14:05:18.043101 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036957 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 14:05:18.043101 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036960 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 14:05:18.043101 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036964 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 14:05:18.043631 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036968 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 14:05:18.043631 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036970 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 14:05:18.043631 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036973 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 14:05:18.043631 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036975 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 14:05:18.043631 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036978 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 14:05:18.043631 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036981 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 14:05:18.043631 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036983 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 14:05:18.043631 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036986 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 14:05:18.043631 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036988 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 14:05:18.043631 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036991 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 14:05:18.043631 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036994 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 14:05:18.043631 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.036996 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 14:05:18.043631 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.037003 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 14:05:18.043631 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.037005 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 14:05:18.043631 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.037008 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 14:05:18.043631 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.037010 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 14:05:18.044043 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.037851 2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 14:05:18.044610 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.044591 2576 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 27 14:05:18.044648 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.044611 2576 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 27 14:05:18.044675 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044662 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 14:05:18.044675 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044668 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 14:05:18.044675 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044671 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 14:05:18.044675 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044674 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 14:05:18.044772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044678 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 14:05:18.044772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044681 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 14:05:18.044772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044685 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 14:05:18.044772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044690 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 14:05:18.044772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044693 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 14:05:18.044772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044696 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 14:05:18.044772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044699 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 14:05:18.044772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044703 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 14:05:18.044772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044706 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 14:05:18.044772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044709 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 14:05:18.044772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044712 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 14:05:18.044772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044715 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 14:05:18.044772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044718 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 14:05:18.044772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044721 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 14:05:18.044772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044724 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 14:05:18.044772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044727 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 14:05:18.044772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044730 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 14:05:18.044772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044732 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 14:05:18.044772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044735 2576 feature_gate.go:328] unrecognized feature gate: Example May 27 14:05:18.045241 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044737 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 14:05:18.045241 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044740 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 14:05:18.045241 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044744 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 14:05:18.045241 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044747 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 14:05:18.045241 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044749 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 14:05:18.045241 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044752 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 14:05:18.045241 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044754 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 14:05:18.045241 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044757 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 14:05:18.045241 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044760 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 14:05:18.045241 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044762 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 14:05:18.045241 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044765 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 14:05:18.045241 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044767 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 14:05:18.045241 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044770 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 14:05:18.045241 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044773 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 14:05:18.045241 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044776 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 14:05:18.045241 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044779 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 14:05:18.045241 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044781 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 14:05:18.045241 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044784 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 14:05:18.045241 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044787 2576 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 14:05:18.045241 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044790 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 14:05:18.045746 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044793 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 14:05:18.045746 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044795 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 14:05:18.045746 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044798 2576 feature_gate.go:328] unrecognized feature gate: Example2 May 27 14:05:18.045746 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044801 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 14:05:18.045746 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044803 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 14:05:18.045746 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044806 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 14:05:18.045746 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044808 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 14:05:18.045746 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044811 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 14:05:18.045746 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044814 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 14:05:18.045746 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044816 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 14:05:18.045746 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044819 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 14:05:18.045746 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044821 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 14:05:18.045746 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044824 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 14:05:18.045746 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044827 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 14:05:18.045746 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044830 2576 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 14:05:18.045746 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044833 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 14:05:18.045746 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044835 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 14:05:18.045746 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044838 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 14:05:18.045746 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044841 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 14:05:18.045746 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044843 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 14:05:18.046234 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044846 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 14:05:18.046234 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044848 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 14:05:18.046234 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044851 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 14:05:18.046234 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044853 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 14:05:18.046234 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044856 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 14:05:18.046234 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044858 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 14:05:18.046234 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044861 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 14:05:18.046234 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044864 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 14:05:18.046234 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044866 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 14:05:18.046234 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044869 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 14:05:18.046234 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044872 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 14:05:18.046234 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044874 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 14:05:18.046234 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044877 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 14:05:18.046234 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044879 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 14:05:18.046234 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044882 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 14:05:18.046234 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044885 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 14:05:18.046234 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044887 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 14:05:18.046234 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044890 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 14:05:18.046234 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044892 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 14:05:18.046234 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044895 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 14:05:18.046772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044897 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 14:05:18.046772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044900 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 14:05:18.046772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.044902 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 14:05:18.046772 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.044908 2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 14:05:18.046772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045013 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 14:05:18.046772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045017 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 14:05:18.046772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045021 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 14:05:18.046772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045024 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 14:05:18.046772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045027 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 14:05:18.046772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045030 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 14:05:18.046772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045032 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 14:05:18.046772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045035 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 14:05:18.046772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045037 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 14:05:18.046772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045040 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 14:05:18.046772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045044 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 14:05:18.047144 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045047 2576 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 14:05:18.047144 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045050 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 14:05:18.047144 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045052 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 14:05:18.047144 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045055 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 14:05:18.047144 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045058 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 14:05:18.047144 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045060 2576 feature_gate.go:328] unrecognized feature gate: Example May 27 14:05:18.047144 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045063 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 14:05:18.047144 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045065 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 14:05:18.047144 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045068 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 14:05:18.047144 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045071 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 14:05:18.047144 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045073 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 14:05:18.047144 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045076 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 14:05:18.047144 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045078 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 14:05:18.047144 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045081 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 14:05:18.047144 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045083 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 14:05:18.047144 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045086 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 14:05:18.047144 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045088 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 14:05:18.047144 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045091 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 14:05:18.047144 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045093 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 14:05:18.047616 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045096 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 14:05:18.047616 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045098 2576 feature_gate.go:328] unrecognized feature gate: Example2 May 27 14:05:18.047616 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045101 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 14:05:18.047616 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045104 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 14:05:18.047616 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045106 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 14:05:18.047616 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045109 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 14:05:18.047616 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045111 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 14:05:18.047616 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045115 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 14:05:18.047616 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045117 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 14:05:18.047616 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045120 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 14:05:18.047616 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045122 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 14:05:18.047616 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045125 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 14:05:18.047616 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045127 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 14:05:18.047616 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045130 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 14:05:18.047616 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045132 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 14:05:18.047616 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045144 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 14:05:18.047616 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045149 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 14:05:18.047616 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045152 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 14:05:18.047616 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045155 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 14:05:18.048104 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045158 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 14:05:18.048104 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045160 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 14:05:18.048104 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045163 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 14:05:18.048104 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045166 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 14:05:18.048104 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045169 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 14:05:18.048104 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045171 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 14:05:18.048104 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045174 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 14:05:18.048104 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045176 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 14:05:18.048104 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045179 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 14:05:18.048104 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045181 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 14:05:18.048104 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045184 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 14:05:18.048104 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045186 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 14:05:18.048104 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045189 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 14:05:18.048104 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045192 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 14:05:18.048104 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045194 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 14:05:18.048104 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045197 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 14:05:18.048104 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045200 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 14:05:18.048104 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045202 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 14:05:18.048104 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045205 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 14:05:18.048104 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045207 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 14:05:18.048613 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045209 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 14:05:18.048613 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045213 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 14:05:18.048613 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045215 2576 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 14:05:18.048613 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045218 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 14:05:18.048613 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045221 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 14:05:18.048613 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045224 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 14:05:18.048613 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045226 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 14:05:18.048613 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045229 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 14:05:18.048613 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045231 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 14:05:18.048613 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045234 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 14:05:18.048613 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045237 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 14:05:18.048613 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045239 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 14:05:18.048613 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045242 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 14:05:18.048613 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045245 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 14:05:18.048613 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045247 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 14:05:18.048613 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045250 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 14:05:18.048613 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:18.045253 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 14:05:18.049020 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.045258 2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 14:05:18.049020 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.046178 2576 server.go:962] "Client rotation is on, will bootstrap in background" May 27 14:05:18.050671 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.050658 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 27 14:05:18.051789 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.051777 2576 server.go:1019] "Starting client certificate rotation" May 27 14:05:18.051889 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.051872 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 14:05:18.051923 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.051913 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 14:05:18.080488 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.080466 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 14:05:18.082309 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.082285 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 14:05:18.100772 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.100748 2576 log.go:25] "Validated CRI v1 runtime API" May 27 14:05:18.107234 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.107217 2576 log.go:25] "Validated CRI v1 image API" May 27 14:05:18.110174 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.110157 2576 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 27 14:05:18.115564 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.115540 2576 fs.go:135] Filesystem UUIDs: map[4570db24-27ea-41f9-8040-47284225389a:/dev/nvme0n1p3 5ce6bef4-8938-485e-87a7-604b424acc13:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] May 27 14:05:18.115626 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.115562 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 27 14:05:18.118249 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.118229 2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 14:05:18.120211 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.120109 2576 manager.go:217] Machine: {Timestamp:2026-05-27 14:05:18.119624419 +0000 UTC m=+0.472449546 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097884 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f954eff97862938d6ace177276e67 SystemUUID:ec2f954e-ff97-8629-38d6-ace177276e67 BootID:b86140ee-7a41-4eb7-906f-bc2fce3c68fd Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:32:ae:a9:f4:71 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:32:ae:a9:f4:71 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:12:6d:7f:55:93 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 27 14:05:18.120211 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.120211 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 27 14:05:18.120311 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.120288 2576 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 27 14:05:18.122507 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.122486 2576 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 27 14:05:18.122641 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.122509 2576 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-132.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 27 14:05:18.122690 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.122651 2576 topology_manager.go:138] "Creating topology manager with none policy" May 27 14:05:18.122690 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.122660 2576 container_manager_linux.go:306] "Creating device plugin manager" May 27 14:05:18.122690 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.122667 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 14:05:18.122690 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.122684 2576 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 14:05:18.125376 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.125365 2576 state_mem.go:36] "Initialized new in-memory state store" May 27 14:05:18.125489 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.125480 2576 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 27 14:05:18.128430 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.128420 2576 kubelet.go:491] "Attempting to sync node with API server" May 27 14:05:18.128466 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.128434 2576 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 27 14:05:18.129265 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.129256 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 27 14:05:18.129296 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.129270 2576 kubelet.go:397] "Adding apiserver pod source" May 27 14:05:18.129296 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.129280 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 27 14:05:18.130558 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.130544 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 14:05:18.130595 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.130571 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 14:05:18.134037 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.134022 2576 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 27 14:05:18.136442 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.136428 2576 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 27 14:05:18.137490 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.137475 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 27 14:05:18.137490 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.137492 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 27 14:05:18.137576 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.137498 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 27 14:05:18.137576 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.137504 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 27 14:05:18.137576 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.137513 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 27 14:05:18.137576 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.137520 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 27 14:05:18.137576 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.137526 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 27 14:05:18.137576 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.137532 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 27 14:05:18.137576 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.137539 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 27 14:05:18.137576 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.137545 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 27 14:05:18.137576 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.137555 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 27 14:05:18.137942 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.137934 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 27 14:05:18.138874 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.138867 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 27 14:05:18.138874 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.138876 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 27 14:05:18.140745 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.140730 2576 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-132.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 27 14:05:18.140793 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:18.140767 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-132.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 27 14:05:18.141336 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:18.141301 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 27 14:05:18.141852 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.141838 2576 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 27 14:05:18.141904 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.141878 2576 server.go:1295] "Started kubelet" May 27 14:05:18.142016 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.141973 2576 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 27 14:05:18.142825 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.142803 2576 server_v1.go:47] "podresources" method="list" useActivePods=true May 27 14:05:18.143277 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.141971 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 27 14:05:18.143433 ip-10-0-141-132 systemd[1]: Started Kubernetes Kubelet. May 27 14:05:18.144434 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.144393 2576 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 27 14:05:18.145294 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.145276 2576 server.go:317] "Adding debug handlers to kubelet server" May 27 14:05:18.151872 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.151853 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-985kl" May 27 14:05:18.152006 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:18.150904 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-132.ec2.internal.18b3712d89dc2b13 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-132.ec2.internal,UID:ip-10-0-141-132.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-132.ec2.internal,},FirstTimestamp:2026-05-27 14:05:18.141852435 +0000 UTC m=+0.494677561,LastTimestamp:2026-05-27 14:05:18.141852435 +0000 UTC m=+0.494677561,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-132.ec2.internal,}" May 27 14:05:18.154365 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.154349 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 27 14:05:18.154849 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:18.154830 2576 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 27 14:05:18.155022 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.155006 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 27 14:05:18.155197 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.155183 2576 volume_manager.go:295] "The desired_state_of_world populator starts" May 27 14:05:18.155197 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.155198 2576 volume_manager.go:297] "Starting Kubelet Volume Manager" May 27 14:05:18.155311 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.155299 2576 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 27 14:05:18.155964 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.155819 2576 factory.go:55] Registering systemd factory May 27 14:05:18.155964 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.155869 2576 factory.go:223] Registration of the systemd container factory successfully May 27 14:05:18.156123 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.156106 2576 reconstruct.go:97] "Volume reconstruction finished" May 27 14:05:18.156123 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.156124 2576 reconciler.go:26] "Reconciler: start to sync state" May 27 14:05:18.156490 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.156462 2576 factory.go:153] Registering CRI-O factory May 27 14:05:18.156490 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.156481 2576 factory.go:223] Registration of the crio container factory successfully May 27 14:05:18.156644 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.156532 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 27 14:05:18.156644 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.156553 2576 factory.go:103] Registering Raw factory May 27 14:05:18.156644 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.156567 2576 manager.go:1196] Started watching for new ooms in manager May 27 14:05:18.156644 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:18.156578 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-132.ec2.internal\" not found" May 27 14:05:18.157816 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.157798 2576 manager.go:319] Starting recovery of all containers May 27 14:05:18.162359 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.162340 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-985kl" May 27 14:05:18.167605 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:18.167368 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 27 14:05:18.167961 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:18.167935 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-132.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 27 14:05:18.168474 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.168461 2576 manager.go:324] Recovery completed May 27 14:05:18.172589 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.172576 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 14:05:18.174988 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.174972 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientMemory" May 27 14:05:18.175045 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.175009 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasNoDiskPressure" May 27 14:05:18.175045 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.175027 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientPID" May 27 14:05:18.175598 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.175583 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" May 27 14:05:18.175598 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.175598 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 27 14:05:18.175692 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.175615 2576 state_mem.go:36] "Initialized new in-memory state store" May 27 14:05:18.179498 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.179484 2576 policy_none.go:49] "None policy: Start" May 27 14:05:18.179547 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.179505 2576 memory_manager.go:186] "Starting memorymanager" policy="None" May 27 14:05:18.179547 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.179521 2576 state_mem.go:35] "Initializing new in-memory state store" May 27 14:05:18.219920 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.219905 2576 manager.go:341] "Starting Device Plugin manager" May 27 14:05:18.240830 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:18.219941 2576 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 27 14:05:18.240830 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.219951 2576 server.go:85] "Starting device plugin registration server" May 27 14:05:18.240830 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.220171 2576 eviction_manager.go:189] "Eviction manager: starting control loop" May 27 14:05:18.240830 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.220180 2576 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 27 14:05:18.240830 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.220298 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 27 14:05:18.240830 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.220378 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 27 14:05:18.240830 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.220387 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 27 14:05:18.240830 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:18.220863 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 27 14:05:18.240830 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:18.220896 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-132.ec2.internal\" not found" May 27 14:05:18.256398 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.256373 2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 27 14:05:18.257495 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.257481 2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 27 14:05:18.257560 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.257506 2576 status_manager.go:230] "Starting to sync pod status with apiserver" May 27 14:05:18.257560 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.257526 2576 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 27 14:05:18.257560 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.257536 2576 kubelet.go:2451] "Starting kubelet main sync loop" May 27 14:05:18.257685 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:18.257577 2576 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 27 14:05:18.262951 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.262934 2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 14:05:18.320626 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.320566 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 14:05:18.321566 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.321551 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientMemory" May 27 14:05:18.321649 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.321581 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasNoDiskPressure" May 27 14:05:18.321649 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.321595 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientPID" May 27 14:05:18.321649 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.321625 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-132.ec2.internal" May 27 14:05:18.330604 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.330581 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-132.ec2.internal" May 27 14:05:18.330681 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:18.330607 2576 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-132.ec2.internal\": node \"ip-10-0-141-132.ec2.internal\" not found" May 27 14:05:18.344521 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:18.344499 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-132.ec2.internal\" not found" May 27 14:05:18.358450 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.358430 2576 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-132.ec2.internal"] May 27 14:05:18.358505 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.358488 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 14:05:18.359289 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.359276 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientMemory" May 27 14:05:18.359364 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.359302 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasNoDiskPressure" May 27 14:05:18.359364 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.359312 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientPID" May 27 14:05:18.360428 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.360415 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 14:05:18.360618 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.360606 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" May 27 14:05:18.360653 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.360636 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 14:05:18.361126 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.361112 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientMemory" May 27 14:05:18.361195 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.361143 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasNoDiskPressure" May 27 14:05:18.361195 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.361143 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientMemory" May 27 14:05:18.361195 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.361170 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasNoDiskPressure" May 27 14:05:18.361195 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.361178 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientPID" May 27 14:05:18.361350 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.361155 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientPID" May 27 14:05:18.362284 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.362272 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-132.ec2.internal" May 27 14:05:18.362331 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.362294 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 14:05:18.362939 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.362921 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientMemory" May 27 14:05:18.363010 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.362949 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasNoDiskPressure" May 27 14:05:18.363010 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.362959 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeHasSufficientPID" May 27 14:05:18.395934 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:18.395913 2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-132.ec2.internal\" not found" node="ip-10-0-141-132.ec2.internal" May 27 14:05:18.400289 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:18.400275 2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-132.ec2.internal\" not found" node="ip-10-0-141-132.ec2.internal" May 27 14:05:18.445086 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:18.445061 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-132.ec2.internal\" not found" May 27 14:05:18.458443 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.458423 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/44d960b13e96bad04d42dc8bf8ea9e6d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal\" (UID: \"44d960b13e96bad04d42dc8bf8ea9e6d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" May 27 14:05:18.458505 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.458448 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44d960b13e96bad04d42dc8bf8ea9e6d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal\" (UID: \"44d960b13e96bad04d42dc8bf8ea9e6d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" May 27 14:05:18.458505 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.458466 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/131ccd4b35d759f500cc09a15f66941e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-132.ec2.internal\" (UID: \"131ccd4b35d759f500cc09a15f66941e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-132.ec2.internal" May 27 14:05:18.546022 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:18.545989 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-132.ec2.internal\" not found" May 27 14:05:18.559166 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.559135 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/44d960b13e96bad04d42dc8bf8ea9e6d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal\" (UID: \"44d960b13e96bad04d42dc8bf8ea9e6d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" May 27 14:05:18.559166 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.559167 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44d960b13e96bad04d42dc8bf8ea9e6d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal\" (UID: \"44d960b13e96bad04d42dc8bf8ea9e6d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" May 27 14:05:18.559310 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.559186 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/131ccd4b35d759f500cc09a15f66941e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-132.ec2.internal\" (UID: \"131ccd4b35d759f500cc09a15f66941e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-132.ec2.internal" May 27 14:05:18.559310 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.559243 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/131ccd4b35d759f500cc09a15f66941e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-132.ec2.internal\" (UID: \"131ccd4b35d759f500cc09a15f66941e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-132.ec2.internal" May 27 14:05:18.559310 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.559245 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/44d960b13e96bad04d42dc8bf8ea9e6d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal\" (UID: \"44d960b13e96bad04d42dc8bf8ea9e6d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" May 27 14:05:18.559310 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.559250 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44d960b13e96bad04d42dc8bf8ea9e6d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal\" (UID: \"44d960b13e96bad04d42dc8bf8ea9e6d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" May 27 14:05:18.646473 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:18.646408 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-132.ec2.internal\" not found" May 27 14:05:18.698929 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.698897 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" May 27 14:05:18.702648 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:18.702628 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-132.ec2.internal" May 27 14:05:18.747335 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:18.747293 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-132.ec2.internal\" not found" May 27 14:05:18.847857 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:18.847810 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-132.ec2.internal\" not found" May 27 14:05:18.948348 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:18.948277 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-132.ec2.internal\" not found" May 27 14:05:19.048852 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:19.048819 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-132.ec2.internal\" not found" May 27 14:05:19.051960 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:19.051945 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 27 14:05:19.052088 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:19.052073 2576 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 14:05:19.149515 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:19.149486 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-132.ec2.internal\" not found" May 27 14:05:19.155044 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:19.155022 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 27 14:05:19.164409 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:19.164383 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-26 14:00:18 +0000 UTC" deadline="2028-02-21 22:17:50.685650818 +0000 UTC" May 27 14:05:19.164409 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:19.164406 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15248h12m31.521247462s" May 27 14:05:19.167004 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:19.166988 2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 14:05:19.194931 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:19.194913 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2dhqh" May 27 14:05:19.202183 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:19.202083 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2dhqh" May 27 14:05:19.214436 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:19.214418 2576 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 27 14:05:19.250593 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:19.250566 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-132.ec2.internal\" not found" May 27 14:05:19.268098 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:19.268077 2576 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 27 14:05:19.335640 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:19.335611 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44d960b13e96bad04d42dc8bf8ea9e6d.slice/crio-37daeafdbd113c8650f5c66d43dd1a9382b84e63208189e0aedb38739d85d23b WatchSource:0}: Error finding container 37daeafdbd113c8650f5c66d43dd1a9382b84e63208189e0aedb38739d85d23b: Status 404 returned error can't find the container with id 37daeafdbd113c8650f5c66d43dd1a9382b84e63208189e0aedb38739d85d23b May 27 14:05:19.335838 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:19.335815 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod131ccd4b35d759f500cc09a15f66941e.slice/crio-dc528a359e7acd3954f5a991c8d84b62837a016b689cc4689414505b2f03500f WatchSource:0}: Error finding container dc528a359e7acd3954f5a991c8d84b62837a016b689cc4689414505b2f03500f: Status 404 returned error can't find the container with id dc528a359e7acd3954f5a991c8d84b62837a016b689cc4689414505b2f03500f May 27 14:05:19.338915 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:19.338901 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 14:05:19.356235 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:19.356212 2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" May 27 14:05:19.368636 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:19.368617 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 14:05:19.369811 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:19.369798 2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-132.ec2.internal" May 27 14:05:19.381420 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:19.381408 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 14:05:19.543459 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:19.543435 2576 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 14:05:20.130473 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.130436 2576 apiserver.go:52] "Watching apiserver" May 27 14:05:20.138978 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.138954 2576 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 27 14:05:20.139312 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.139288 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-knspg","openshift-cluster-node-tuning-operator/tuned-fpg92","openshift-multus/multus-rkmqt","openshift-network-diagnostics/network-check-target-cr7vm","openshift-ovn-kubernetes/ovnkube-node-wd4m8","kube-system/konnectivity-agent-tqc6p","kube-system/kube-apiserver-proxy-ip-10-0-141-132.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr","openshift-image-registry/node-ca-d6zwm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal","openshift-multus/multus-additional-cni-plugins-qd9xc","openshift-multus/network-metrics-daemon-58m9b"] May 27 14:05:20.144004 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.143965 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-knspg" May 27 14:05:20.146034 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.146000 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.147568 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.147549 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 27 14:05:20.147675 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.147611 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 27 14:05:20.147675 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.147662 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rbnvp\"" May 27 14:05:20.147781 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.147554 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 27 14:05:20.148071 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.148052 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rkmqt" May 27 14:05:20.148648 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.148625 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 27 14:05:20.148754 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.148677 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 27 14:05:20.148989 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.148973 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8c6kl\"" May 27 14:05:20.150274 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.150255 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:20.150381 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:20.150345 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cr7vm" podUID="6a8d3b41-b8d0-4b23-9658-c239ee121858" May 27 14:05:20.150470 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.150451 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.152530 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.152209 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ddpfk\"" May 27 14:05:20.152530 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.152340 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 27 14:05:20.152530 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.152453 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 27 14:05:20.152742 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.152536 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 27 14:05:20.152797 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.152744 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tqc6p" May 27 14:05:20.153053 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.153033 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 27 14:05:20.154995 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.154975 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" May 27 14:05:20.155427 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.155398 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 27 14:05:20.155427 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.155414 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 27 14:05:20.155638 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.155449 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 27 14:05:20.156139 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.156122 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 27 14:05:20.156930 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.156764 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l5426\"" May 27 14:05:20.156930 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.156776 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 27 14:05:20.156930 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.156804 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ccftl\"" May 27 14:05:20.156930 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.156869 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 27 14:05:20.156930 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.156871 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 27 14:05:20.156930 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.156858 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 27 14:05:20.157431 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.157415 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d6zwm" May 27 14:05:20.158651 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.158611 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 27 14:05:20.158779 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.158759 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 27 14:05:20.158868 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.158767 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 27 14:05:20.159114 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.159056 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-672v9\"" May 27 14:05:20.160383 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.159982 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.162439 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.162024 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 27 14:05:20.162439 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.162303 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sfs49\"" May 27 14:05:20.162593 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.162563 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 27 14:05:20.163173 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.162871 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 27 14:05:20.163173 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.163025 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 27 14:05:20.163848 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.163803 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:20.163992 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.163940 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 27 14:05:20.164869 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:20.164835 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58m9b" podUID="f1a2947c-37ec-4483-b026-f7d0e5a6365d" May 27 14:05:20.165051 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.165016 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bnt65\"" May 27 14:05:20.167244 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167225 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ae3f7910-95b9-4293-8c5e-ba15fdb6739e-etc-selinux\") pod \"aws-ebs-csi-driver-node-htvbr\" (UID: \"ae3f7910-95b9-4293-8c5e-ba15fdb6739e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" May 27 14:05:20.167349 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167256 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f1c91f4-dd6f-49db-9f83-6fcc448f06f3-host\") pod \"node-ca-d6zwm\" (UID: \"0f1c91f4-dd6f-49db-9f83-6fcc448f06f3\") " pod="openshift-image-registry/node-ca-d6zwm" May 27 14:05:20.167349 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-multus-socket-dir-parent\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.167349 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/61335746-8301-4cff-bbe5-8da818657d5d-ovnkube-config\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.167508 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167352 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8rqd\" (UniqueName: \"kubernetes.io/projected/61335746-8301-4cff-bbe5-8da818657d5d-kube-api-access-q8rqd\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.167508 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-etc-modprobe-d\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.167508 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167399 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-run\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.167508 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167422 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-host-cni-netd\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.167508 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167466 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ae3f7910-95b9-4293-8c5e-ba15fdb6739e-sys-fs\") pod \"aws-ebs-csi-driver-node-htvbr\" (UID: \"ae3f7910-95b9-4293-8c5e-ba15fdb6739e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" May 27 14:05:20.167508 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167499 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-multus-cni-dir\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.167773 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167524 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6b5q\" (UniqueName: \"kubernetes.io/projected/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-kube-api-access-g6b5q\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.167773 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167570 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-node-log\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.167773 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167626 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-host-var-lib-cni-multus\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.167773 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167653 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-host-cni-bin\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.167773 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167710 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ae3f7910-95b9-4293-8c5e-ba15fdb6739e-socket-dir\") pod \"aws-ebs-csi-driver-node-htvbr\" (UID: \"ae3f7910-95b9-4293-8c5e-ba15fdb6739e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" May 27 14:05:20.167773 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167746 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ae3f7910-95b9-4293-8c5e-ba15fdb6739e-registration-dir\") pod \"aws-ebs-csi-driver-node-htvbr\" (UID: \"ae3f7910-95b9-4293-8c5e-ba15fdb6739e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" May 27 14:05:20.168110 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167777 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2npws\" (UniqueName: \"kubernetes.io/projected/e951b51f-08ac-4c01-8734-ed44b0e24d1d-kube-api-access-2npws\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.168110 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167805 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/61335746-8301-4cff-bbe5-8da818657d5d-ovnkube-script-lib\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.168110 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167830 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct6zd\" (UniqueName: \"kubernetes.io/projected/fd46e9f9-82b1-4ed8-bf59-100aafafa0c4-kube-api-access-ct6zd\") pod \"iptables-alerter-knspg\" (UID: \"fd46e9f9-82b1-4ed8-bf59-100aafafa0c4\") " pod="openshift-network-operator/iptables-alerter-knspg" May 27 14:05:20.168110 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167863 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-host-run-k8s-cni-cncf-io\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.168110 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167886 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-host\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.168110 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167909 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-host-kubelet\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.168110 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167931 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.168110 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167955 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-etc-kubernetes\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.168110 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167976 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-etc-sysctl-d\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.168110 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.167997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-var-lib-kubelet\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.168110 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168021 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9fxt\" (UniqueName: \"kubernetes.io/projected/ae3f7910-95b9-4293-8c5e-ba15fdb6739e-kube-api-access-g9fxt\") pod \"aws-ebs-csi-driver-node-htvbr\" (UID: \"ae3f7910-95b9-4293-8c5e-ba15fdb6739e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" May 27 14:05:20.168110 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168043 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-host-var-lib-kubelet\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.168110 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168067 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-etc-sysconfig\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.168110 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168091 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-system-cni-dir\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.168680 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168116 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/425ee3b1-4732-4289-b393-23327664c19e-konnectivity-ca\") pod \"konnectivity-agent-tqc6p\" (UID: \"425ee3b1-4732-4289-b393-23327664c19e\") " pod="kube-system/konnectivity-agent-tqc6p" May 27 14:05:20.168680 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168148 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-etc-systemd\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.168680 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168189 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e951b51f-08ac-4c01-8734-ed44b0e24d1d-tmp\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.168680 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168225 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-host-run-netns\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.168680 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168254 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-run-systemd\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.168680 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-var-lib-openvswitch\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.168680 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/61335746-8301-4cff-bbe5-8da818657d5d-ovn-node-metrics-cert\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.168680 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168349 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fd46e9f9-82b1-4ed8-bf59-100aafafa0c4-iptables-alerter-script\") pod \"iptables-alerter-knspg\" (UID: \"fd46e9f9-82b1-4ed8-bf59-100aafafa0c4\") " pod="openshift-network-operator/iptables-alerter-knspg" May 27 14:05:20.168680 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168372 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-cni-binary-copy\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.168680 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168393 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e951b51f-08ac-4c01-8734-ed44b0e24d1d-etc-tuned\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.168680 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-cnibin\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.168680 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168435 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-host-var-lib-cni-bin\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.168680 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168458 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-multus-conf-dir\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.168680 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168482 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-host-run-ovn-kubernetes\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.168680 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168506 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0f1c91f4-dd6f-49db-9f83-6fcc448f06f3-serviceca\") pod \"node-ca-d6zwm\" (UID: \"0f1c91f4-dd6f-49db-9f83-6fcc448f06f3\") " pod="openshift-image-registry/node-ca-d6zwm" May 27 14:05:20.168680 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168545 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-os-release\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.168680 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168586 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-host-run-netns\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.169530 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168623 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/425ee3b1-4732-4289-b393-23327664c19e-agent-certs\") pod \"konnectivity-agent-tqc6p\" (UID: \"425ee3b1-4732-4289-b393-23327664c19e\") " pod="kube-system/konnectivity-agent-tqc6p" May 27 14:05:20.169530 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168648 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-host-slash\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.169530 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168672 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/61335746-8301-4cff-bbe5-8da818657d5d-env-overrides\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.169530 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168703 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ae3f7910-95b9-4293-8c5e-ba15fdb6739e-device-dir\") pod \"aws-ebs-csi-driver-node-htvbr\" (UID: \"ae3f7910-95b9-4293-8c5e-ba15fdb6739e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" May 27 14:05:20.169530 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168733 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbpb5\" (UniqueName: \"kubernetes.io/projected/0f1c91f4-dd6f-49db-9f83-6fcc448f06f3-kube-api-access-fbpb5\") pod \"node-ca-d6zwm\" (UID: \"0f1c91f4-dd6f-49db-9f83-6fcc448f06f3\") " pod="openshift-image-registry/node-ca-d6zwm" May 27 14:05:20.169530 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fd46e9f9-82b1-4ed8-bf59-100aafafa0c4-host-slash\") pod \"iptables-alerter-knspg\" (UID: \"fd46e9f9-82b1-4ed8-bf59-100aafafa0c4\") " pod="openshift-network-operator/iptables-alerter-knspg" May 27 14:05:20.169530 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168775 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-host-run-multus-certs\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.169530 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168790 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-etc-kubernetes\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.169530 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77kzh\" (UniqueName: \"kubernetes.io/projected/6a8d3b41-b8d0-4b23-9658-c239ee121858-kube-api-access-77kzh\") pod \"network-check-target-cr7vm\" (UID: \"6a8d3b41-b8d0-4b23-9658-c239ee121858\") " pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:20.169530 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168874 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-etc-sysctl-conf\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.169530 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168901 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-sys\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.169530 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168928 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-etc-openvswitch\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.169530 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168952 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-run-ovn\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.169530 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.168974 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-hostroot\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.169530 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.169007 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-multus-daemon-config\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.169530 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.169030 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-lib-modules\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.169530 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.169055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-systemd-units\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.170365 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.169080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-run-openvswitch\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.170365 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.169102 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-log-socket\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.170365 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.169125 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ae3f7910-95b9-4293-8c5e-ba15fdb6739e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-htvbr\" (UID: \"ae3f7910-95b9-4293-8c5e-ba15fdb6739e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" May 27 14:05:20.202822 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.202742 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 14:00:19 +0000 UTC" deadline="2028-03-08 15:32:46.811462182 +0000 UTC" May 27 14:05:20.202822 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.202774 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15625h27m26.608691207s" May 27 14:05:20.256132 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.256108 2576 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 27 14:05:20.261920 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.261866 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-132.ec2.internal" event={"ID":"131ccd4b35d759f500cc09a15f66941e","Type":"ContainerStarted","Data":"dc528a359e7acd3954f5a991c8d84b62837a016b689cc4689414505b2f03500f"} May 27 14:05:20.262990 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.262969 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" event={"ID":"44d960b13e96bad04d42dc8bf8ea9e6d","Type":"ContainerStarted","Data":"37daeafdbd113c8650f5c66d43dd1a9382b84e63208189e0aedb38739d85d23b"} May 27 14:05:20.269428 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.269404 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-host-var-lib-cni-multus\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.269515 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.269439 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7dce939e-5149-403d-a0b3-5b40c239a8c4-cnibin\") pod \"multus-additional-cni-plugins-qd9xc\" (UID: \"7dce939e-5149-403d-a0b3-5b40c239a8c4\") " pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.269515 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.269457 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7dce939e-5149-403d-a0b3-5b40c239a8c4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qd9xc\" (UID: \"7dce939e-5149-403d-a0b3-5b40c239a8c4\") " pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.269515 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.269502 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-host-cni-bin\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.269680 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.269522 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-host-var-lib-cni-multus\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.269680 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.269539 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ae3f7910-95b9-4293-8c5e-ba15fdb6739e-socket-dir\") pod \"aws-ebs-csi-driver-node-htvbr\" (UID: \"ae3f7910-95b9-4293-8c5e-ba15fdb6739e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" May 27 14:05:20.269680 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.269569 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ae3f7910-95b9-4293-8c5e-ba15fdb6739e-registration-dir\") pod \"aws-ebs-csi-driver-node-htvbr\" (UID: \"ae3f7910-95b9-4293-8c5e-ba15fdb6739e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" May 27 14:05:20.269680 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.269596 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2npws\" (UniqueName: \"kubernetes.io/projected/e951b51f-08ac-4c01-8734-ed44b0e24d1d-kube-api-access-2npws\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.269680 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.269594 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-host-cni-bin\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.269680 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.269658 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/61335746-8301-4cff-bbe5-8da818657d5d-ovnkube-script-lib\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.269950 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.269684 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ct6zd\" (UniqueName: \"kubernetes.io/projected/fd46e9f9-82b1-4ed8-bf59-100aafafa0c4-kube-api-access-ct6zd\") pod \"iptables-alerter-knspg\" (UID: \"fd46e9f9-82b1-4ed8-bf59-100aafafa0c4\") " pod="openshift-network-operator/iptables-alerter-knspg" May 27 14:05:20.269950 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.269688 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ae3f7910-95b9-4293-8c5e-ba15fdb6739e-registration-dir\") pod \"aws-ebs-csi-driver-node-htvbr\" (UID: \"ae3f7910-95b9-4293-8c5e-ba15fdb6739e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" May 27 14:05:20.269950 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.269764 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ae3f7910-95b9-4293-8c5e-ba15fdb6739e-socket-dir\") pod \"aws-ebs-csi-driver-node-htvbr\" (UID: \"ae3f7910-95b9-4293-8c5e-ba15fdb6739e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" May 27 14:05:20.269950 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.269768 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-host-run-k8s-cni-cncf-io\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.269950 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.269807 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-host-run-k8s-cni-cncf-io\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.269950 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.269824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7dce939e-5149-403d-a0b3-5b40c239a8c4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qd9xc\" (UID: \"7dce939e-5149-403d-a0b3-5b40c239a8c4\") " pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.269950 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.269876 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-host\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.269950 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.269901 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-host-kubelet\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.269950 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.269931 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.270292 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.269978 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.270292 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.269987 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-host\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.270292 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270008 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-etc-kubernetes\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.270292 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270026 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-host-kubelet\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.270292 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270061 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-etc-kubernetes\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.270292 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270062 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-etc-sysctl-d\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.270292 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270101 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-var-lib-kubelet\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.270292 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270127 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g9fxt\" (UniqueName: \"kubernetes.io/projected/ae3f7910-95b9-4293-8c5e-ba15fdb6739e-kube-api-access-g9fxt\") pod \"aws-ebs-csi-driver-node-htvbr\" (UID: \"ae3f7910-95b9-4293-8c5e-ba15fdb6739e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" May 27 14:05:20.270292 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270155 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-host-var-lib-kubelet\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.270292 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270180 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-etc-sysconfig\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.270292 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270189 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-etc-sysctl-d\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.270292 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270217 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-host-var-lib-kubelet\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.270292 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270220 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-system-cni-dir\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.270292 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270243 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-etc-sysconfig\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.270292 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270266 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-system-cni-dir\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.270292 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270283 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/425ee3b1-4732-4289-b393-23327664c19e-konnectivity-ca\") pod \"konnectivity-agent-tqc6p\" (UID: \"425ee3b1-4732-4289-b393-23327664c19e\") " pod="kube-system/konnectivity-agent-tqc6p" May 27 14:05:20.271002 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7dce939e-5149-403d-a0b3-5b40c239a8c4-os-release\") pod \"multus-additional-cni-plugins-qd9xc\" (UID: \"7dce939e-5149-403d-a0b3-5b40c239a8c4\") " pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.271002 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270361 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-etc-systemd\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.271002 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270390 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e951b51f-08ac-4c01-8734-ed44b0e24d1d-tmp\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.271002 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270414 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-host-run-netns\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.271002 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270439 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-run-systemd\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.271002 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270447 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-etc-systemd\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.271002 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270464 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-var-lib-openvswitch\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.271002 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270497 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/61335746-8301-4cff-bbe5-8da818657d5d-ovn-node-metrics-cert\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.271002 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270501 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-host-run-netns\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.271002 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270532 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-var-lib-openvswitch\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.271002 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270542 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-run-systemd\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.271002 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270534 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fd46e9f9-82b1-4ed8-bf59-100aafafa0c4-iptables-alerter-script\") pod \"iptables-alerter-knspg\" (UID: \"fd46e9f9-82b1-4ed8-bf59-100aafafa0c4\") " pod="openshift-network-operator/iptables-alerter-knspg" May 27 14:05:20.271002 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270607 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-cni-binary-copy\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.271002 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270643 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e951b51f-08ac-4c01-8734-ed44b0e24d1d-etc-tuned\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.271002 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270709 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-cnibin\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.271002 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270715 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/61335746-8301-4cff-bbe5-8da818657d5d-ovnkube-script-lib\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.271002 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270735 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-host-var-lib-cni-bin\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.271002 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270791 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-multus-conf-dir\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.271852 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270833 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-multus-conf-dir\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.271852 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270853 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/425ee3b1-4732-4289-b393-23327664c19e-konnectivity-ca\") pod \"konnectivity-agent-tqc6p\" (UID: \"425ee3b1-4732-4289-b393-23327664c19e\") " pod="kube-system/konnectivity-agent-tqc6p" May 27 14:05:20.271852 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270858 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 27 14:05:20.271852 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270900 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-host-run-ovn-kubernetes\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.271852 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270911 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-host-var-lib-cni-bin\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.271852 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270929 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0f1c91f4-dd6f-49db-9f83-6fcc448f06f3-serviceca\") pod \"node-ca-d6zwm\" (UID: \"0f1c91f4-dd6f-49db-9f83-6fcc448f06f3\") " pod="openshift-image-registry/node-ca-d6zwm" May 27 14:05:20.271852 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270850 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-cnibin\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.271852 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270956 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-host-run-ovn-kubernetes\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.271852 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270452 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-var-lib-kubelet\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.271852 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.270985 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-os-release\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.271852 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271001 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-host-run-netns\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.271852 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271028 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/425ee3b1-4732-4289-b393-23327664c19e-agent-certs\") pod \"konnectivity-agent-tqc6p\" (UID: \"425ee3b1-4732-4289-b393-23327664c19e\") " pod="kube-system/konnectivity-agent-tqc6p" May 27 14:05:20.271852 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271034 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fd46e9f9-82b1-4ed8-bf59-100aafafa0c4-iptables-alerter-script\") pod \"iptables-alerter-knspg\" (UID: \"fd46e9f9-82b1-4ed8-bf59-100aafafa0c4\") " pod="openshift-network-operator/iptables-alerter-knspg" May 27 14:05:20.271852 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271057 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kw95\" (UniqueName: \"kubernetes.io/projected/7dce939e-5149-403d-a0b3-5b40c239a8c4-kube-api-access-7kw95\") pod \"multus-additional-cni-plugins-qd9xc\" (UID: \"7dce939e-5149-403d-a0b3-5b40c239a8c4\") " pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.271852 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271078 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-host-run-netns\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.271852 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271078 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-os-release\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.271852 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271204 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-host-slash\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.271852 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271261 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/61335746-8301-4cff-bbe5-8da818657d5d-env-overrides\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.272687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271296 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ae3f7910-95b9-4293-8c5e-ba15fdb6739e-device-dir\") pod \"aws-ebs-csi-driver-node-htvbr\" (UID: \"ae3f7910-95b9-4293-8c5e-ba15fdb6739e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" May 27 14:05:20.272687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271368 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fbpb5\" (UniqueName: \"kubernetes.io/projected/0f1c91f4-dd6f-49db-9f83-6fcc448f06f3-kube-api-access-fbpb5\") pod \"node-ca-d6zwm\" (UID: \"0f1c91f4-dd6f-49db-9f83-6fcc448f06f3\") " pod="openshift-image-registry/node-ca-d6zwm" May 27 14:05:20.272687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271402 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fd46e9f9-82b1-4ed8-bf59-100aafafa0c4-host-slash\") pod \"iptables-alerter-knspg\" (UID: \"fd46e9f9-82b1-4ed8-bf59-100aafafa0c4\") " pod="openshift-network-operator/iptables-alerter-knspg" May 27 14:05:20.272687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271447 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0f1c91f4-dd6f-49db-9f83-6fcc448f06f3-serviceca\") pod \"node-ca-d6zwm\" (UID: \"0f1c91f4-dd6f-49db-9f83-6fcc448f06f3\") " pod="openshift-image-registry/node-ca-d6zwm" May 27 14:05:20.272687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271467 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-host-run-multus-certs\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.272687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271524 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ae3f7910-95b9-4293-8c5e-ba15fdb6739e-device-dir\") pod \"aws-ebs-csi-driver-node-htvbr\" (UID: \"ae3f7910-95b9-4293-8c5e-ba15fdb6739e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" May 27 14:05:20.272687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271553 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-host-slash\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.272687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271579 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-etc-kubernetes\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.272687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271601 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-77kzh\" (UniqueName: \"kubernetes.io/projected/6a8d3b41-b8d0-4b23-9658-c239ee121858-kube-api-access-77kzh\") pod \"network-check-target-cr7vm\" (UID: \"6a8d3b41-b8d0-4b23-9658-c239ee121858\") " pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:20.272687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271640 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-etc-kubernetes\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.272687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271652 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fd46e9f9-82b1-4ed8-bf59-100aafafa0c4-host-slash\") pod \"iptables-alerter-knspg\" (UID: \"fd46e9f9-82b1-4ed8-bf59-100aafafa0c4\") " pod="openshift-network-operator/iptables-alerter-knspg" May 27 14:05:20.272687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271667 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-host-run-multus-certs\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.272687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271695 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7dce939e-5149-403d-a0b3-5b40c239a8c4-system-cni-dir\") pod \"multus-additional-cni-plugins-qd9xc\" (UID: \"7dce939e-5149-403d-a0b3-5b40c239a8c4\") " pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.272687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271809 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-etc-sysctl-conf\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.272687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271833 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-sys\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.272687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271877 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-sys\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.272687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271879 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-etc-openvswitch\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.272687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271911 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-run-ovn\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.273532 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.271980 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-etc-sysctl-conf\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.273532 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272021 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-hostroot\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.273532 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272045 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-multus-daemon-config\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.273532 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272070 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-lib-modules\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.273532 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272094 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-systemd-units\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.273532 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272155 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-run-openvswitch\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.273532 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272180 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-log-socket\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.273532 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272224 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ae3f7910-95b9-4293-8c5e-ba15fdb6739e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-htvbr\" (UID: \"ae3f7910-95b9-4293-8c5e-ba15fdb6739e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" May 27 14:05:20.273532 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272251 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ae3f7910-95b9-4293-8c5e-ba15fdb6739e-etc-selinux\") pod \"aws-ebs-csi-driver-node-htvbr\" (UID: \"ae3f7910-95b9-4293-8c5e-ba15fdb6739e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" May 27 14:05:20.273532 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272275 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f1c91f4-dd6f-49db-9f83-6fcc448f06f3-host\") pod \"node-ca-d6zwm\" (UID: \"0f1c91f4-dd6f-49db-9f83-6fcc448f06f3\") " pod="openshift-image-registry/node-ca-d6zwm" May 27 14:05:20.273532 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272299 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-multus-socket-dir-parent\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.273532 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272349 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/61335746-8301-4cff-bbe5-8da818657d5d-ovnkube-config\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.273532 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272377 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q8rqd\" (UniqueName: \"kubernetes.io/projected/61335746-8301-4cff-bbe5-8da818657d5d-kube-api-access-q8rqd\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.273532 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272420 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/61335746-8301-4cff-bbe5-8da818657d5d-env-overrides\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.273532 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272455 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6hlj\" (UniqueName: \"kubernetes.io/projected/f1a2947c-37ec-4483-b026-f7d0e5a6365d-kube-api-access-t6hlj\") pod \"network-metrics-daemon-58m9b\" (UID: \"f1a2947c-37ec-4483-b026-f7d0e5a6365d\") " pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:20.273532 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272483 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-etc-modprobe-d\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.273532 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272505 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ae3f7910-95b9-4293-8c5e-ba15fdb6739e-etc-selinux\") pod \"aws-ebs-csi-driver-node-htvbr\" (UID: \"ae3f7910-95b9-4293-8c5e-ba15fdb6739e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" May 27 14:05:20.274265 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272511 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-run\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.274265 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272527 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-multus-socket-dir-parent\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.274265 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272550 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-run-ovn\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.274265 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272552 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-cni-binary-copy\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.274265 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272561 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-run\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.274265 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272602 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f1c91f4-dd6f-49db-9f83-6fcc448f06f3-host\") pod \"node-ca-d6zwm\" (UID: \"0f1c91f4-dd6f-49db-9f83-6fcc448f06f3\") " pod="openshift-image-registry/node-ca-d6zwm" May 27 14:05:20.274265 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272602 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-etc-openvswitch\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.274265 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272624 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-systemd-units\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.274265 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272643 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-lib-modules\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.274265 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272687 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-hostroot\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.274265 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272703 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-run-openvswitch\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.274265 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272821 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e951b51f-08ac-4c01-8734-ed44b0e24d1d-etc-modprobe-d\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.274265 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.272866 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-multus-daemon-config\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.274265 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.273487 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/61335746-8301-4cff-bbe5-8da818657d5d-ovnkube-config\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.274265 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.273606 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ae3f7910-95b9-4293-8c5e-ba15fdb6739e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-htvbr\" (UID: \"ae3f7910-95b9-4293-8c5e-ba15fdb6739e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" May 27 14:05:20.274265 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.273689 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-host-cni-netd\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.274265 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.273728 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ae3f7910-95b9-4293-8c5e-ba15fdb6739e-sys-fs\") pod \"aws-ebs-csi-driver-node-htvbr\" (UID: \"ae3f7910-95b9-4293-8c5e-ba15fdb6739e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" May 27 14:05:20.274265 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.273756 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-multus-cni-dir\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.275073 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.273790 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g6b5q\" (UniqueName: \"kubernetes.io/projected/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-kube-api-access-g6b5q\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.275073 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.273825 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7dce939e-5149-403d-a0b3-5b40c239a8c4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qd9xc\" (UID: \"7dce939e-5149-403d-a0b3-5b40c239a8c4\") " pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.275073 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.273859 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-node-log\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.275073 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.273894 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7dce939e-5149-403d-a0b3-5b40c239a8c4-cni-binary-copy\") pod \"multus-additional-cni-plugins-qd9xc\" (UID: \"7dce939e-5149-403d-a0b3-5b40c239a8c4\") " pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.275073 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.273917 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1a2947c-37ec-4483-b026-f7d0e5a6365d-metrics-certs\") pod \"network-metrics-daemon-58m9b\" (UID: \"f1a2947c-37ec-4483-b026-f7d0e5a6365d\") " pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:20.275073 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.273998 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-multus-cni-dir\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.275073 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.274057 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-log-socket\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.275073 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.274114 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-host-cni-netd\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.275073 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.274180 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/61335746-8301-4cff-bbe5-8da818657d5d-node-log\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.275073 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.274268 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ae3f7910-95b9-4293-8c5e-ba15fdb6739e-sys-fs\") pod \"aws-ebs-csi-driver-node-htvbr\" (UID: \"ae3f7910-95b9-4293-8c5e-ba15fdb6739e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" May 27 14:05:20.275073 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.274666 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e951b51f-08ac-4c01-8734-ed44b0e24d1d-tmp\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.275073 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.274718 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e951b51f-08ac-4c01-8734-ed44b0e24d1d-etc-tuned\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.278212 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.278188 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/425ee3b1-4732-4289-b393-23327664c19e-agent-certs\") pod \"konnectivity-agent-tqc6p\" (UID: \"425ee3b1-4732-4289-b393-23327664c19e\") " pod="kube-system/konnectivity-agent-tqc6p" May 27 14:05:20.279646 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.279622 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2npws\" (UniqueName: \"kubernetes.io/projected/e951b51f-08ac-4c01-8734-ed44b0e24d1d-kube-api-access-2npws\") pod \"tuned-fpg92\" (UID: \"e951b51f-08ac-4c01-8734-ed44b0e24d1d\") " pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.279841 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:20.279808 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 14:05:20.279841 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:20.279835 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 14:05:20.279968 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:20.279849 2576 projected.go:194] Error preparing data for projected volume kube-api-access-77kzh for pod openshift-network-diagnostics/network-check-target-cr7vm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:20.279968 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:20.279921 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a8d3b41-b8d0-4b23-9658-c239ee121858-kube-api-access-77kzh podName:6a8d3b41-b8d0-4b23-9658-c239ee121858 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:20.779890835 +0000 UTC m=+3.132715952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-77kzh" (UniqueName: "kubernetes.io/projected/6a8d3b41-b8d0-4b23-9658-c239ee121858-kube-api-access-77kzh") pod "network-check-target-cr7vm" (UID: "6a8d3b41-b8d0-4b23-9658-c239ee121858") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:20.280837 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.280814 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9fxt\" (UniqueName: \"kubernetes.io/projected/ae3f7910-95b9-4293-8c5e-ba15fdb6739e-kube-api-access-g9fxt\") pod \"aws-ebs-csi-driver-node-htvbr\" (UID: \"ae3f7910-95b9-4293-8c5e-ba15fdb6739e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" May 27 14:05:20.281155 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.281126 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct6zd\" (UniqueName: \"kubernetes.io/projected/fd46e9f9-82b1-4ed8-bf59-100aafafa0c4-kube-api-access-ct6zd\") pod \"iptables-alerter-knspg\" (UID: \"fd46e9f9-82b1-4ed8-bf59-100aafafa0c4\") " pod="openshift-network-operator/iptables-alerter-knspg" May 27 14:05:20.281378 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.281358 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/61335746-8301-4cff-bbe5-8da818657d5d-ovn-node-metrics-cert\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.282313 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.282286 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8rqd\" (UniqueName: \"kubernetes.io/projected/61335746-8301-4cff-bbe5-8da818657d5d-kube-api-access-q8rqd\") pod \"ovnkube-node-wd4m8\" (UID: \"61335746-8301-4cff-bbe5-8da818657d5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.282797 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.282776 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbpb5\" (UniqueName: \"kubernetes.io/projected/0f1c91f4-dd6f-49db-9f83-6fcc448f06f3-kube-api-access-fbpb5\") pod \"node-ca-d6zwm\" (UID: \"0f1c91f4-dd6f-49db-9f83-6fcc448f06f3\") " pod="openshift-image-registry/node-ca-d6zwm" May 27 14:05:20.282874 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.282843 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6b5q\" (UniqueName: \"kubernetes.io/projected/6bb48ff2-6eb2-427e-85d8-8e127bf280e1-kube-api-access-g6b5q\") pod \"multus-rkmqt\" (UID: \"6bb48ff2-6eb2-427e-85d8-8e127bf280e1\") " pod="openshift-multus/multus-rkmqt" May 27 14:05:20.375157 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.375128 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7dce939e-5149-403d-a0b3-5b40c239a8c4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qd9xc\" (UID: \"7dce939e-5149-403d-a0b3-5b40c239a8c4\") " pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.375157 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.375167 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7dce939e-5149-403d-a0b3-5b40c239a8c4-cni-binary-copy\") pod \"multus-additional-cni-plugins-qd9xc\" (UID: \"7dce939e-5149-403d-a0b3-5b40c239a8c4\") " pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.375413 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.375193 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1a2947c-37ec-4483-b026-f7d0e5a6365d-metrics-certs\") pod \"network-metrics-daemon-58m9b\" (UID: \"f1a2947c-37ec-4483-b026-f7d0e5a6365d\") " pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:20.375413 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.375219 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7dce939e-5149-403d-a0b3-5b40c239a8c4-cnibin\") pod \"multus-additional-cni-plugins-qd9xc\" (UID: \"7dce939e-5149-403d-a0b3-5b40c239a8c4\") " pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.375413 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.375240 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7dce939e-5149-403d-a0b3-5b40c239a8c4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qd9xc\" (UID: \"7dce939e-5149-403d-a0b3-5b40c239a8c4\") " pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.375413 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.375267 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7dce939e-5149-403d-a0b3-5b40c239a8c4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qd9xc\" (UID: \"7dce939e-5149-403d-a0b3-5b40c239a8c4\") " pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.375413 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.375300 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7dce939e-5149-403d-a0b3-5b40c239a8c4-os-release\") pod \"multus-additional-cni-plugins-qd9xc\" (UID: \"7dce939e-5149-403d-a0b3-5b40c239a8c4\") " pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.375413 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.375341 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7dce939e-5149-403d-a0b3-5b40c239a8c4-cnibin\") pod \"multus-additional-cni-plugins-qd9xc\" (UID: \"7dce939e-5149-403d-a0b3-5b40c239a8c4\") " pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.375413 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.375353 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7kw95\" (UniqueName: \"kubernetes.io/projected/7dce939e-5149-403d-a0b3-5b40c239a8c4-kube-api-access-7kw95\") pod \"multus-additional-cni-plugins-qd9xc\" (UID: \"7dce939e-5149-403d-a0b3-5b40c239a8c4\") " pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.375413 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:20.375402 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:20.375744 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.375427 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7dce939e-5149-403d-a0b3-5b40c239a8c4-system-cni-dir\") pod \"multus-additional-cni-plugins-qd9xc\" (UID: \"7dce939e-5149-403d-a0b3-5b40c239a8c4\") " pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.375744 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.375455 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t6hlj\" (UniqueName: \"kubernetes.io/projected/f1a2947c-37ec-4483-b026-f7d0e5a6365d-kube-api-access-t6hlj\") pod \"network-metrics-daemon-58m9b\" (UID: \"f1a2947c-37ec-4483-b026-f7d0e5a6365d\") " pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:20.375744 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:20.375472 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1a2947c-37ec-4483-b026-f7d0e5a6365d-metrics-certs podName:f1a2947c-37ec-4483-b026-f7d0e5a6365d nodeName:}" failed. No retries permitted until 2026-05-27 14:05:20.875452843 +0000 UTC m=+3.228277974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1a2947c-37ec-4483-b026-f7d0e5a6365d-metrics-certs") pod "network-metrics-daemon-58m9b" (UID: "f1a2947c-37ec-4483-b026-f7d0e5a6365d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:20.375744 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.375466 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7dce939e-5149-403d-a0b3-5b40c239a8c4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qd9xc\" (UID: \"7dce939e-5149-403d-a0b3-5b40c239a8c4\") " pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.375744 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.375576 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7dce939e-5149-403d-a0b3-5b40c239a8c4-system-cni-dir\") pod \"multus-additional-cni-plugins-qd9xc\" (UID: \"7dce939e-5149-403d-a0b3-5b40c239a8c4\") " pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.375744 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.375641 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7dce939e-5149-403d-a0b3-5b40c239a8c4-os-release\") pod \"multus-additional-cni-plugins-qd9xc\" (UID: \"7dce939e-5149-403d-a0b3-5b40c239a8c4\") " pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.375926 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.375753 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7dce939e-5149-403d-a0b3-5b40c239a8c4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qd9xc\" (UID: \"7dce939e-5149-403d-a0b3-5b40c239a8c4\") " pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.375926 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.375778 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7dce939e-5149-403d-a0b3-5b40c239a8c4-cni-binary-copy\") pod \"multus-additional-cni-plugins-qd9xc\" (UID: \"7dce939e-5149-403d-a0b3-5b40c239a8c4\") " pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.376047 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.375952 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7dce939e-5149-403d-a0b3-5b40c239a8c4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qd9xc\" (UID: \"7dce939e-5149-403d-a0b3-5b40c239a8c4\") " pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.386989 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.386936 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kw95\" (UniqueName: \"kubernetes.io/projected/7dce939e-5149-403d-a0b3-5b40c239a8c4-kube-api-access-7kw95\") pod \"multus-additional-cni-plugins-qd9xc\" (UID: \"7dce939e-5149-403d-a0b3-5b40c239a8c4\") " pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.386989 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.386938 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6hlj\" (UniqueName: \"kubernetes.io/projected/f1a2947c-37ec-4483-b026-f7d0e5a6365d-kube-api-access-t6hlj\") pod \"network-metrics-daemon-58m9b\" (UID: \"f1a2947c-37ec-4483-b026-f7d0e5a6365d\") " pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:20.455911 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.455876 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-knspg" May 27 14:05:20.464797 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.464708 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fpg92" May 27 14:05:20.479398 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.479375 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rkmqt" May 27 14:05:20.483993 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.483976 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:20.489625 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.489604 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tqc6p" May 27 14:05:20.497235 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.497212 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" May 27 14:05:20.503802 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.503782 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d6zwm" May 27 14:05:20.509420 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.509399 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qd9xc" May 27 14:05:20.539924 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.539903 2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 14:05:20.878290 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.878220 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-77kzh\" (UniqueName: \"kubernetes.io/projected/6a8d3b41-b8d0-4b23-9658-c239ee121858-kube-api-access-77kzh\") pod \"network-check-target-cr7vm\" (UID: \"6a8d3b41-b8d0-4b23-9658-c239ee121858\") " pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:20.878290 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:20.878261 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1a2947c-37ec-4483-b026-f7d0e5a6365d-metrics-certs\") pod \"network-metrics-daemon-58m9b\" (UID: \"f1a2947c-37ec-4483-b026-f7d0e5a6365d\") " pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:20.878525 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:20.878370 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:20.878525 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:20.878416 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1a2947c-37ec-4483-b026-f7d0e5a6365d-metrics-certs podName:f1a2947c-37ec-4483-b026-f7d0e5a6365d nodeName:}" failed. No retries permitted until 2026-05-27 14:05:21.878403985 +0000 UTC m=+4.231229098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1a2947c-37ec-4483-b026-f7d0e5a6365d-metrics-certs") pod "network-metrics-daemon-58m9b" (UID: "f1a2947c-37ec-4483-b026-f7d0e5a6365d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:20.878525 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:20.878435 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 14:05:20.878525 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:20.878462 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 14:05:20.878525 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:20.878474 2576 projected.go:194] Error preparing data for projected volume kube-api-access-77kzh for pod openshift-network-diagnostics/network-check-target-cr7vm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:20.878689 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:20.878533 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a8d3b41-b8d0-4b23-9658-c239ee121858-kube-api-access-77kzh podName:6a8d3b41-b8d0-4b23-9658-c239ee121858 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:21.87851734 +0000 UTC m=+4.231342476 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-77kzh" (UniqueName: "kubernetes.io/projected/6a8d3b41-b8d0-4b23-9658-c239ee121858-kube-api-access-77kzh") pod "network-check-target-cr7vm" (UID: "6a8d3b41-b8d0-4b23-9658-c239ee121858") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:20.922182 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:20.922078 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod425ee3b1_4732_4289_b393_23327664c19e.slice/crio-986b6fea725adc03cacadf7ccc45e6f24bd2437c2a30f97ea7c63ada50d39ab6 WatchSource:0}: Error finding container 986b6fea725adc03cacadf7ccc45e6f24bd2437c2a30f97ea7c63ada50d39ab6: Status 404 returned error can't find the container with id 986b6fea725adc03cacadf7ccc45e6f24bd2437c2a30f97ea7c63ada50d39ab6 May 27 14:05:20.923429 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:20.923402 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f1c91f4_dd6f_49db_9f83_6fcc448f06f3.slice/crio-93c3067b7c770d262d7f1982ec2a370b68e0f27a4601eea85a2cb84a98675a65 WatchSource:0}: Error finding container 93c3067b7c770d262d7f1982ec2a370b68e0f27a4601eea85a2cb84a98675a65: Status 404 returned error can't find the container with id 93c3067b7c770d262d7f1982ec2a370b68e0f27a4601eea85a2cb84a98675a65 May 27 14:05:20.924312 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:20.924288 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb48ff2_6eb2_427e_85d8_8e127bf280e1.slice/crio-447fa07f4233dfc72a221364aa2f0b7e0bd7f0f06de62bd2ee69e28767c77870 WatchSource:0}: Error finding container 447fa07f4233dfc72a221364aa2f0b7e0bd7f0f06de62bd2ee69e28767c77870: Status 404 returned error can't find the container with id 447fa07f4233dfc72a221364aa2f0b7e0bd7f0f06de62bd2ee69e28767c77870 May 27 14:05:20.926953 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:20.926846 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61335746_8301_4cff_bbe5_8da818657d5d.slice/crio-67a819dd9ff5e69bdaaa56f6dcb0b1d64d2d98b59addc9c4d2477b2a58ddca2a WatchSource:0}: Error finding container 67a819dd9ff5e69bdaaa56f6dcb0b1d64d2d98b59addc9c4d2477b2a58ddca2a: Status 404 returned error can't find the container with id 67a819dd9ff5e69bdaaa56f6dcb0b1d64d2d98b59addc9c4d2477b2a58ddca2a May 27 14:05:20.928048 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:20.928020 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd46e9f9_82b1_4ed8_bf59_100aafafa0c4.slice/crio-7081d15ef712705b5379e8b74c157a0431efacf301181454d16902a5a462b2aa WatchSource:0}: Error finding container 7081d15ef712705b5379e8b74c157a0431efacf301181454d16902a5a462b2aa: Status 404 returned error can't find the container with id 7081d15ef712705b5379e8b74c157a0431efacf301181454d16902a5a462b2aa May 27 14:05:20.929359 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:20.929336 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dce939e_5149_403d_a0b3_5b40c239a8c4.slice/crio-ddb56f48fe0a5f52745eacc788097bc647541aadb55ddaf1ae57aeee35f75082 WatchSource:0}: Error finding container ddb56f48fe0a5f52745eacc788097bc647541aadb55ddaf1ae57aeee35f75082: Status 404 returned error can't find the container with id ddb56f48fe0a5f52745eacc788097bc647541aadb55ddaf1ae57aeee35f75082 May 27 14:05:20.930405 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:20.930279 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode951b51f_08ac_4c01_8734_ed44b0e24d1d.slice/crio-c7e5071e7702c4401076f18620cdc85e29822e150861fbce9235a0e74ef70f5a WatchSource:0}: Error finding container c7e5071e7702c4401076f18620cdc85e29822e150861fbce9235a0e74ef70f5a: Status 404 returned error can't find the container with id c7e5071e7702c4401076f18620cdc85e29822e150861fbce9235a0e74ef70f5a May 27 14:05:20.931877 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:20.931857 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae3f7910_95b9_4293_8c5e_ba15fdb6739e.slice/crio-8c3f92e2e21903aa54e616f92d5565339334f793ce5ffa609672a9a82d4ded04 WatchSource:0}: Error finding container 8c3f92e2e21903aa54e616f92d5565339334f793ce5ffa609672a9a82d4ded04: Status 404 returned error can't find the container with id 8c3f92e2e21903aa54e616f92d5565339334f793ce5ffa609672a9a82d4ded04 May 27 14:05:21.203064 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:21.202891 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 14:00:19 +0000 UTC" deadline="2028-03-02 02:23:08.73364316 +0000 UTC" May 27 14:05:21.203064 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:21.203061 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15468h17m47.530585431s" May 27 14:05:21.265273 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:21.265246 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-knspg" event={"ID":"fd46e9f9-82b1-4ed8-bf59-100aafafa0c4","Type":"ContainerStarted","Data":"7081d15ef712705b5379e8b74c157a0431efacf301181454d16902a5a462b2aa"} May 27 14:05:21.266283 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:21.266248 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" event={"ID":"ae3f7910-95b9-4293-8c5e-ba15fdb6739e","Type":"ContainerStarted","Data":"8c3f92e2e21903aa54e616f92d5565339334f793ce5ffa609672a9a82d4ded04"} May 27 14:05:21.267295 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:21.267270 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fpg92" event={"ID":"e951b51f-08ac-4c01-8734-ed44b0e24d1d","Type":"ContainerStarted","Data":"c7e5071e7702c4401076f18620cdc85e29822e150861fbce9235a0e74ef70f5a"} May 27 14:05:21.268574 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:21.268550 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rkmqt" event={"ID":"6bb48ff2-6eb2-427e-85d8-8e127bf280e1","Type":"ContainerStarted","Data":"447fa07f4233dfc72a221364aa2f0b7e0bd7f0f06de62bd2ee69e28767c77870"} May 27 14:05:21.270205 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:21.270180 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d6zwm" event={"ID":"0f1c91f4-dd6f-49db-9f83-6fcc448f06f3","Type":"ContainerStarted","Data":"93c3067b7c770d262d7f1982ec2a370b68e0f27a4601eea85a2cb84a98675a65"} May 27 14:05:21.271422 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:21.271399 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qd9xc" event={"ID":"7dce939e-5149-403d-a0b3-5b40c239a8c4","Type":"ContainerStarted","Data":"ddb56f48fe0a5f52745eacc788097bc647541aadb55ddaf1ae57aeee35f75082"} May 27 14:05:21.274381 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:21.274347 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" event={"ID":"61335746-8301-4cff-bbe5-8da818657d5d","Type":"ContainerStarted","Data":"67a819dd9ff5e69bdaaa56f6dcb0b1d64d2d98b59addc9c4d2477b2a58ddca2a"} May 27 14:05:21.276745 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:21.276718 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tqc6p" event={"ID":"425ee3b1-4732-4289-b393-23327664c19e","Type":"ContainerStarted","Data":"986b6fea725adc03cacadf7ccc45e6f24bd2437c2a30f97ea7c63ada50d39ab6"} May 27 14:05:21.278708 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:21.278681 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-132.ec2.internal" event={"ID":"131ccd4b35d759f500cc09a15f66941e","Type":"ContainerStarted","Data":"4e6b89869e07fda5c4c477058390671c25eed55a97b29b56234909ca73b32a5a"} May 27 14:05:21.281007 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:21.280981 2576 generic.go:358] "Generic (PLEG): container finished" podID="44d960b13e96bad04d42dc8bf8ea9e6d" containerID="52dc3c829095d025f744abeb4d60702757a3a52f4c8ae3121b4d55d6c3db91ea" exitCode=0 May 27 14:05:21.281092 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:21.281016 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" event={"ID":"44d960b13e96bad04d42dc8bf8ea9e6d","Type":"ContainerDied","Data":"52dc3c829095d025f744abeb4d60702757a3a52f4c8ae3121b4d55d6c3db91ea"} May 27 14:05:21.296693 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:21.296358 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-132.ec2.internal" podStartSLOduration=2.296341342 podStartE2EDuration="2.296341342s" podCreationTimestamp="2026-05-27 14:05:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 14:05:21.294565573 +0000 UTC m=+3.647390710" watchObservedRunningTime="2026-05-27 14:05:21.296341342 +0000 UTC m=+3.649166475" May 27 14:05:21.886807 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:21.886692 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-77kzh\" (UniqueName: \"kubernetes.io/projected/6a8d3b41-b8d0-4b23-9658-c239ee121858-kube-api-access-77kzh\") pod \"network-check-target-cr7vm\" (UID: \"6a8d3b41-b8d0-4b23-9658-c239ee121858\") " pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:21.886807 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:21.886759 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1a2947c-37ec-4483-b026-f7d0e5a6365d-metrics-certs\") pod \"network-metrics-daemon-58m9b\" (UID: \"f1a2947c-37ec-4483-b026-f7d0e5a6365d\") " pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:21.887007 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:21.886874 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:21.887007 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:21.886936 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1a2947c-37ec-4483-b026-f7d0e5a6365d-metrics-certs podName:f1a2947c-37ec-4483-b026-f7d0e5a6365d nodeName:}" failed. No retries permitted until 2026-05-27 14:05:23.886917007 +0000 UTC m=+6.239742126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1a2947c-37ec-4483-b026-f7d0e5a6365d-metrics-certs") pod "network-metrics-daemon-58m9b" (UID: "f1a2947c-37ec-4483-b026-f7d0e5a6365d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:21.887431 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:21.887266 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 14:05:21.887431 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:21.887297 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 14:05:21.887431 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:21.887310 2576 projected.go:194] Error preparing data for projected volume kube-api-access-77kzh for pod openshift-network-diagnostics/network-check-target-cr7vm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:21.887431 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:21.887387 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a8d3b41-b8d0-4b23-9658-c239ee121858-kube-api-access-77kzh podName:6a8d3b41-b8d0-4b23-9658-c239ee121858 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:23.887368924 +0000 UTC m=+6.240194062 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-77kzh" (UniqueName: "kubernetes.io/projected/6a8d3b41-b8d0-4b23-9658-c239ee121858-kube-api-access-77kzh") pod "network-check-target-cr7vm" (UID: "6a8d3b41-b8d0-4b23-9658-c239ee121858") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:22.259594 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:22.259463 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:22.259594 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:22.259485 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:22.260145 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:22.259591 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cr7vm" podUID="6a8d3b41-b8d0-4b23-9658-c239ee121858" May 27 14:05:22.260145 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:22.259713 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58m9b" podUID="f1a2947c-37ec-4483-b026-f7d0e5a6365d" May 27 14:05:22.301975 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:22.301932 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" event={"ID":"44d960b13e96bad04d42dc8bf8ea9e6d","Type":"ContainerStarted","Data":"7bb7196a76d01180f51ab185c508bd0fddc72544b420808a14e67957b9b013aa"} May 27 14:05:23.904650 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:23.904319 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1a2947c-37ec-4483-b026-f7d0e5a6365d-metrics-certs\") pod \"network-metrics-daemon-58m9b\" (UID: \"f1a2947c-37ec-4483-b026-f7d0e5a6365d\") " pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:23.904650 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:23.904419 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-77kzh\" (UniqueName: \"kubernetes.io/projected/6a8d3b41-b8d0-4b23-9658-c239ee121858-kube-api-access-77kzh\") pod \"network-check-target-cr7vm\" (UID: \"6a8d3b41-b8d0-4b23-9658-c239ee121858\") " pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:23.904650 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:23.904476 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:23.904650 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:23.904546 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 14:05:23.904650 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:23.904558 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1a2947c-37ec-4483-b026-f7d0e5a6365d-metrics-certs podName:f1a2947c-37ec-4483-b026-f7d0e5a6365d nodeName:}" failed. No retries permitted until 2026-05-27 14:05:27.904536343 +0000 UTC m=+10.257361464 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1a2947c-37ec-4483-b026-f7d0e5a6365d-metrics-certs") pod "network-metrics-daemon-58m9b" (UID: "f1a2947c-37ec-4483-b026-f7d0e5a6365d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:23.904650 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:23.904564 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 14:05:23.904650 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:23.904577 2576 projected.go:194] Error preparing data for projected volume kube-api-access-77kzh for pod openshift-network-diagnostics/network-check-target-cr7vm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:23.904650 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:23.904626 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a8d3b41-b8d0-4b23-9658-c239ee121858-kube-api-access-77kzh podName:6a8d3b41-b8d0-4b23-9658-c239ee121858 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:27.904610538 +0000 UTC m=+10.257435669 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-77kzh" (UniqueName: "kubernetes.io/projected/6a8d3b41-b8d0-4b23-9658-c239ee121858-kube-api-access-77kzh") pod "network-check-target-cr7vm" (UID: "6a8d3b41-b8d0-4b23-9658-c239ee121858") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:24.258645 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:24.258557 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:24.258803 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:24.258684 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cr7vm" podUID="6a8d3b41-b8d0-4b23-9658-c239ee121858" May 27 14:05:24.259158 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:24.258972 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:24.259158 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:24.259091 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58m9b" podUID="f1a2947c-37ec-4483-b026-f7d0e5a6365d" May 27 14:05:26.259445 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:26.259403 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:26.259445 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:26.259445 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:26.259947 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:26.259548 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cr7vm" podUID="6a8d3b41-b8d0-4b23-9658-c239ee121858" May 27 14:05:26.259947 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:26.259675 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58m9b" podUID="f1a2947c-37ec-4483-b026-f7d0e5a6365d" May 27 14:05:27.938161 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:27.938120 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-77kzh\" (UniqueName: \"kubernetes.io/projected/6a8d3b41-b8d0-4b23-9658-c239ee121858-kube-api-access-77kzh\") pod \"network-check-target-cr7vm\" (UID: \"6a8d3b41-b8d0-4b23-9658-c239ee121858\") " pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:27.938711 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:27.938193 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1a2947c-37ec-4483-b026-f7d0e5a6365d-metrics-certs\") pod \"network-metrics-daemon-58m9b\" (UID: \"f1a2947c-37ec-4483-b026-f7d0e5a6365d\") " pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:27.938711 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:27.938316 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:27.938711 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:27.938393 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1a2947c-37ec-4483-b026-f7d0e5a6365d-metrics-certs podName:f1a2947c-37ec-4483-b026-f7d0e5a6365d nodeName:}" failed. No retries permitted until 2026-05-27 14:05:35.938373648 +0000 UTC m=+18.291198762 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1a2947c-37ec-4483-b026-f7d0e5a6365d-metrics-certs") pod "network-metrics-daemon-58m9b" (UID: "f1a2947c-37ec-4483-b026-f7d0e5a6365d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:27.938711 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:27.938442 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 14:05:27.938711 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:27.938459 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 14:05:27.938711 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:27.938473 2576 projected.go:194] Error preparing data for projected volume kube-api-access-77kzh for pod openshift-network-diagnostics/network-check-target-cr7vm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:27.938711 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:27.938521 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a8d3b41-b8d0-4b23-9658-c239ee121858-kube-api-access-77kzh podName:6a8d3b41-b8d0-4b23-9658-c239ee121858 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:35.938507398 +0000 UTC m=+18.291332530 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-77kzh" (UniqueName: "kubernetes.io/projected/6a8d3b41-b8d0-4b23-9658-c239ee121858-kube-api-access-77kzh") pod "network-check-target-cr7vm" (UID: "6a8d3b41-b8d0-4b23-9658-c239ee121858") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:28.259493 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:28.259425 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:28.259653 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:28.259611 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:28.259795 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:28.259728 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cr7vm" podUID="6a8d3b41-b8d0-4b23-9658-c239ee121858" May 27 14:05:28.259795 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:28.259762 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58m9b" podUID="f1a2947c-37ec-4483-b026-f7d0e5a6365d" May 27 14:05:30.258639 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:30.258606 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:30.259124 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:30.258618 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:30.259124 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:30.258746 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58m9b" podUID="f1a2947c-37ec-4483-b026-f7d0e5a6365d" May 27 14:05:30.259124 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:30.258799 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cr7vm" podUID="6a8d3b41-b8d0-4b23-9658-c239ee121858" May 27 14:05:32.257897 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:32.257861 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:32.258335 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:32.257993 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cr7vm" podUID="6a8d3b41-b8d0-4b23-9658-c239ee121858" May 27 14:05:32.258335 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:32.258058 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:32.258335 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:32.258240 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58m9b" podUID="f1a2947c-37ec-4483-b026-f7d0e5a6365d" May 27 14:05:34.258520 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:34.258474 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:34.258939 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:34.258636 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:34.258939 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:34.258710 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58m9b" podUID="f1a2947c-37ec-4483-b026-f7d0e5a6365d" May 27 14:05:34.258939 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:34.258610 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cr7vm" podUID="6a8d3b41-b8d0-4b23-9658-c239ee121858" May 27 14:05:35.997945 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:35.997902 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-77kzh\" (UniqueName: \"kubernetes.io/projected/6a8d3b41-b8d0-4b23-9658-c239ee121858-kube-api-access-77kzh\") pod \"network-check-target-cr7vm\" (UID: \"6a8d3b41-b8d0-4b23-9658-c239ee121858\") " pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:35.998465 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:35.997975 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1a2947c-37ec-4483-b026-f7d0e5a6365d-metrics-certs\") pod \"network-metrics-daemon-58m9b\" (UID: \"f1a2947c-37ec-4483-b026-f7d0e5a6365d\") " pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:35.998465 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:35.998043 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 14:05:35.998465 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:35.998069 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 14:05:35.998465 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:35.998072 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:35.998465 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:35.998083 2576 projected.go:194] Error preparing data for projected volume kube-api-access-77kzh for pod openshift-network-diagnostics/network-check-target-cr7vm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:35.998465 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:35.998132 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1a2947c-37ec-4483-b026-f7d0e5a6365d-metrics-certs podName:f1a2947c-37ec-4483-b026-f7d0e5a6365d nodeName:}" failed. No retries permitted until 2026-05-27 14:05:51.998112289 +0000 UTC m=+34.350937410 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1a2947c-37ec-4483-b026-f7d0e5a6365d-metrics-certs") pod "network-metrics-daemon-58m9b" (UID: "f1a2947c-37ec-4483-b026-f7d0e5a6365d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:35.998465 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:35.998148 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a8d3b41-b8d0-4b23-9658-c239ee121858-kube-api-access-77kzh podName:6a8d3b41-b8d0-4b23-9658-c239ee121858 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:51.998141196 +0000 UTC m=+34.350966310 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-77kzh" (UniqueName: "kubernetes.io/projected/6a8d3b41-b8d0-4b23-9658-c239ee121858-kube-api-access-77kzh") pod "network-check-target-cr7vm" (UID: "6a8d3b41-b8d0-4b23-9658-c239ee121858") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:36.258212 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:36.258131 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:36.258395 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:36.258131 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:36.258395 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:36.258256 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cr7vm" podUID="6a8d3b41-b8d0-4b23-9658-c239ee121858" May 27 14:05:36.258506 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:36.258402 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58m9b" podUID="f1a2947c-37ec-4483-b026-f7d0e5a6365d" May 27 14:05:38.258731 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:38.258700 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:38.259057 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:38.258817 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cr7vm" podUID="6a8d3b41-b8d0-4b23-9658-c239ee121858" May 27 14:05:38.259057 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:38.258858 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:38.259057 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:38.258941 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58m9b" podUID="f1a2947c-37ec-4483-b026-f7d0e5a6365d" May 27 14:05:39.332688 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:39.332313 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rkmqt" event={"ID":"6bb48ff2-6eb2-427e-85d8-8e127bf280e1","Type":"ContainerStarted","Data":"598c6781874d2f51e63ee0e32105182c563da26ebef1e63a3671a55e9f718897"} May 27 14:05:39.333781 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:39.333745 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d6zwm" event={"ID":"0f1c91f4-dd6f-49db-9f83-6fcc448f06f3","Type":"ContainerStarted","Data":"a50cf8c584bc795d92e06f1322c1e121c1e27779138f77cbcb47c91556250dc3"} May 27 14:05:39.335147 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:39.335121 2576 generic.go:358] "Generic (PLEG): container finished" podID="7dce939e-5149-403d-a0b3-5b40c239a8c4" containerID="a984702593f9a8fdb5714700cb87de1d8d0cddb249400e48e91d0a7f05e3ac69" exitCode=0 May 27 14:05:39.335268 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:39.335212 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qd9xc" event={"ID":"7dce939e-5149-403d-a0b3-5b40c239a8c4","Type":"ContainerDied","Data":"a984702593f9a8fdb5714700cb87de1d8d0cddb249400e48e91d0a7f05e3ac69"} May 27 14:05:39.337166 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:39.337081 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wd4m8_61335746-8301-4cff-bbe5-8da818657d5d/ovn-acl-logging/0.log" May 27 14:05:39.337474 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:39.337454 2576 generic.go:358] "Generic (PLEG): container finished" podID="61335746-8301-4cff-bbe5-8da818657d5d" containerID="b04528cd645d2358779bb3914cfff5cf65559d698aa861f33d3b03897b7b3ca6" exitCode=1 May 27 14:05:39.337556 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:39.337483 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" event={"ID":"61335746-8301-4cff-bbe5-8da818657d5d","Type":"ContainerStarted","Data":"dcee8f6a73e8e95010e7db696b127b90ed853c422ac8ec0f01b77ffd64872f36"} May 27 14:05:39.337556 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:39.337518 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" event={"ID":"61335746-8301-4cff-bbe5-8da818657d5d","Type":"ContainerDied","Data":"b04528cd645d2358779bb3914cfff5cf65559d698aa861f33d3b03897b7b3ca6"} May 27 14:05:39.337556 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:39.337533 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" event={"ID":"61335746-8301-4cff-bbe5-8da818657d5d","Type":"ContainerStarted","Data":"c6b60d30fe11af137548f680cd4fdee6fd373743bd0bbcfcce1a37ffe247e40f"} May 27 14:05:39.339083 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:39.339064 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tqc6p" event={"ID":"425ee3b1-4732-4289-b393-23327664c19e","Type":"ContainerStarted","Data":"4eb81ab10129a77c797a618e3448cc6a8664c31e2b7cfacd265e510bb2b6b822"} May 27 14:05:39.340621 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:39.340596 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" event={"ID":"ae3f7910-95b9-4293-8c5e-ba15fdb6739e","Type":"ContainerStarted","Data":"42a4b0e11a7df4d4e8c84a1e21ebe3e6e7dae72fd8ec680b6f0febb0b6645ec3"} May 27 14:05:39.343902 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:39.343802 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fpg92" event={"ID":"e951b51f-08ac-4c01-8734-ed44b0e24d1d","Type":"ContainerStarted","Data":"d8a1511bd0d094dd489869e31190c0d98ab929706f38e0d7c0792f0d7644b831"} May 27 14:05:39.359007 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:39.358964 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-132.ec2.internal" podStartSLOduration=20.358950213 podStartE2EDuration="20.358950213s" podCreationTimestamp="2026-05-27 14:05:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 14:05:22.317446067 +0000 UTC m=+4.670271204" watchObservedRunningTime="2026-05-27 14:05:39.358950213 +0000 UTC m=+21.711775350" May 27 14:05:39.385156 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:39.385099 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fpg92" podStartSLOduration=3.64081043 podStartE2EDuration="21.385083243s" podCreationTimestamp="2026-05-27 14:05:18 +0000 UTC" firstStartedPulling="2026-05-27 14:05:20.934595215 +0000 UTC m=+3.287420343" lastFinishedPulling="2026-05-27 14:05:38.678868027 +0000 UTC m=+21.031693156" observedRunningTime="2026-05-27 14:05:39.384762402 +0000 UTC m=+21.737587539" watchObservedRunningTime="2026-05-27 14:05:39.385083243 +0000 UTC m=+21.737908381" May 27 14:05:39.385279 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:39.385253 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-rkmqt" podStartSLOduration=3.6037384919999997 podStartE2EDuration="21.385244533s" podCreationTimestamp="2026-05-27 14:05:18 +0000 UTC" firstStartedPulling="2026-05-27 14:05:20.926907258 +0000 UTC m=+3.279732373" lastFinishedPulling="2026-05-27 14:05:38.708413299 +0000 UTC m=+21.061238414" observedRunningTime="2026-05-27 14:05:39.358528723 +0000 UTC m=+21.711353882" watchObservedRunningTime="2026-05-27 14:05:39.385244533 +0000 UTC m=+21.738069671" May 27 14:05:39.433486 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:39.433431 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tqc6p" podStartSLOduration=7.5760440110000005 podStartE2EDuration="21.433413623s" podCreationTimestamp="2026-05-27 14:05:18 +0000 UTC" firstStartedPulling="2026-05-27 14:05:20.924387113 +0000 UTC m=+3.277212227" lastFinishedPulling="2026-05-27 14:05:34.781756724 +0000 UTC m=+17.134581839" observedRunningTime="2026-05-27 14:05:39.410409241 +0000 UTC m=+21.763234377" watchObservedRunningTime="2026-05-27 14:05:39.433413623 +0000 UTC m=+21.786238758" May 27 14:05:39.433659 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:39.433630 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d6zwm" podStartSLOduration=3.719987034 podStartE2EDuration="21.433624365s" podCreationTimestamp="2026-05-27 14:05:18 +0000 UTC" firstStartedPulling="2026-05-27 14:05:20.925251537 +0000 UTC m=+3.278076655" lastFinishedPulling="2026-05-27 14:05:38.638888868 +0000 UTC m=+20.991713986" observedRunningTime="2026-05-27 14:05:39.433563202 +0000 UTC m=+21.786388329" watchObservedRunningTime="2026-05-27 14:05:39.433624365 +0000 UTC m=+21.786449503" May 27 14:05:40.073193 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:40.073164 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 27 14:05:40.232233 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:40.232080 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-27T14:05:40.073185384Z","UUID":"bb0b09b7-a65f-49ef-a8e4-e06cd03e6913","Handler":null,"Name":"","Endpoint":""} May 27 14:05:40.234270 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:40.234191 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 27 14:05:40.234270 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:40.234222 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 27 14:05:40.258024 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:40.257994 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:40.258168 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:40.258004 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:40.258168 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:40.258116 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cr7vm" podUID="6a8d3b41-b8d0-4b23-9658-c239ee121858" May 27 14:05:40.258364 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:40.258164 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58m9b" podUID="f1a2947c-37ec-4483-b026-f7d0e5a6365d" May 27 14:05:40.347956 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:40.347912 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" event={"ID":"ae3f7910-95b9-4293-8c5e-ba15fdb6739e","Type":"ContainerStarted","Data":"0092e6a68234863a7adf376bc60def78532d7a748b27a856d4718cde0b7e1903"} May 27 14:05:40.350737 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:40.350716 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wd4m8_61335746-8301-4cff-bbe5-8da818657d5d/ovn-acl-logging/0.log" May 27 14:05:40.351176 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:40.351157 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" event={"ID":"61335746-8301-4cff-bbe5-8da818657d5d","Type":"ContainerStarted","Data":"8b6dbc74851e22992f97d0f645e65a271d5b79bd437ee3fa69caacd63dd66941"} May 27 14:05:40.351270 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:40.351183 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" event={"ID":"61335746-8301-4cff-bbe5-8da818657d5d","Type":"ContainerStarted","Data":"b9fc73a4e4c752227328c31de57111dd8874b1d85b0c62a832af2cc025452fa4"} May 27 14:05:40.351270 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:40.351195 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" event={"ID":"61335746-8301-4cff-bbe5-8da818657d5d","Type":"ContainerStarted","Data":"870ac627c40234c6b1e64d79930bd3e3fa684194aa26b8087524aacec6aa7ff1"} May 27 14:05:40.352508 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:40.352483 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-knspg" event={"ID":"fd46e9f9-82b1-4ed8-bf59-100aafafa0c4","Type":"ContainerStarted","Data":"864e950b28a9d4eb901058bc9388b22e5c65a29bdd6f405c90ab2d3c288911dc"} May 27 14:05:40.370744 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:40.370688 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-knspg" podStartSLOduration=4.62353648 podStartE2EDuration="22.370675059s" podCreationTimestamp="2026-05-27 14:05:18 +0000 UTC" firstStartedPulling="2026-05-27 14:05:20.930236451 +0000 UTC m=+3.283061580" lastFinishedPulling="2026-05-27 14:05:38.67737503 +0000 UTC m=+21.030200159" observedRunningTime="2026-05-27 14:05:40.370419536 +0000 UTC m=+22.723244674" watchObservedRunningTime="2026-05-27 14:05:40.370675059 +0000 UTC m=+22.723500195" May 27 14:05:40.748956 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:40.748919 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tqc6p" May 27 14:05:40.749659 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:40.749636 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tqc6p" May 27 14:05:41.356889 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:41.356809 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" event={"ID":"ae3f7910-95b9-4293-8c5e-ba15fdb6739e","Type":"ContainerStarted","Data":"da864474df32080a879f343c27b170fc76c2c42ab18721da1c369ca4e94636bb"} May 27 14:05:42.258044 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:42.257848 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:42.258242 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:42.257919 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:42.258242 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:42.258119 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cr7vm" podUID="6a8d3b41-b8d0-4b23-9658-c239ee121858" May 27 14:05:42.258363 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:42.258255 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58m9b" podUID="f1a2947c-37ec-4483-b026-f7d0e5a6365d" May 27 14:05:42.361947 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:42.361916 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wd4m8_61335746-8301-4cff-bbe5-8da818657d5d/ovn-acl-logging/0.log" May 27 14:05:42.362394 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:42.362369 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" event={"ID":"61335746-8301-4cff-bbe5-8da818657d5d","Type":"ContainerStarted","Data":"dd6e9a066ff3ed6cd292245804cdb15139ee3cca067466c5d9da23df9e68d226"} May 27 14:05:42.362463 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:42.362414 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 27 14:05:44.257749 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.257724 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:44.258451 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:44.257845 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cr7vm" podUID="6a8d3b41-b8d0-4b23-9658-c239ee121858" May 27 14:05:44.258451 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.257896 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:44.258451 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:44.257991 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58m9b" podUID="f1a2947c-37ec-4483-b026-f7d0e5a6365d" May 27 14:05:44.269683 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.269633 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htvbr" podStartSLOduration=6.2973293120000005 podStartE2EDuration="26.26962157s" podCreationTimestamp="2026-05-27 14:05:18 +0000 UTC" firstStartedPulling="2026-05-27 14:05:20.934729355 +0000 UTC m=+3.287554468" lastFinishedPulling="2026-05-27 14:05:40.907021606 +0000 UTC m=+23.259846726" observedRunningTime="2026-05-27 14:05:41.375529127 +0000 UTC m=+23.728354265" watchObservedRunningTime="2026-05-27 14:05:44.26962157 +0000 UTC m=+26.622446706" May 27 14:05:44.269807 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.269754 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-4nn5w"] May 27 14:05:44.274307 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.274291 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4nn5w" May 27 14:05:44.274381 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:44.274360 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4nn5w" podUID="289d47a1-b316-4f03-a8d7-617598d6bef1" May 27 14:05:44.363172 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.363137 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/289d47a1-b316-4f03-a8d7-617598d6bef1-dbus\") pod \"global-pull-secret-syncer-4nn5w\" (UID: \"289d47a1-b316-4f03-a8d7-617598d6bef1\") " pod="kube-system/global-pull-secret-syncer-4nn5w" May 27 14:05:44.363172 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.363173 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/289d47a1-b316-4f03-a8d7-617598d6bef1-kubelet-config\") pod \"global-pull-secret-syncer-4nn5w\" (UID: \"289d47a1-b316-4f03-a8d7-617598d6bef1\") " pod="kube-system/global-pull-secret-syncer-4nn5w" May 27 14:05:44.363398 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.363204 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/289d47a1-b316-4f03-a8d7-617598d6bef1-original-pull-secret\") pod \"global-pull-secret-syncer-4nn5w\" (UID: \"289d47a1-b316-4f03-a8d7-617598d6bef1\") " pod="kube-system/global-pull-secret-syncer-4nn5w" May 27 14:05:44.366671 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.366646 2576 generic.go:358] "Generic (PLEG): container finished" podID="7dce939e-5149-403d-a0b3-5b40c239a8c4" containerID="ab178c883f264668f6297231fffb06a4b81482f630a1ed5a7620e6ccd05707da" exitCode=0 May 27 14:05:44.366804 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.366718 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qd9xc" event={"ID":"7dce939e-5149-403d-a0b3-5b40c239a8c4","Type":"ContainerDied","Data":"ab178c883f264668f6297231fffb06a4b81482f630a1ed5a7620e6ccd05707da"} May 27 14:05:44.369766 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.369748 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wd4m8_61335746-8301-4cff-bbe5-8da818657d5d/ovn-acl-logging/0.log" May 27 14:05:44.370069 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.370050 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" event={"ID":"61335746-8301-4cff-bbe5-8da818657d5d","Type":"ContainerStarted","Data":"4a6c840ba41f552799d57e0e9bc187d41a33a073df3cb51871be259c17bc0f65"} May 27 14:05:44.370376 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.370358 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:44.370437 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.370386 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:44.370437 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.370399 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:44.370522 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.370467 2576 scope.go:117] "RemoveContainer" containerID="b04528cd645d2358779bb3914cfff5cf65559d698aa861f33d3b03897b7b3ca6" May 27 14:05:44.386173 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.386153 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:44.386265 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.386226 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:05:44.464134 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.464107 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/289d47a1-b316-4f03-a8d7-617598d6bef1-dbus\") pod \"global-pull-secret-syncer-4nn5w\" (UID: \"289d47a1-b316-4f03-a8d7-617598d6bef1\") " pod="kube-system/global-pull-secret-syncer-4nn5w" May 27 14:05:44.464286 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.464148 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/289d47a1-b316-4f03-a8d7-617598d6bef1-kubelet-config\") pod \"global-pull-secret-syncer-4nn5w\" (UID: \"289d47a1-b316-4f03-a8d7-617598d6bef1\") " pod="kube-system/global-pull-secret-syncer-4nn5w" May 27 14:05:44.464286 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.464206 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/289d47a1-b316-4f03-a8d7-617598d6bef1-kubelet-config\") pod \"global-pull-secret-syncer-4nn5w\" (UID: \"289d47a1-b316-4f03-a8d7-617598d6bef1\") " pod="kube-system/global-pull-secret-syncer-4nn5w" May 27 14:05:44.464425 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.464309 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/289d47a1-b316-4f03-a8d7-617598d6bef1-original-pull-secret\") pod \"global-pull-secret-syncer-4nn5w\" (UID: \"289d47a1-b316-4f03-a8d7-617598d6bef1\") " pod="kube-system/global-pull-secret-syncer-4nn5w" May 27 14:05:44.464552 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.464350 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/289d47a1-b316-4f03-a8d7-617598d6bef1-dbus\") pod \"global-pull-secret-syncer-4nn5w\" (UID: \"289d47a1-b316-4f03-a8d7-617598d6bef1\") " pod="kube-system/global-pull-secret-syncer-4nn5w" May 27 14:05:44.465451 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:44.465089 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 14:05:44.467437 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:44.467410 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289d47a1-b316-4f03-a8d7-617598d6bef1-original-pull-secret podName:289d47a1-b316-4f03-a8d7-617598d6bef1 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:44.96737592 +0000 UTC m=+27.320201048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/289d47a1-b316-4f03-a8d7-617598d6bef1-original-pull-secret") pod "global-pull-secret-syncer-4nn5w" (UID: "289d47a1-b316-4f03-a8d7-617598d6bef1") : object "kube-system"/"original-pull-secret" not registered May 27 14:05:44.881988 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.881944 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tqc6p" May 27 14:05:44.882165 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.882101 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 27 14:05:44.882667 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.882642 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tqc6p" May 27 14:05:44.968052 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:44.968015 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/289d47a1-b316-4f03-a8d7-617598d6bef1-original-pull-secret\") pod \"global-pull-secret-syncer-4nn5w\" (UID: \"289d47a1-b316-4f03-a8d7-617598d6bef1\") " pod="kube-system/global-pull-secret-syncer-4nn5w" May 27 14:05:44.968211 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:44.968151 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 14:05:44.968260 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:44.968232 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289d47a1-b316-4f03-a8d7-617598d6bef1-original-pull-secret podName:289d47a1-b316-4f03-a8d7-617598d6bef1 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:45.968213674 +0000 UTC m=+28.321038793 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/289d47a1-b316-4f03-a8d7-617598d6bef1-original-pull-secret") pod "global-pull-secret-syncer-4nn5w" (UID: "289d47a1-b316-4f03-a8d7-617598d6bef1") : object "kube-system"/"original-pull-secret" not registered May 27 14:05:45.256477 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.256449 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-cgjjd"] May 27 14:05:45.269697 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.269668 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cgjjd" May 27 14:05:45.274274 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.274243 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 27 14:05:45.274516 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.274497 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 27 14:05:45.274788 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.274766 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dgz9p\"" May 27 14:05:45.372090 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.372058 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdb2t\" (UniqueName: \"kubernetes.io/projected/948632b3-b439-4e9b-ab4c-8f29cce2643a-kube-api-access-pdb2t\") pod \"node-resolver-cgjjd\" (UID: \"948632b3-b439-4e9b-ab4c-8f29cce2643a\") " pod="openshift-dns/node-resolver-cgjjd" May 27 14:05:45.372221 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.372151 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/948632b3-b439-4e9b-ab4c-8f29cce2643a-hosts-file\") pod \"node-resolver-cgjjd\" (UID: \"948632b3-b439-4e9b-ab4c-8f29cce2643a\") " pod="openshift-dns/node-resolver-cgjjd" May 27 14:05:45.372274 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.372257 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/948632b3-b439-4e9b-ab4c-8f29cce2643a-tmp-dir\") pod \"node-resolver-cgjjd\" (UID: \"948632b3-b439-4e9b-ab4c-8f29cce2643a\") " pod="openshift-dns/node-resolver-cgjjd" May 27 14:05:45.375603 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.375581 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wd4m8_61335746-8301-4cff-bbe5-8da818657d5d/ovn-acl-logging/0.log" May 27 14:05:45.375986 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.375958 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" event={"ID":"61335746-8301-4cff-bbe5-8da818657d5d","Type":"ContainerStarted","Data":"f51c88f8528be525e9df57c2f1c823e29dd34dd049137efbba475d26ab953c3f"} May 27 14:05:45.406620 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.406466 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" podStartSLOduration=9.340286806 podStartE2EDuration="27.406448136s" podCreationTimestamp="2026-05-27 14:05:18 +0000 UTC" firstStartedPulling="2026-05-27 14:05:20.928879477 +0000 UTC m=+3.281704591" lastFinishedPulling="2026-05-27 14:05:38.995040805 +0000 UTC m=+21.347865921" observedRunningTime="2026-05-27 14:05:45.405491439 +0000 UTC m=+27.758316574" watchObservedRunningTime="2026-05-27 14:05:45.406448136 +0000 UTC m=+27.759273274" May 27 14:05:45.473139 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.473103 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/948632b3-b439-4e9b-ab4c-8f29cce2643a-tmp-dir\") pod \"node-resolver-cgjjd\" (UID: \"948632b3-b439-4e9b-ab4c-8f29cce2643a\") " pod="openshift-dns/node-resolver-cgjjd" May 27 14:05:45.473243 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.473217 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdb2t\" (UniqueName: \"kubernetes.io/projected/948632b3-b439-4e9b-ab4c-8f29cce2643a-kube-api-access-pdb2t\") pod \"node-resolver-cgjjd\" (UID: \"948632b3-b439-4e9b-ab4c-8f29cce2643a\") " pod="openshift-dns/node-resolver-cgjjd" May 27 14:05:45.473526 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.473263 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/948632b3-b439-4e9b-ab4c-8f29cce2643a-hosts-file\") pod \"node-resolver-cgjjd\" (UID: \"948632b3-b439-4e9b-ab4c-8f29cce2643a\") " pod="openshift-dns/node-resolver-cgjjd" May 27 14:05:45.473735 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.473695 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/948632b3-b439-4e9b-ab4c-8f29cce2643a-hosts-file\") pod \"node-resolver-cgjjd\" (UID: \"948632b3-b439-4e9b-ab4c-8f29cce2643a\") " pod="openshift-dns/node-resolver-cgjjd" May 27 14:05:45.474010 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.473985 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/948632b3-b439-4e9b-ab4c-8f29cce2643a-tmp-dir\") pod \"node-resolver-cgjjd\" (UID: \"948632b3-b439-4e9b-ab4c-8f29cce2643a\") " pod="openshift-dns/node-resolver-cgjjd" May 27 14:05:45.483756 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.483732 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdb2t\" (UniqueName: \"kubernetes.io/projected/948632b3-b439-4e9b-ab4c-8f29cce2643a-kube-api-access-pdb2t\") pod \"node-resolver-cgjjd\" (UID: \"948632b3-b439-4e9b-ab4c-8f29cce2643a\") " pod="openshift-dns/node-resolver-cgjjd" May 27 14:05:45.585081 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.584992 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cgjjd" May 27 14:05:45.592983 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:45.592947 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod948632b3_b439_4e9b_ab4c_8f29cce2643a.slice/crio-60fd4a11610af4f097c994c2f0bf25781c645cbe0b144c35fe79ffe02bd829ab WatchSource:0}: Error finding container 60fd4a11610af4f097c994c2f0bf25781c645cbe0b144c35fe79ffe02bd829ab: Status 404 returned error can't find the container with id 60fd4a11610af4f097c994c2f0bf25781c645cbe0b144c35fe79ffe02bd829ab May 27 14:05:45.942627 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.942349 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cr7vm"] May 27 14:05:45.942799 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.942698 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:45.942799 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:45.942779 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cr7vm" podUID="6a8d3b41-b8d0-4b23-9658-c239ee121858" May 27 14:05:45.942975 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.942954 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-58m9b"] May 27 14:05:45.943068 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.943058 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:45.943152 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:45.943135 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58m9b" podUID="f1a2947c-37ec-4483-b026-f7d0e5a6365d" May 27 14:05:45.945059 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.945038 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4nn5w"] May 27 14:05:45.945178 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.945122 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4nn5w" May 27 14:05:45.945224 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:45.945198 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4nn5w" podUID="289d47a1-b316-4f03-a8d7-617598d6bef1" May 27 14:05:45.976493 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:45.976465 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/289d47a1-b316-4f03-a8d7-617598d6bef1-original-pull-secret\") pod \"global-pull-secret-syncer-4nn5w\" (UID: \"289d47a1-b316-4f03-a8d7-617598d6bef1\") " pod="kube-system/global-pull-secret-syncer-4nn5w" May 27 14:05:45.976628 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:45.976570 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 14:05:45.976628 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:45.976622 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289d47a1-b316-4f03-a8d7-617598d6bef1-original-pull-secret podName:289d47a1-b316-4f03-a8d7-617598d6bef1 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:47.976606569 +0000 UTC m=+30.329431692 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/289d47a1-b316-4f03-a8d7-617598d6bef1-original-pull-secret") pod "global-pull-secret-syncer-4nn5w" (UID: "289d47a1-b316-4f03-a8d7-617598d6bef1") : object "kube-system"/"original-pull-secret" not registered May 27 14:05:46.379502 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:46.379465 2576 generic.go:358] "Generic (PLEG): container finished" podID="7dce939e-5149-403d-a0b3-5b40c239a8c4" containerID="90f40d06ac42682951ceac1ef7d05c86600c910963616d12dac8f9c6af3ee63c" exitCode=0 May 27 14:05:46.379998 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:46.379561 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qd9xc" event={"ID":"7dce939e-5149-403d-a0b3-5b40c239a8c4","Type":"ContainerDied","Data":"90f40d06ac42682951ceac1ef7d05c86600c910963616d12dac8f9c6af3ee63c"} May 27 14:05:46.380814 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:46.380781 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cgjjd" event={"ID":"948632b3-b439-4e9b-ab4c-8f29cce2643a","Type":"ContainerStarted","Data":"66ab703335f9bcbdd2fa07ee36853a01262f4065e7313ce032ca55aee84722c7"} May 27 14:05:46.380814 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:46.380816 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cgjjd" event={"ID":"948632b3-b439-4e9b-ab4c-8f29cce2643a","Type":"ContainerStarted","Data":"60fd4a11610af4f097c994c2f0bf25781c645cbe0b144c35fe79ffe02bd829ab"} May 27 14:05:46.417036 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:46.416990 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-cgjjd" podStartSLOduration=1.416975949 podStartE2EDuration="1.416975949s" podCreationTimestamp="2026-05-27 14:05:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 14:05:46.416393718 +0000 UTC m=+28.769218856" watchObservedRunningTime="2026-05-27 14:05:46.416975949 +0000 UTC m=+28.769801079" May 27 14:05:47.258377 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:47.258351 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:47.258507 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:47.258448 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cr7vm" podUID="6a8d3b41-b8d0-4b23-9658-c239ee121858" May 27 14:05:47.385143 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:47.385099 2576 generic.go:358] "Generic (PLEG): container finished" podID="7dce939e-5149-403d-a0b3-5b40c239a8c4" containerID="0b64f8c01727187f6dd58663ccfe63d102ca44c4a8a9e457f7d0b3fd47640415" exitCode=0 May 27 14:05:47.385773 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:47.385175 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qd9xc" event={"ID":"7dce939e-5149-403d-a0b3-5b40c239a8c4","Type":"ContainerDied","Data":"0b64f8c01727187f6dd58663ccfe63d102ca44c4a8a9e457f7d0b3fd47640415"} May 27 14:05:47.992036 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:47.991994 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/289d47a1-b316-4f03-a8d7-617598d6bef1-original-pull-secret\") pod \"global-pull-secret-syncer-4nn5w\" (UID: \"289d47a1-b316-4f03-a8d7-617598d6bef1\") " pod="kube-system/global-pull-secret-syncer-4nn5w" May 27 14:05:47.992222 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:47.992168 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 14:05:47.992292 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:47.992238 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289d47a1-b316-4f03-a8d7-617598d6bef1-original-pull-secret podName:289d47a1-b316-4f03-a8d7-617598d6bef1 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:51.992222905 +0000 UTC m=+34.345048018 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/289d47a1-b316-4f03-a8d7-617598d6bef1-original-pull-secret") pod "global-pull-secret-syncer-4nn5w" (UID: "289d47a1-b316-4f03-a8d7-617598d6bef1") : object "kube-system"/"original-pull-secret" not registered May 27 14:05:48.258762 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:48.258676 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4nn5w" May 27 14:05:48.258926 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:48.258773 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:48.258926 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:48.258867 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58m9b" podUID="f1a2947c-37ec-4483-b026-f7d0e5a6365d" May 27 14:05:48.258926 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:48.258885 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4nn5w" podUID="289d47a1-b316-4f03-a8d7-617598d6bef1" May 27 14:05:49.258640 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:49.258605 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:49.259162 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:49.258714 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cr7vm" podUID="6a8d3b41-b8d0-4b23-9658-c239ee121858" May 27 14:05:50.258890 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:50.258643 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:50.259346 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:50.258678 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4nn5w" May 27 14:05:50.259346 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:50.259023 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58m9b" podUID="f1a2947c-37ec-4483-b026-f7d0e5a6365d" May 27 14:05:50.259346 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:50.259049 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4nn5w" podUID="289d47a1-b316-4f03-a8d7-617598d6bef1" May 27 14:05:51.258699 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.258664 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:51.258842 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:51.258810 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cr7vm" podUID="6a8d3b41-b8d0-4b23-9658-c239ee121858" May 27 14:05:51.424935 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.424909 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-132.ec2.internal" event="NodeReady" May 27 14:05:51.425426 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.425045 2576 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 27 14:05:51.468690 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.468653 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76bb57545c-bt9qt"] May 27 14:05:51.497103 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.497069 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-h4llj"] May 27 14:05:51.497310 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.497230 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:51.501166 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.501025 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 27 14:05:51.501166 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.501040 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 27 14:05:51.501166 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.501052 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 27 14:05:51.501565 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.501226 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-w599p\"" May 27 14:05:51.506468 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.506436 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m4795"] May 27 14:05:51.506649 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.506603 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h4llj" May 27 14:05:51.508581 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.508562 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 27 14:05:51.509597 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.509546 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 27 14:05:51.509597 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.509585 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 27 14:05:51.509826 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.509807 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dcgs8\"" May 27 14:05:51.520835 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.520815 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76bb57545c-bt9qt"] May 27 14:05:51.520939 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.520840 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m4795"] May 27 14:05:51.520939 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.520852 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h4llj"] May 27 14:05:51.521087 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.520957 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m4795" May 27 14:05:51.524767 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.524400 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 27 14:05:51.524877 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.524781 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rb76g\"" May 27 14:05:51.524997 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.524976 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 27 14:05:51.525094 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.525026 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 27 14:05:51.622364 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.622312 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59575ced-2733-424b-91f8-04efa7a3d4f3-metrics-tls\") pod \"dns-default-h4llj\" (UID: \"59575ced-2733-424b-91f8-04efa7a3d4f3\") " pod="openshift-dns/dns-default-h4llj" May 27 14:05:51.622364 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.622369 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-installation-pull-secrets\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:51.622604 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.622439 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59575ced-2733-424b-91f8-04efa7a3d4f3-tmp-dir\") pod \"dns-default-h4llj\" (UID: \"59575ced-2733-424b-91f8-04efa7a3d4f3\") " pod="openshift-dns/dns-default-h4llj" May 27 14:05:51.622604 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.622533 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-tls\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:51.622604 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.622584 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-bound-sa-token\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:51.622719 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.622616 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-certificates\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:51.622719 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.622673 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60daec24-40fb-4ec9-bd38-48b06bfee016-cert\") pod \"ingress-canary-m4795\" (UID: \"60daec24-40fb-4ec9-bd38-48b06bfee016\") " pod="openshift-ingress-canary/ingress-canary-m4795" May 27 14:05:51.622719 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.622703 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-trusted-ca\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:51.622843 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.622732 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q45gl\" (UniqueName: \"kubernetes.io/projected/60daec24-40fb-4ec9-bd38-48b06bfee016-kube-api-access-q45gl\") pod \"ingress-canary-m4795\" (UID: \"60daec24-40fb-4ec9-bd38-48b06bfee016\") " pod="openshift-ingress-canary/ingress-canary-m4795" May 27 14:05:51.622843 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.622768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmqkf\" (UniqueName: \"kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-kube-api-access-pmqkf\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:51.622843 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.622797 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blgv9\" (UniqueName: \"kubernetes.io/projected/59575ced-2733-424b-91f8-04efa7a3d4f3-kube-api-access-blgv9\") pod \"dns-default-h4llj\" (UID: \"59575ced-2733-424b-91f8-04efa7a3d4f3\") " pod="openshift-dns/dns-default-h4llj" May 27 14:05:51.622843 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.622822 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-image-registry-private-configuration\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:51.623010 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.622844 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/59575ced-2733-424b-91f8-04efa7a3d4f3-config-volume\") pod \"dns-default-h4llj\" (UID: \"59575ced-2733-424b-91f8-04efa7a3d4f3\") " pod="openshift-dns/dns-default-h4llj" May 27 14:05:51.623010 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.622873 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-ca-trust-extracted\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:51.723788 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.723750 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-ca-trust-extracted\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:51.724056 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.723796 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59575ced-2733-424b-91f8-04efa7a3d4f3-metrics-tls\") pod \"dns-default-h4llj\" (UID: \"59575ced-2733-424b-91f8-04efa7a3d4f3\") " pod="openshift-dns/dns-default-h4llj" May 27 14:05:51.724056 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.723815 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-installation-pull-secrets\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:51.724056 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.723840 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59575ced-2733-424b-91f8-04efa7a3d4f3-tmp-dir\") pod \"dns-default-h4llj\" (UID: \"59575ced-2733-424b-91f8-04efa7a3d4f3\") " pod="openshift-dns/dns-default-h4llj" May 27 14:05:51.724056 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.723904 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-tls\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:51.724056 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:51.723911 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 14:05:51.724056 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.723932 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-bound-sa-token\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:51.724056 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.723960 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-certificates\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:51.724056 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:51.723989 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59575ced-2733-424b-91f8-04efa7a3d4f3-metrics-tls podName:59575ced-2733-424b-91f8-04efa7a3d4f3 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:52.223967373 +0000 UTC m=+34.576792492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59575ced-2733-424b-91f8-04efa7a3d4f3-metrics-tls") pod "dns-default-h4llj" (UID: "59575ced-2733-424b-91f8-04efa7a3d4f3") : secret "dns-default-metrics-tls" not found May 27 14:05:51.724056 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.724034 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60daec24-40fb-4ec9-bd38-48b06bfee016-cert\") pod \"ingress-canary-m4795\" (UID: \"60daec24-40fb-4ec9-bd38-48b06bfee016\") " pod="openshift-ingress-canary/ingress-canary-m4795" May 27 14:05:51.724596 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:51.724070 2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 14:05:51.724596 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.724076 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-trusted-ca\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:51.724596 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:51.724086 2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76bb57545c-bt9qt: secret "image-registry-tls" not found May 27 14:05:51.724596 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.724109 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q45gl\" (UniqueName: \"kubernetes.io/projected/60daec24-40fb-4ec9-bd38-48b06bfee016-kube-api-access-q45gl\") pod \"ingress-canary-m4795\" (UID: \"60daec24-40fb-4ec9-bd38-48b06bfee016\") " pod="openshift-ingress-canary/ingress-canary-m4795" May 27 14:05:51.724596 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:51.724140 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-tls podName:cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:52.224120931 +0000 UTC m=+34.576946063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-tls") pod "image-registry-76bb57545c-bt9qt" (UID: "cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1") : secret "image-registry-tls" not found May 27 14:05:51.724596 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.724164 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pmqkf\" (UniqueName: \"kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-kube-api-access-pmqkf\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:51.724596 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.724214 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-ca-trust-extracted\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:51.724596 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.724236 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-blgv9\" (UniqueName: \"kubernetes.io/projected/59575ced-2733-424b-91f8-04efa7a3d4f3-kube-api-access-blgv9\") pod \"dns-default-h4llj\" (UID: \"59575ced-2733-424b-91f8-04efa7a3d4f3\") " pod="openshift-dns/dns-default-h4llj" May 27 14:05:51.724596 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.724289 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-image-registry-private-configuration\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:51.724596 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.724297 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59575ced-2733-424b-91f8-04efa7a3d4f3-tmp-dir\") pod \"dns-default-h4llj\" (UID: \"59575ced-2733-424b-91f8-04efa7a3d4f3\") " pod="openshift-dns/dns-default-h4llj" May 27 14:05:51.724596 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.724340 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/59575ced-2733-424b-91f8-04efa7a3d4f3-config-volume\") pod \"dns-default-h4llj\" (UID: \"59575ced-2733-424b-91f8-04efa7a3d4f3\") " pod="openshift-dns/dns-default-h4llj" May 27 14:05:51.724596 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.724598 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-certificates\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:51.725198 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:51.724673 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 14:05:51.725198 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:51.724740 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60daec24-40fb-4ec9-bd38-48b06bfee016-cert podName:60daec24-40fb-4ec9-bd38-48b06bfee016 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:52.224726268 +0000 UTC m=+34.577551383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/60daec24-40fb-4ec9-bd38-48b06bfee016-cert") pod "ingress-canary-m4795" (UID: "60daec24-40fb-4ec9-bd38-48b06bfee016") : secret "canary-serving-cert" not found May 27 14:05:51.725198 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.724826 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/59575ced-2733-424b-91f8-04efa7a3d4f3-config-volume\") pod \"dns-default-h4llj\" (UID: \"59575ced-2733-424b-91f8-04efa7a3d4f3\") " pod="openshift-dns/dns-default-h4llj" May 27 14:05:51.725365 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.725193 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-trusted-ca\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:51.728276 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.728239 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-image-registry-private-configuration\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:51.728276 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.728258 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-installation-pull-secrets\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:51.735024 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.734988 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmqkf\" (UniqueName: \"kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-kube-api-access-pmqkf\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:51.735570 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.735548 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q45gl\" (UniqueName: \"kubernetes.io/projected/60daec24-40fb-4ec9-bd38-48b06bfee016-kube-api-access-q45gl\") pod \"ingress-canary-m4795\" (UID: \"60daec24-40fb-4ec9-bd38-48b06bfee016\") " pod="openshift-ingress-canary/ingress-canary-m4795" May 27 14:05:51.735741 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.735652 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blgv9\" (UniqueName: \"kubernetes.io/projected/59575ced-2733-424b-91f8-04efa7a3d4f3-kube-api-access-blgv9\") pod \"dns-default-h4llj\" (UID: \"59575ced-2733-424b-91f8-04efa7a3d4f3\") " pod="openshift-dns/dns-default-h4llj" May 27 14:05:51.736244 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:51.736218 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-bound-sa-token\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:52.027171 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:52.027133 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-77kzh\" (UniqueName: \"kubernetes.io/projected/6a8d3b41-b8d0-4b23-9658-c239ee121858-kube-api-access-77kzh\") pod \"network-check-target-cr7vm\" (UID: \"6a8d3b41-b8d0-4b23-9658-c239ee121858\") " pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:52.027443 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:52.027183 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/289d47a1-b316-4f03-a8d7-617598d6bef1-original-pull-secret\") pod \"global-pull-secret-syncer-4nn5w\" (UID: \"289d47a1-b316-4f03-a8d7-617598d6bef1\") " pod="kube-system/global-pull-secret-syncer-4nn5w" May 27 14:05:52.027443 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:52.027249 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1a2947c-37ec-4483-b026-f7d0e5a6365d-metrics-certs\") pod \"network-metrics-daemon-58m9b\" (UID: \"f1a2947c-37ec-4483-b026-f7d0e5a6365d\") " pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:52.027443 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:52.027288 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 14:05:52.027443 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:52.027318 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 14:05:52.027443 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:52.027347 2576 projected.go:194] Error preparing data for projected volume kube-api-access-77kzh for pod openshift-network-diagnostics/network-check-target-cr7vm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:52.027443 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:52.027368 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 14:05:52.027443 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:52.027402 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a8d3b41-b8d0-4b23-9658-c239ee121858-kube-api-access-77kzh podName:6a8d3b41-b8d0-4b23-9658-c239ee121858 nodeName:}" failed. No retries permitted until 2026-05-27 14:06:24.027388642 +0000 UTC m=+66.380213757 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-77kzh" (UniqueName: "kubernetes.io/projected/6a8d3b41-b8d0-4b23-9658-c239ee121858-kube-api-access-77kzh") pod "network-check-target-cr7vm" (UID: "6a8d3b41-b8d0-4b23-9658-c239ee121858") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 14:05:52.027443 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:52.027426 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289d47a1-b316-4f03-a8d7-617598d6bef1-original-pull-secret podName:289d47a1-b316-4f03-a8d7-617598d6bef1 nodeName:}" failed. No retries permitted until 2026-05-27 14:06:00.027410573 +0000 UTC m=+42.380235693 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/289d47a1-b316-4f03-a8d7-617598d6bef1-original-pull-secret") pod "global-pull-secret-syncer-4nn5w" (UID: "289d47a1-b316-4f03-a8d7-617598d6bef1") : object "kube-system"/"original-pull-secret" not registered May 27 14:05:52.027443 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:52.027372 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:52.027793 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:52.027454 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1a2947c-37ec-4483-b026-f7d0e5a6365d-metrics-certs podName:f1a2947c-37ec-4483-b026-f7d0e5a6365d nodeName:}" failed. No retries permitted until 2026-05-27 14:06:24.027447622 +0000 UTC m=+66.380272736 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1a2947c-37ec-4483-b026-f7d0e5a6365d-metrics-certs") pod "network-metrics-daemon-58m9b" (UID: "f1a2947c-37ec-4483-b026-f7d0e5a6365d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 14:05:52.229229 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:52.229188 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59575ced-2733-424b-91f8-04efa7a3d4f3-metrics-tls\") pod \"dns-default-h4llj\" (UID: \"59575ced-2733-424b-91f8-04efa7a3d4f3\") " pod="openshift-dns/dns-default-h4llj" May 27 14:05:52.229448 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:52.229259 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-tls\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:52.229448 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:52.229302 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60daec24-40fb-4ec9-bd38-48b06bfee016-cert\") pod \"ingress-canary-m4795\" (UID: \"60daec24-40fb-4ec9-bd38-48b06bfee016\") " pod="openshift-ingress-canary/ingress-canary-m4795" May 27 14:05:52.229448 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:52.229380 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 14:05:52.229448 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:52.229402 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 14:05:52.229448 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:52.229385 2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 14:05:52.229448 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:52.229448 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59575ced-2733-424b-91f8-04efa7a3d4f3-metrics-tls podName:59575ced-2733-424b-91f8-04efa7a3d4f3 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:53.229427227 +0000 UTC m=+35.582252363 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59575ced-2733-424b-91f8-04efa7a3d4f3-metrics-tls") pod "dns-default-h4llj" (UID: "59575ced-2733-424b-91f8-04efa7a3d4f3") : secret "dns-default-metrics-tls" not found May 27 14:05:52.229448 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:52.229452 2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76bb57545c-bt9qt: secret "image-registry-tls" not found May 27 14:05:52.229797 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:52.229462 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60daec24-40fb-4ec9-bd38-48b06bfee016-cert podName:60daec24-40fb-4ec9-bd38-48b06bfee016 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:53.229456254 +0000 UTC m=+35.582281368 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/60daec24-40fb-4ec9-bd38-48b06bfee016-cert") pod "ingress-canary-m4795" (UID: "60daec24-40fb-4ec9-bd38-48b06bfee016") : secret "canary-serving-cert" not found May 27 14:05:52.229797 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:52.229487 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-tls podName:cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:53.229472647 +0000 UTC m=+35.582297762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-tls") pod "image-registry-76bb57545c-bt9qt" (UID: "cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1") : secret "image-registry-tls" not found May 27 14:05:52.258519 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:52.258486 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:05:52.258664 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:52.258533 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4nn5w" May 27 14:05:52.261824 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:52.261800 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jlrrx\"" May 27 14:05:52.262077 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:52.262059 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 27 14:05:52.262294 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:52.262280 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 14:05:53.236663 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:53.236634 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59575ced-2733-424b-91f8-04efa7a3d4f3-metrics-tls\") pod \"dns-default-h4llj\" (UID: \"59575ced-2733-424b-91f8-04efa7a3d4f3\") " pod="openshift-dns/dns-default-h4llj" May 27 14:05:53.237008 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:53.236705 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-tls\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:53.237008 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:53.236832 2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 14:05:53.237008 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:53.236847 2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76bb57545c-bt9qt: secret "image-registry-tls" not found May 27 14:05:53.237008 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:53.236860 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60daec24-40fb-4ec9-bd38-48b06bfee016-cert\") pod \"ingress-canary-m4795\" (UID: \"60daec24-40fb-4ec9-bd38-48b06bfee016\") " pod="openshift-ingress-canary/ingress-canary-m4795" May 27 14:05:53.237008 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:53.236893 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-tls podName:cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:55.236879708 +0000 UTC m=+37.589704822 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-tls") pod "image-registry-76bb57545c-bt9qt" (UID: "cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1") : secret "image-registry-tls" not found May 27 14:05:53.237008 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:53.236927 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 14:05:53.237008 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:53.236832 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 14:05:53.237008 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:53.236970 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60daec24-40fb-4ec9-bd38-48b06bfee016-cert podName:60daec24-40fb-4ec9-bd38-48b06bfee016 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:55.236958268 +0000 UTC m=+37.589783382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/60daec24-40fb-4ec9-bd38-48b06bfee016-cert") pod "ingress-canary-m4795" (UID: "60daec24-40fb-4ec9-bd38-48b06bfee016") : secret "canary-serving-cert" not found May 27 14:05:53.237008 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:53.237008 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59575ced-2733-424b-91f8-04efa7a3d4f3-metrics-tls podName:59575ced-2733-424b-91f8-04efa7a3d4f3 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:55.236984656 +0000 UTC m=+37.589809781 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59575ced-2733-424b-91f8-04efa7a3d4f3-metrics-tls") pod "dns-default-h4llj" (UID: "59575ced-2733-424b-91f8-04efa7a3d4f3") : secret "dns-default-metrics-tls" not found May 27 14:05:53.258733 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:53.258697 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:05:53.261870 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:53.261812 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 14:05:53.261982 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:53.261896 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kjqwb\"" May 27 14:05:53.261982 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:53.261945 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 14:05:53.399988 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:53.399956 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qd9xc" event={"ID":"7dce939e-5149-403d-a0b3-5b40c239a8c4","Type":"ContainerStarted","Data":"84beee30b40ace02512d4dd13cf8545a107dd9ad067a90a85021e6edd668c663"} May 27 14:05:54.404411 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:54.404378 2576 generic.go:358] "Generic (PLEG): container finished" podID="7dce939e-5149-403d-a0b3-5b40c239a8c4" containerID="84beee30b40ace02512d4dd13cf8545a107dd9ad067a90a85021e6edd668c663" exitCode=0 May 27 14:05:54.404810 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:54.404435 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qd9xc" event={"ID":"7dce939e-5149-403d-a0b3-5b40c239a8c4","Type":"ContainerDied","Data":"84beee30b40ace02512d4dd13cf8545a107dd9ad067a90a85021e6edd668c663"} May 27 14:05:55.253436 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:55.253397 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59575ced-2733-424b-91f8-04efa7a3d4f3-metrics-tls\") pod \"dns-default-h4llj\" (UID: \"59575ced-2733-424b-91f8-04efa7a3d4f3\") " pod="openshift-dns/dns-default-h4llj" May 27 14:05:55.253604 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:55.253461 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-tls\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:55.253604 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:55.253488 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60daec24-40fb-4ec9-bd38-48b06bfee016-cert\") pod \"ingress-canary-m4795\" (UID: \"60daec24-40fb-4ec9-bd38-48b06bfee016\") " pod="openshift-ingress-canary/ingress-canary-m4795" May 27 14:05:55.253604 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:55.253560 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 14:05:55.253604 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:55.253571 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 14:05:55.253604 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:55.253563 2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 14:05:55.253754 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:55.253616 2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76bb57545c-bt9qt: secret "image-registry-tls" not found May 27 14:05:55.253754 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:55.253625 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59575ced-2733-424b-91f8-04efa7a3d4f3-metrics-tls podName:59575ced-2733-424b-91f8-04efa7a3d4f3 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:59.253607207 +0000 UTC m=+41.606432321 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59575ced-2733-424b-91f8-04efa7a3d4f3-metrics-tls") pod "dns-default-h4llj" (UID: "59575ced-2733-424b-91f8-04efa7a3d4f3") : secret "dns-default-metrics-tls" not found May 27 14:05:55.253754 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:55.253643 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-tls podName:cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:59.253631677 +0000 UTC m=+41.606456791 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-tls") pod "image-registry-76bb57545c-bt9qt" (UID: "cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1") : secret "image-registry-tls" not found May 27 14:05:55.253754 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:55.253655 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60daec24-40fb-4ec9-bd38-48b06bfee016-cert podName:60daec24-40fb-4ec9-bd38-48b06bfee016 nodeName:}" failed. No retries permitted until 2026-05-27 14:05:59.253648541 +0000 UTC m=+41.606473654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/60daec24-40fb-4ec9-bd38-48b06bfee016-cert") pod "ingress-canary-m4795" (UID: "60daec24-40fb-4ec9-bd38-48b06bfee016") : secret "canary-serving-cert" not found May 27 14:05:55.408680 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:55.408645 2576 generic.go:358] "Generic (PLEG): container finished" podID="7dce939e-5149-403d-a0b3-5b40c239a8c4" containerID="e145def8d66b963a25e78aae7ac1a426892f0847989f86c68dff1954d1c1b1e7" exitCode=0 May 27 14:05:55.409120 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:55.408696 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qd9xc" event={"ID":"7dce939e-5149-403d-a0b3-5b40c239a8c4","Type":"ContainerDied","Data":"e145def8d66b963a25e78aae7ac1a426892f0847989f86c68dff1954d1c1b1e7"} May 27 14:05:56.413279 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:56.413098 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qd9xc" event={"ID":"7dce939e-5149-403d-a0b3-5b40c239a8c4","Type":"ContainerStarted","Data":"d30efdaa16a24b6bd1f07650b02c1ae04deb18eaea235bc049400a876edc690e"} May 27 14:05:56.439567 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:56.439521 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qd9xc" podStartSLOduration=6.175938072 podStartE2EDuration="38.439504929s" podCreationTimestamp="2026-05-27 14:05:18 +0000 UTC" firstStartedPulling="2026-05-27 14:05:20.933460337 +0000 UTC m=+3.286285454" lastFinishedPulling="2026-05-27 14:05:53.197027196 +0000 UTC m=+35.549852311" observedRunningTime="2026-05-27 14:05:56.437831376 +0000 UTC m=+38.790656511" watchObservedRunningTime="2026-05-27 14:05:56.439504929 +0000 UTC m=+38.792330068" May 27 14:05:59.282049 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:59.282002 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59575ced-2733-424b-91f8-04efa7a3d4f3-metrics-tls\") pod \"dns-default-h4llj\" (UID: \"59575ced-2733-424b-91f8-04efa7a3d4f3\") " pod="openshift-dns/dns-default-h4llj" May 27 14:05:59.282484 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:59.282082 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-tls\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:05:59.282484 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:59.282118 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60daec24-40fb-4ec9-bd38-48b06bfee016-cert\") pod \"ingress-canary-m4795\" (UID: \"60daec24-40fb-4ec9-bd38-48b06bfee016\") " pod="openshift-ingress-canary/ingress-canary-m4795" May 27 14:05:59.282484 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:59.282162 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 14:05:59.282484 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:59.282203 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 14:05:59.282484 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:59.282216 2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 14:05:59.282484 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:59.282233 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59575ced-2733-424b-91f8-04efa7a3d4f3-metrics-tls podName:59575ced-2733-424b-91f8-04efa7a3d4f3 nodeName:}" failed. No retries permitted until 2026-05-27 14:06:07.282214228 +0000 UTC m=+49.635039359 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59575ced-2733-424b-91f8-04efa7a3d4f3-metrics-tls") pod "dns-default-h4llj" (UID: "59575ced-2733-424b-91f8-04efa7a3d4f3") : secret "dns-default-metrics-tls" not found May 27 14:05:59.282484 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:59.282234 2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76bb57545c-bt9qt: secret "image-registry-tls" not found May 27 14:05:59.282484 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:59.282251 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60daec24-40fb-4ec9-bd38-48b06bfee016-cert podName:60daec24-40fb-4ec9-bd38-48b06bfee016 nodeName:}" failed. No retries permitted until 2026-05-27 14:06:07.282242911 +0000 UTC m=+49.635068040 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/60daec24-40fb-4ec9-bd38-48b06bfee016-cert") pod "ingress-canary-m4795" (UID: "60daec24-40fb-4ec9-bd38-48b06bfee016") : secret "canary-serving-cert" not found May 27 14:05:59.282484 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:05:59.282284 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-tls podName:cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1 nodeName:}" failed. No retries permitted until 2026-05-27 14:06:07.282268726 +0000 UTC m=+49.635093840 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-tls") pod "image-registry-76bb57545c-bt9qt" (UID: "cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1") : secret "image-registry-tls" not found May 27 14:05:59.398356 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:59.398307 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-bc884"] May 27 14:05:59.425095 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:59.425068 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-bc884"] May 27 14:05:59.425233 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:59.425195 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bc884" May 27 14:05:59.429807 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:59.429784 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 27 14:05:59.429925 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:59.429824 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-sllx8\"" May 27 14:05:59.431572 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:59.431552 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 27 14:05:59.585382 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:59.585298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w475k\" (UniqueName: \"kubernetes.io/projected/359794b7-1c6c-41e8-8bea-f8bdfe0860db-kube-api-access-w475k\") pod \"migrator-b985f5d89-bc884\" (UID: \"359794b7-1c6c-41e8-8bea-f8bdfe0860db\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bc884" May 27 14:05:59.685921 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:59.685872 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w475k\" (UniqueName: \"kubernetes.io/projected/359794b7-1c6c-41e8-8bea-f8bdfe0860db-kube-api-access-w475k\") pod \"migrator-b985f5d89-bc884\" (UID: \"359794b7-1c6c-41e8-8bea-f8bdfe0860db\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bc884" May 27 14:05:59.694727 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:59.694692 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w475k\" (UniqueName: \"kubernetes.io/projected/359794b7-1c6c-41e8-8bea-f8bdfe0860db-kube-api-access-w475k\") pod \"migrator-b985f5d89-bc884\" (UID: \"359794b7-1c6c-41e8-8bea-f8bdfe0860db\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bc884" May 27 14:05:59.706963 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:59.706936 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cgjjd_948632b3-b439-4e9b-ab4c-8f29cce2643a/dns-node-resolver/0.log" May 27 14:05:59.734105 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:59.734082 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bc884" May 27 14:05:59.908374 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:05:59.908340 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-bc884"] May 27 14:05:59.911449 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:05:59.911422 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod359794b7_1c6c_41e8_8bea_f8bdfe0860db.slice/crio-6bf1bb56a7adc1b098e7decdb109f26d200e395853f72bf86cb993c0d79f50ab WatchSource:0}: Error finding container 6bf1bb56a7adc1b098e7decdb109f26d200e395853f72bf86cb993c0d79f50ab: Status 404 returned error can't find the container with id 6bf1bb56a7adc1b098e7decdb109f26d200e395853f72bf86cb993c0d79f50ab May 27 14:06:00.088662 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.088619 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/289d47a1-b316-4f03-a8d7-617598d6bef1-original-pull-secret\") pod \"global-pull-secret-syncer-4nn5w\" (UID: \"289d47a1-b316-4f03-a8d7-617598d6bef1\") " pod="kube-system/global-pull-secret-syncer-4nn5w" May 27 14:06:00.091040 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.091010 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/289d47a1-b316-4f03-a8d7-617598d6bef1-original-pull-secret\") pod \"global-pull-secret-syncer-4nn5w\" (UID: \"289d47a1-b316-4f03-a8d7-617598d6bef1\") " pod="kube-system/global-pull-secret-syncer-4nn5w" May 27 14:06:00.099211 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.099155 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-dcc2t"] May 27 14:06:00.131891 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.131864 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-dcc2t"] May 27 14:06:00.132025 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.131995 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-dcc2t" May 27 14:06:00.135264 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.135236 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 27 14:06:00.136539 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.136514 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 27 14:06:00.136662 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.136541 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 27 14:06:00.136662 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.136605 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 27 14:06:00.136814 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.136799 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mm799\"" May 27 14:06:00.290458 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.290420 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/48c5fbef-7bdd-4127-8d63-b3ee2e376b21-signing-key\") pod \"service-ca-67d667c7d-dcc2t\" (UID: \"48c5fbef-7bdd-4127-8d63-b3ee2e376b21\") " pod="openshift-service-ca/service-ca-67d667c7d-dcc2t" May 27 14:06:00.290458 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.290455 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/48c5fbef-7bdd-4127-8d63-b3ee2e376b21-signing-cabundle\") pod \"service-ca-67d667c7d-dcc2t\" (UID: \"48c5fbef-7bdd-4127-8d63-b3ee2e376b21\") " pod="openshift-service-ca/service-ca-67d667c7d-dcc2t" May 27 14:06:00.290890 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.290569 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmjdq\" (UniqueName: \"kubernetes.io/projected/48c5fbef-7bdd-4127-8d63-b3ee2e376b21-kube-api-access-gmjdq\") pod \"service-ca-67d667c7d-dcc2t\" (UID: \"48c5fbef-7bdd-4127-8d63-b3ee2e376b21\") " pod="openshift-service-ca/service-ca-67d667c7d-dcc2t" May 27 14:06:00.375749 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.375676 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4nn5w" May 27 14:06:00.391634 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.391602 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/48c5fbef-7bdd-4127-8d63-b3ee2e376b21-signing-key\") pod \"service-ca-67d667c7d-dcc2t\" (UID: \"48c5fbef-7bdd-4127-8d63-b3ee2e376b21\") " pod="openshift-service-ca/service-ca-67d667c7d-dcc2t" May 27 14:06:00.391763 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.391649 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/48c5fbef-7bdd-4127-8d63-b3ee2e376b21-signing-cabundle\") pod \"service-ca-67d667c7d-dcc2t\" (UID: \"48c5fbef-7bdd-4127-8d63-b3ee2e376b21\") " pod="openshift-service-ca/service-ca-67d667c7d-dcc2t" May 27 14:06:00.391763 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.391723 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmjdq\" (UniqueName: \"kubernetes.io/projected/48c5fbef-7bdd-4127-8d63-b3ee2e376b21-kube-api-access-gmjdq\") pod \"service-ca-67d667c7d-dcc2t\" (UID: \"48c5fbef-7bdd-4127-8d63-b3ee2e376b21\") " pod="openshift-service-ca/service-ca-67d667c7d-dcc2t" May 27 14:06:00.392370 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.392345 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/48c5fbef-7bdd-4127-8d63-b3ee2e376b21-signing-cabundle\") pod \"service-ca-67d667c7d-dcc2t\" (UID: \"48c5fbef-7bdd-4127-8d63-b3ee2e376b21\") " pod="openshift-service-ca/service-ca-67d667c7d-dcc2t" May 27 14:06:00.393963 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.393938 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/48c5fbef-7bdd-4127-8d63-b3ee2e376b21-signing-key\") pod \"service-ca-67d667c7d-dcc2t\" (UID: \"48c5fbef-7bdd-4127-8d63-b3ee2e376b21\") " pod="openshift-service-ca/service-ca-67d667c7d-dcc2t" May 27 14:06:00.401349 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.401310 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmjdq\" (UniqueName: \"kubernetes.io/projected/48c5fbef-7bdd-4127-8d63-b3ee2e376b21-kube-api-access-gmjdq\") pod \"service-ca-67d667c7d-dcc2t\" (UID: \"48c5fbef-7bdd-4127-8d63-b3ee2e376b21\") " pod="openshift-service-ca/service-ca-67d667c7d-dcc2t" May 27 14:06:00.421483 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.421446 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bc884" event={"ID":"359794b7-1c6c-41e8-8bea-f8bdfe0860db","Type":"ContainerStarted","Data":"6bf1bb56a7adc1b098e7decdb109f26d200e395853f72bf86cb993c0d79f50ab"} May 27 14:06:00.447344 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.440675 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-dcc2t" May 27 14:06:00.505989 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.505957 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4nn5w"] May 27 14:06:00.508992 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:06:00.508965 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod289d47a1_b316_4f03_a8d7_617598d6bef1.slice/crio-73049cd6ce3c66942863b57185e1b61515585d16ef301d130760ce547accd429 WatchSource:0}: Error finding container 73049cd6ce3c66942863b57185e1b61515585d16ef301d130760ce547accd429: Status 404 returned error can't find the container with id 73049cd6ce3c66942863b57185e1b61515585d16ef301d130760ce547accd429 May 27 14:06:00.580431 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.580397 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-dcc2t"] May 27 14:06:00.583955 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:06:00.583925 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48c5fbef_7bdd_4127_8d63_b3ee2e376b21.slice/crio-fd413a4cb13d323c9cceb5c44ad9a0a3709713493a13ab11920249e8eb70a55f WatchSource:0}: Error finding container fd413a4cb13d323c9cceb5c44ad9a0a3709713493a13ab11920249e8eb70a55f: Status 404 returned error can't find the container with id fd413a4cb13d323c9cceb5c44ad9a0a3709713493a13ab11920249e8eb70a55f May 27 14:06:00.708146 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:00.708058 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d6zwm_0f1c91f4-dd6f-49db-9f83-6fcc448f06f3/node-ca/0.log" May 27 14:06:01.425104 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:01.425064 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-dcc2t" event={"ID":"48c5fbef-7bdd-4127-8d63-b3ee2e376b21","Type":"ContainerStarted","Data":"fd413a4cb13d323c9cceb5c44ad9a0a3709713493a13ab11920249e8eb70a55f"} May 27 14:06:01.426111 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:01.426086 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4nn5w" event={"ID":"289d47a1-b316-4f03-a8d7-617598d6bef1","Type":"ContainerStarted","Data":"73049cd6ce3c66942863b57185e1b61515585d16ef301d130760ce547accd429"} May 27 14:06:02.430164 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:02.430125 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bc884" event={"ID":"359794b7-1c6c-41e8-8bea-f8bdfe0860db","Type":"ContainerStarted","Data":"6f86c506fccf8a4791a273ea92eae111f50d159ef2cc9fb5bdbba2474143ca85"} May 27 14:06:02.430164 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:02.430171 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bc884" event={"ID":"359794b7-1c6c-41e8-8bea-f8bdfe0860db","Type":"ContainerStarted","Data":"d2c5204b4eadc451b063e122e6457ec260d4c93f9d3068fa3f87c3146745dbef"} May 27 14:06:02.448027 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:02.447982 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-bc884" podStartSLOduration=2.025993888 podStartE2EDuration="3.447969503s" podCreationTimestamp="2026-05-27 14:05:59 +0000 UTC" firstStartedPulling="2026-05-27 14:05:59.913844668 +0000 UTC m=+42.266669782" lastFinishedPulling="2026-05-27 14:06:01.335820269 +0000 UTC m=+43.688645397" observedRunningTime="2026-05-27 14:06:02.446627159 +0000 UTC m=+44.799452297" watchObservedRunningTime="2026-05-27 14:06:02.447969503 +0000 UTC m=+44.800794633" May 27 14:06:05.441879 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:05.441850 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-dcc2t" event={"ID":"48c5fbef-7bdd-4127-8d63-b3ee2e376b21","Type":"ContainerStarted","Data":"f65690a1d08294c0f4fc7b69a86fe60d39bf00923195fc0108b1926ba5f6c186"} May 27 14:06:05.469737 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:05.469686 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-dcc2t" podStartSLOduration=1.015921406 podStartE2EDuration="5.469669337s" podCreationTimestamp="2026-05-27 14:06:00 +0000 UTC" firstStartedPulling="2026-05-27 14:06:00.586176528 +0000 UTC m=+42.939001643" lastFinishedPulling="2026-05-27 14:06:05.039924459 +0000 UTC m=+47.392749574" observedRunningTime="2026-05-27 14:06:05.468960521 +0000 UTC m=+47.821785658" watchObservedRunningTime="2026-05-27 14:06:05.469669337 +0000 UTC m=+47.822494473" May 27 14:06:06.446101 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:06.446049 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4nn5w" event={"ID":"289d47a1-b316-4f03-a8d7-617598d6bef1","Type":"ContainerStarted","Data":"ff6bfb3451b7f2a0d11a650039f05b35fc5df69ac35e8638cb95ba0081ebe0c9"} May 27 14:06:06.501563 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:06.501506 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4nn5w" podStartSLOduration=17.602958714 podStartE2EDuration="22.501487935s" podCreationTimestamp="2026-05-27 14:05:44 +0000 UTC" firstStartedPulling="2026-05-27 14:06:00.510910569 +0000 UTC m=+42.863735697" lastFinishedPulling="2026-05-27 14:06:05.409439793 +0000 UTC m=+47.762264918" observedRunningTime="2026-05-27 14:06:06.485430591 +0000 UTC m=+48.838255729" watchObservedRunningTime="2026-05-27 14:06:06.501487935 +0000 UTC m=+48.854313075" May 27 14:06:07.343383 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:07.343337 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60daec24-40fb-4ec9-bd38-48b06bfee016-cert\") pod \"ingress-canary-m4795\" (UID: \"60daec24-40fb-4ec9-bd38-48b06bfee016\") " pod="openshift-ingress-canary/ingress-canary-m4795" May 27 14:06:07.343549 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:07.343414 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59575ced-2733-424b-91f8-04efa7a3d4f3-metrics-tls\") pod \"dns-default-h4llj\" (UID: \"59575ced-2733-424b-91f8-04efa7a3d4f3\") " pod="openshift-dns/dns-default-h4llj" May 27 14:06:07.343549 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:07.343456 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-tls\") pod \"image-registry-76bb57545c-bt9qt\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:06:07.343549 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:06:07.343480 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 14:06:07.343651 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:06:07.343547 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 14:06:07.343651 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:06:07.343556 2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 14:06:07.343651 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:06:07.343568 2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76bb57545c-bt9qt: secret "image-registry-tls" not found May 27 14:06:07.343651 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:06:07.343559 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60daec24-40fb-4ec9-bd38-48b06bfee016-cert podName:60daec24-40fb-4ec9-bd38-48b06bfee016 nodeName:}" failed. No retries permitted until 2026-05-27 14:06:23.343538715 +0000 UTC m=+65.696363843 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/60daec24-40fb-4ec9-bd38-48b06bfee016-cert") pod "ingress-canary-m4795" (UID: "60daec24-40fb-4ec9-bd38-48b06bfee016") : secret "canary-serving-cert" not found May 27 14:06:07.343651 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:06:07.343619 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59575ced-2733-424b-91f8-04efa7a3d4f3-metrics-tls podName:59575ced-2733-424b-91f8-04efa7a3d4f3 nodeName:}" failed. No retries permitted until 2026-05-27 14:06:23.343607688 +0000 UTC m=+65.696432802 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59575ced-2733-424b-91f8-04efa7a3d4f3-metrics-tls") pod "dns-default-h4llj" (UID: "59575ced-2733-424b-91f8-04efa7a3d4f3") : secret "dns-default-metrics-tls" not found May 27 14:06:07.343651 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:06:07.343629 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-tls podName:cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1 nodeName:}" failed. No retries permitted until 2026-05-27 14:06:23.343623316 +0000 UTC m=+65.696448430 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-tls") pod "image-registry-76bb57545c-bt9qt" (UID: "cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1") : secret "image-registry-tls" not found May 27 14:06:16.400139 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:16.400110 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wd4m8" May 27 14:06:21.056367 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.056319 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d865d9df9-gx6rt"] May 27 14:06:21.060587 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.060568 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d865d9df9-gx6rt" May 27 14:06:21.064562 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.064541 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 27 14:06:21.064788 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.064773 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 27 14:06:21.066229 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.066206 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 27 14:06:21.066878 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.066856 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 27 14:06:21.067826 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.067809 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9d7c5f7b-f9ktk"] May 27 14:06:21.070474 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.070460 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9d7c5f7b-f9ktk" May 27 14:06:21.073981 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.073966 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 27 14:06:21.076973 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.076956 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-5gx25\"" May 27 14:06:21.086197 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.086181 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d865d9df9-gx6rt"] May 27 14:06:21.087183 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.087163 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9d7c5f7b-f9ktk"] May 27 14:06:21.154129 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.154098 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/035fb20f-7857-43ed-88b0-880dea582600-tmp\") pod \"klusterlet-addon-workmgr-d865d9df9-gx6rt\" (UID: \"035fb20f-7857-43ed-88b0-880dea582600\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d865d9df9-gx6rt" May 27 14:06:21.154267 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.154133 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cflv\" (UniqueName: \"kubernetes.io/projected/035fb20f-7857-43ed-88b0-880dea582600-kube-api-access-9cflv\") pod \"klusterlet-addon-workmgr-d865d9df9-gx6rt\" (UID: \"035fb20f-7857-43ed-88b0-880dea582600\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d865d9df9-gx6rt" May 27 14:06:21.154267 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.154179 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/28f0d06a-4a7b-4eed-a047-d2a9716c4ee4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b9d7c5f7b-f9ktk\" (UID: \"28f0d06a-4a7b-4eed-a047-d2a9716c4ee4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9d7c5f7b-f9ktk" May 27 14:06:21.154267 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.154204 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfrgv\" (UniqueName: \"kubernetes.io/projected/28f0d06a-4a7b-4eed-a047-d2a9716c4ee4-kube-api-access-zfrgv\") pod \"managed-serviceaccount-addon-agent-7b9d7c5f7b-f9ktk\" (UID: \"28f0d06a-4a7b-4eed-a047-d2a9716c4ee4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9d7c5f7b-f9ktk" May 27 14:06:21.154267 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.154228 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/035fb20f-7857-43ed-88b0-880dea582600-klusterlet-config\") pod \"klusterlet-addon-workmgr-d865d9df9-gx6rt\" (UID: \"035fb20f-7857-43ed-88b0-880dea582600\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d865d9df9-gx6rt" May 27 14:06:21.236543 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.236519 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-74t66"] May 27 14:06:21.239595 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.239576 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-74t66" May 27 14:06:21.242719 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:06:21.242694 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-141-132.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-141-132.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" May 27 14:06:21.242798 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:06:21.242698 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-141-132.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-141-132.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" May 27 14:06:21.242970 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.242941 2576 status_manager.go:895] "Failed to get status for pod" podUID="e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710" pod="openshift-insights/insights-runtime-extractor-74t66" err="pods \"insights-runtime-extractor-74t66\" is forbidden: User \"system:node:ip-10-0-141-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-141-132.ec2.internal' and this object" May 27 14:06:21.243217 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:06:21.243198 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-141-132.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-141-132.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" May 27 14:06:21.243259 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:06:21.243238 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-sa-dockercfg-6zlr5\" is forbidden: User \"system:node:ip-10-0-141-132.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-141-132.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6zlr5\"" type="*v1.Secret" May 27 14:06:21.243431 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:06:21.243413 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-141-132.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-141-132.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" May 27 14:06:21.254738 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.254718 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/035fb20f-7857-43ed-88b0-880dea582600-tmp\") pod \"klusterlet-addon-workmgr-d865d9df9-gx6rt\" (UID: \"035fb20f-7857-43ed-88b0-880dea582600\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d865d9df9-gx6rt" May 27 14:06:21.254833 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.254744 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9cflv\" (UniqueName: \"kubernetes.io/projected/035fb20f-7857-43ed-88b0-880dea582600-kube-api-access-9cflv\") pod \"klusterlet-addon-workmgr-d865d9df9-gx6rt\" (UID: \"035fb20f-7857-43ed-88b0-880dea582600\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d865d9df9-gx6rt" May 27 14:06:21.254905 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.254887 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/28f0d06a-4a7b-4eed-a047-d2a9716c4ee4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b9d7c5f7b-f9ktk\" (UID: \"28f0d06a-4a7b-4eed-a047-d2a9716c4ee4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9d7c5f7b-f9ktk" May 27 14:06:21.254951 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.254923 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zfrgv\" (UniqueName: \"kubernetes.io/projected/28f0d06a-4a7b-4eed-a047-d2a9716c4ee4-kube-api-access-zfrgv\") pod \"managed-serviceaccount-addon-agent-7b9d7c5f7b-f9ktk\" (UID: \"28f0d06a-4a7b-4eed-a047-d2a9716c4ee4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9d7c5f7b-f9ktk" May 27 14:06:21.255006 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.254950 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/035fb20f-7857-43ed-88b0-880dea582600-klusterlet-config\") pod \"klusterlet-addon-workmgr-d865d9df9-gx6rt\" (UID: \"035fb20f-7857-43ed-88b0-880dea582600\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d865d9df9-gx6rt" May 27 14:06:21.255083 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.255062 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/035fb20f-7857-43ed-88b0-880dea582600-tmp\") pod \"klusterlet-addon-workmgr-d865d9df9-gx6rt\" (UID: \"035fb20f-7857-43ed-88b0-880dea582600\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d865d9df9-gx6rt" May 27 14:06:21.255676 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.255658 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-74t66"] May 27 14:06:21.257371 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.257237 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/28f0d06a-4a7b-4eed-a047-d2a9716c4ee4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b9d7c5f7b-f9ktk\" (UID: \"28f0d06a-4a7b-4eed-a047-d2a9716c4ee4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9d7c5f7b-f9ktk" May 27 14:06:21.257685 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.257661 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/035fb20f-7857-43ed-88b0-880dea582600-klusterlet-config\") pod \"klusterlet-addon-workmgr-d865d9df9-gx6rt\" (UID: \"035fb20f-7857-43ed-88b0-880dea582600\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d865d9df9-gx6rt" May 27 14:06:21.281217 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.281189 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-4gvg6"] May 27 14:06:21.284241 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.284225 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-4gvg6" May 27 14:06:21.285276 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.285255 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cflv\" (UniqueName: \"kubernetes.io/projected/035fb20f-7857-43ed-88b0-880dea582600-kube-api-access-9cflv\") pod \"klusterlet-addon-workmgr-d865d9df9-gx6rt\" (UID: \"035fb20f-7857-43ed-88b0-880dea582600\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d865d9df9-gx6rt" May 27 14:06:21.288765 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.288737 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfrgv\" (UniqueName: \"kubernetes.io/projected/28f0d06a-4a7b-4eed-a047-d2a9716c4ee4-kube-api-access-zfrgv\") pod \"managed-serviceaccount-addon-agent-7b9d7c5f7b-f9ktk\" (UID: \"28f0d06a-4a7b-4eed-a047-d2a9716c4ee4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9d7c5f7b-f9ktk" May 27 14:06:21.297931 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.297914 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 27 14:06:21.298047 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.297982 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 27 14:06:21.298137 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.298124 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-tx4vw\"" May 27 14:06:21.310026 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.309979 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-4gvg6"] May 27 14:06:21.317534 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.317511 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76bb57545c-bt9qt"] May 27 14:06:21.317691 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:06:21.317673 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" podUID="cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1" May 27 14:06:21.355605 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.355579 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710-crio-socket\") pod \"insights-runtime-extractor-74t66\" (UID: \"e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710\") " pod="openshift-insights/insights-runtime-extractor-74t66" May 27 14:06:21.355723 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.355612 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74t66\" (UID: \"e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710\") " pod="openshift-insights/insights-runtime-extractor-74t66" May 27 14:06:21.355723 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.355634 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710-data-volume\") pod \"insights-runtime-extractor-74t66\" (UID: \"e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710\") " pod="openshift-insights/insights-runtime-extractor-74t66" May 27 14:06:21.355804 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.355730 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hdzj\" (UniqueName: \"kubernetes.io/projected/26c67875-8892-4213-ac40-1cbd327af5d2-kube-api-access-2hdzj\") pod \"downloads-57bd96b888-4gvg6\" (UID: \"26c67875-8892-4213-ac40-1cbd327af5d2\") " pod="openshift-console/downloads-57bd96b888-4gvg6" May 27 14:06:21.355804 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.355782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bc7t\" (UniqueName: \"kubernetes.io/projected/e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710-kube-api-access-2bc7t\") pod \"insights-runtime-extractor-74t66\" (UID: \"e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710\") " pod="openshift-insights/insights-runtime-extractor-74t66" May 27 14:06:21.355877 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.355833 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74t66\" (UID: \"e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710\") " pod="openshift-insights/insights-runtime-extractor-74t66" May 27 14:06:21.369605 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.369583 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d865d9df9-gx6rt" May 27 14:06:21.393455 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.393430 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9d7c5f7b-f9ktk" May 27 14:06:21.395227 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.395202 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f7d4789c6-b8lwr"] May 27 14:06:21.399493 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.399473 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.416040 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.416017 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f7d4789c6-b8lwr"] May 27 14:06:21.456576 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.456528 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/51fef4bf-a781-4a70-abb7-69f09f1b2e02-image-registry-private-configuration\") pod \"image-registry-f7d4789c6-b8lwr\" (UID: \"51fef4bf-a781-4a70-abb7-69f09f1b2e02\") " pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.456704 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.456638 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/51fef4bf-a781-4a70-abb7-69f09f1b2e02-trusted-ca\") pod \"image-registry-f7d4789c6-b8lwr\" (UID: \"51fef4bf-a781-4a70-abb7-69f09f1b2e02\") " pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.456704 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.456690 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2hdzj\" (UniqueName: \"kubernetes.io/projected/26c67875-8892-4213-ac40-1cbd327af5d2-kube-api-access-2hdzj\") pod \"downloads-57bd96b888-4gvg6\" (UID: \"26c67875-8892-4213-ac40-1cbd327af5d2\") " pod="openshift-console/downloads-57bd96b888-4gvg6" May 27 14:06:21.456823 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.456732 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/51fef4bf-a781-4a70-abb7-69f09f1b2e02-registry-tls\") pod \"image-registry-f7d4789c6-b8lwr\" (UID: \"51fef4bf-a781-4a70-abb7-69f09f1b2e02\") " pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.456823 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.456769 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/51fef4bf-a781-4a70-abb7-69f09f1b2e02-registry-certificates\") pod \"image-registry-f7d4789c6-b8lwr\" (UID: \"51fef4bf-a781-4a70-abb7-69f09f1b2e02\") " pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.456937 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.456822 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcw56\" (UniqueName: \"kubernetes.io/projected/51fef4bf-a781-4a70-abb7-69f09f1b2e02-kube-api-access-jcw56\") pod \"image-registry-f7d4789c6-b8lwr\" (UID: \"51fef4bf-a781-4a70-abb7-69f09f1b2e02\") " pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.456937 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.456861 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bc7t\" (UniqueName: \"kubernetes.io/projected/e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710-kube-api-access-2bc7t\") pod \"insights-runtime-extractor-74t66\" (UID: \"e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710\") " pod="openshift-insights/insights-runtime-extractor-74t66" May 27 14:06:21.456937 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.456907 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74t66\" (UID: \"e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710\") " pod="openshift-insights/insights-runtime-extractor-74t66" May 27 14:06:21.457096 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.456946 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/51fef4bf-a781-4a70-abb7-69f09f1b2e02-ca-trust-extracted\") pod \"image-registry-f7d4789c6-b8lwr\" (UID: \"51fef4bf-a781-4a70-abb7-69f09f1b2e02\") " pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.457096 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.456977 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710-crio-socket\") pod \"insights-runtime-extractor-74t66\" (UID: \"e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710\") " pod="openshift-insights/insights-runtime-extractor-74t66" May 27 14:06:21.457096 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.457007 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74t66\" (UID: \"e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710\") " pod="openshift-insights/insights-runtime-extractor-74t66" May 27 14:06:21.457096 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.457035 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/51fef4bf-a781-4a70-abb7-69f09f1b2e02-bound-sa-token\") pod \"image-registry-f7d4789c6-b8lwr\" (UID: \"51fef4bf-a781-4a70-abb7-69f09f1b2e02\") " pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.457096 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.457068 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710-data-volume\") pod \"insights-runtime-extractor-74t66\" (UID: \"e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710\") " pod="openshift-insights/insights-runtime-extractor-74t66" May 27 14:06:21.457393 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.457103 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/51fef4bf-a781-4a70-abb7-69f09f1b2e02-installation-pull-secrets\") pod \"image-registry-f7d4789c6-b8lwr\" (UID: \"51fef4bf-a781-4a70-abb7-69f09f1b2e02\") " pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.458402 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.457868 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710-crio-socket\") pod \"insights-runtime-extractor-74t66\" (UID: \"e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710\") " pod="openshift-insights/insights-runtime-extractor-74t66" May 27 14:06:21.458402 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.458251 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710-data-volume\") pod \"insights-runtime-extractor-74t66\" (UID: \"e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710\") " pod="openshift-insights/insights-runtime-extractor-74t66" May 27 14:06:21.471347 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.471059 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hdzj\" (UniqueName: \"kubernetes.io/projected/26c67875-8892-4213-ac40-1cbd327af5d2-kube-api-access-2hdzj\") pod \"downloads-57bd96b888-4gvg6\" (UID: \"26c67875-8892-4213-ac40-1cbd327af5d2\") " pod="openshift-console/downloads-57bd96b888-4gvg6" May 27 14:06:21.474262 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.474242 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:06:21.479260 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.479214 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:06:21.506303 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.506272 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d865d9df9-gx6rt"] May 27 14:06:21.508862 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:06:21.508823 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod035fb20f_7857_43ed_88b0_880dea582600.slice/crio-6a5682ec6fc28fb608c18634b4d0f4088979ea299a6f8131e3d95d5e1ecacebe WatchSource:0}: Error finding container 6a5682ec6fc28fb608c18634b4d0f4088979ea299a6f8131e3d95d5e1ecacebe: Status 404 returned error can't find the container with id 6a5682ec6fc28fb608c18634b4d0f4088979ea299a6f8131e3d95d5e1ecacebe May 27 14:06:21.522778 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.522737 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9d7c5f7b-f9ktk"] May 27 14:06:21.524975 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:06:21.524953 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28f0d06a_4a7b_4eed_a047_d2a9716c4ee4.slice/crio-fd7d48994f9fad2318d2431376754fe59654e79c3f33a55ac513be3191c2282d WatchSource:0}: Error finding container fd7d48994f9fad2318d2431376754fe59654e79c3f33a55ac513be3191c2282d: Status 404 returned error can't find the container with id fd7d48994f9fad2318d2431376754fe59654e79c3f33a55ac513be3191c2282d May 27 14:06:21.558193 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.558172 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-installation-pull-secrets\") pod \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " May 27 14:06:21.558281 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.558202 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmqkf\" (UniqueName: \"kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-kube-api-access-pmqkf\") pod \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " May 27 14:06:21.558281 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.558228 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-image-registry-private-configuration\") pod \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " May 27 14:06:21.558281 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.558267 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-trusted-ca\") pod \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " May 27 14:06:21.558463 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.558303 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-bound-sa-token\") pod \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " May 27 14:06:21.558463 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.558338 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-ca-trust-extracted\") pod \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " May 27 14:06:21.558463 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.558366 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-certificates\") pod \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\" (UID: \"cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1\") " May 27 14:06:21.558463 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.558437 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/51fef4bf-a781-4a70-abb7-69f09f1b2e02-registry-tls\") pod \"image-registry-f7d4789c6-b8lwr\" (UID: \"51fef4bf-a781-4a70-abb7-69f09f1b2e02\") " pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.558655 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.558472 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/51fef4bf-a781-4a70-abb7-69f09f1b2e02-registry-certificates\") pod \"image-registry-f7d4789c6-b8lwr\" (UID: \"51fef4bf-a781-4a70-abb7-69f09f1b2e02\") " pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.558655 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.558521 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jcw56\" (UniqueName: \"kubernetes.io/projected/51fef4bf-a781-4a70-abb7-69f09f1b2e02-kube-api-access-jcw56\") pod \"image-registry-f7d4789c6-b8lwr\" (UID: \"51fef4bf-a781-4a70-abb7-69f09f1b2e02\") " pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.558655 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.558589 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/51fef4bf-a781-4a70-abb7-69f09f1b2e02-ca-trust-extracted\") pod \"image-registry-f7d4789c6-b8lwr\" (UID: \"51fef4bf-a781-4a70-abb7-69f09f1b2e02\") " pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.558655 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.558624 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/51fef4bf-a781-4a70-abb7-69f09f1b2e02-bound-sa-token\") pod \"image-registry-f7d4789c6-b8lwr\" (UID: \"51fef4bf-a781-4a70-abb7-69f09f1b2e02\") " pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.558655 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.558641 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1" (UID: "cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:06:21.558889 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.558667 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/51fef4bf-a781-4a70-abb7-69f09f1b2e02-installation-pull-secrets\") pod \"image-registry-f7d4789c6-b8lwr\" (UID: \"51fef4bf-a781-4a70-abb7-69f09f1b2e02\") " pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.558889 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.558740 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/51fef4bf-a781-4a70-abb7-69f09f1b2e02-image-registry-private-configuration\") pod \"image-registry-f7d4789c6-b8lwr\" (UID: \"51fef4bf-a781-4a70-abb7-69f09f1b2e02\") " pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.558889 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.558792 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/51fef4bf-a781-4a70-abb7-69f09f1b2e02-trusted-ca\") pod \"image-registry-f7d4789c6-b8lwr\" (UID: \"51fef4bf-a781-4a70-abb7-69f09f1b2e02\") " pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.558889 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.558840 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-ca-trust-extracted\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:06:21.559651 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.559190 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1" (UID: "cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 14:06:21.559748 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.559618 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1" (UID: "cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 14:06:21.560652 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.560403 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/51fef4bf-a781-4a70-abb7-69f09f1b2e02-trusted-ca\") pod \"image-registry-f7d4789c6-b8lwr\" (UID: \"51fef4bf-a781-4a70-abb7-69f09f1b2e02\") " pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.560977 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.560950 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/51fef4bf-a781-4a70-abb7-69f09f1b2e02-registry-certificates\") pod \"image-registry-f7d4789c6-b8lwr\" (UID: \"51fef4bf-a781-4a70-abb7-69f09f1b2e02\") " pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.561075 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.561027 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1" (UID: "cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 14:06:21.561215 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.561180 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-kube-api-access-pmqkf" (OuterVolumeSpecName: "kube-api-access-pmqkf") pod "cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1" (UID: "cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1"). InnerVolumeSpecName "kube-api-access-pmqkf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:06:21.561340 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.561220 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1" (UID: "cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 14:06:21.561340 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.561276 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1" (UID: "cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:06:21.561470 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.561390 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/51fef4bf-a781-4a70-abb7-69f09f1b2e02-ca-trust-extracted\") pod \"image-registry-f7d4789c6-b8lwr\" (UID: \"51fef4bf-a781-4a70-abb7-69f09f1b2e02\") " pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.561544 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.561525 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/51fef4bf-a781-4a70-abb7-69f09f1b2e02-registry-tls\") pod \"image-registry-f7d4789c6-b8lwr\" (UID: \"51fef4bf-a781-4a70-abb7-69f09f1b2e02\") " pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.562026 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.562009 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/51fef4bf-a781-4a70-abb7-69f09f1b2e02-image-registry-private-configuration\") pod \"image-registry-f7d4789c6-b8lwr\" (UID: \"51fef4bf-a781-4a70-abb7-69f09f1b2e02\") " pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.562087 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.562071 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/51fef4bf-a781-4a70-abb7-69f09f1b2e02-installation-pull-secrets\") pod \"image-registry-f7d4789c6-b8lwr\" (UID: \"51fef4bf-a781-4a70-abb7-69f09f1b2e02\") " pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.575775 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.575750 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcw56\" (UniqueName: \"kubernetes.io/projected/51fef4bf-a781-4a70-abb7-69f09f1b2e02-kube-api-access-jcw56\") pod \"image-registry-f7d4789c6-b8lwr\" (UID: \"51fef4bf-a781-4a70-abb7-69f09f1b2e02\") " pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.576281 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.576262 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/51fef4bf-a781-4a70-abb7-69f09f1b2e02-bound-sa-token\") pod \"image-registry-f7d4789c6-b8lwr\" (UID: \"51fef4bf-a781-4a70-abb7-69f09f1b2e02\") " pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.600874 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.600850 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-4gvg6" May 27 14:06:21.660116 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.660089 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-trusted-ca\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:06:21.660116 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.660115 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-bound-sa-token\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:06:21.660293 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.660124 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-certificates\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:06:21.660293 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.660134 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-installation-pull-secrets\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:06:21.660293 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.660143 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmqkf\" (UniqueName: \"kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-kube-api-access-pmqkf\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:06:21.660293 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.660153 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-image-registry-private-configuration\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:06:21.713289 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.713259 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-w599p\"" May 27 14:06:21.720950 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.720925 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:21.722988 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.722964 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-4gvg6"] May 27 14:06:21.726223 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:06:21.726197 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26c67875_8892_4213_ac40_1cbd327af5d2.slice/crio-6f9e347e57d9dd6f4a8d27db57f55f0ffa1bd9371d853e154c527dd1ae0d1810 WatchSource:0}: Error finding container 6f9e347e57d9dd6f4a8d27db57f55f0ffa1bd9371d853e154c527dd1ae0d1810: Status 404 returned error can't find the container with id 6f9e347e57d9dd6f4a8d27db57f55f0ffa1bd9371d853e154c527dd1ae0d1810 May 27 14:06:21.844590 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:21.844526 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f7d4789c6-b8lwr"] May 27 14:06:21.847147 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:06:21.847120 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51fef4bf_a781_4a70_abb7_69f09f1b2e02.slice/crio-58a1205d966f90e76c35dc85141fec4bc7d6a46f5da4401f615e1b49c6b5104f WatchSource:0}: Error finding container 58a1205d966f90e76c35dc85141fec4bc7d6a46f5da4401f615e1b49c6b5104f: Status 404 returned error can't find the container with id 58a1205d966f90e76c35dc85141fec4bc7d6a46f5da4401f615e1b49c6b5104f May 27 14:06:22.296137 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:22.296111 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 27 14:06:22.299179 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:22.299118 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74t66\" (UID: \"e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710\") " pod="openshift-insights/insights-runtime-extractor-74t66" May 27 14:06:22.314735 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:22.314531 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 27 14:06:22.365301 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:22.365092 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 27 14:06:22.375979 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:22.375947 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74t66\" (UID: \"e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710\") " pod="openshift-insights/insights-runtime-extractor-74t66" May 27 14:06:22.393792 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:22.393587 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6zlr5\"" May 27 14:06:22.480310 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:22.479372 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" event={"ID":"51fef4bf-a781-4a70-abb7-69f09f1b2e02","Type":"ContainerStarted","Data":"6a87a1447e51f593fe069112d97376fccdd123e7810fd58c215fbacacaf9df1d"} May 27 14:06:22.480310 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:22.479415 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" event={"ID":"51fef4bf-a781-4a70-abb7-69f09f1b2e02","Type":"ContainerStarted","Data":"58a1205d966f90e76c35dc85141fec4bc7d6a46f5da4401f615e1b49c6b5104f"} May 27 14:06:22.480310 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:22.480252 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:22.482783 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:22.482723 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-4gvg6" event={"ID":"26c67875-8892-4213-ac40-1cbd327af5d2","Type":"ContainerStarted","Data":"6f9e347e57d9dd6f4a8d27db57f55f0ffa1bd9371d853e154c527dd1ae0d1810"} May 27 14:06:22.485073 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:22.485012 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d865d9df9-gx6rt" event={"ID":"035fb20f-7857-43ed-88b0-880dea582600","Type":"ContainerStarted","Data":"6a5682ec6fc28fb608c18634b4d0f4088979ea299a6f8131e3d95d5e1ecacebe"} May 27 14:06:22.489621 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:22.488982 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76bb57545c-bt9qt" May 27 14:06:22.491026 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:22.489908 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9d7c5f7b-f9ktk" event={"ID":"28f0d06a-4a7b-4eed-a047-d2a9716c4ee4","Type":"ContainerStarted","Data":"fd7d48994f9fad2318d2431376754fe59654e79c3f33a55ac513be3191c2282d"} May 27 14:06:22.510354 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:22.507830 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" podStartSLOduration=1.507814399 podStartE2EDuration="1.507814399s" podCreationTimestamp="2026-05-27 14:06:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 14:06:22.50482075 +0000 UTC m=+64.857645887" watchObservedRunningTime="2026-05-27 14:06:22.507814399 +0000 UTC m=+64.860639538" May 27 14:06:22.537840 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:22.537772 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76bb57545c-bt9qt"] May 27 14:06:22.541807 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:22.541760 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-76bb57545c-bt9qt"] May 27 14:06:22.584618 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:22.584385 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 27 14:06:22.592234 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:22.592196 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bc7t\" (UniqueName: \"kubernetes.io/projected/e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710-kube-api-access-2bc7t\") pod \"insights-runtime-extractor-74t66\" (UID: \"e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710\") " pod="openshift-insights/insights-runtime-extractor-74t66" May 27 14:06:22.671956 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:22.671925 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1-registry-tls\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:06:22.748598 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:22.748046 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-74t66" May 27 14:06:22.949430 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:22.949239 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-74t66"] May 27 14:06:23.379022 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:23.378851 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60daec24-40fb-4ec9-bd38-48b06bfee016-cert\") pod \"ingress-canary-m4795\" (UID: \"60daec24-40fb-4ec9-bd38-48b06bfee016\") " pod="openshift-ingress-canary/ingress-canary-m4795" May 27 14:06:23.379022 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:23.378976 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59575ced-2733-424b-91f8-04efa7a3d4f3-metrics-tls\") pod \"dns-default-h4llj\" (UID: \"59575ced-2733-424b-91f8-04efa7a3d4f3\") " pod="openshift-dns/dns-default-h4llj" May 27 14:06:23.381955 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:23.381862 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59575ced-2733-424b-91f8-04efa7a3d4f3-metrics-tls\") pod \"dns-default-h4llj\" (UID: \"59575ced-2733-424b-91f8-04efa7a3d4f3\") " pod="openshift-dns/dns-default-h4llj" May 27 14:06:23.382532 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:23.382505 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60daec24-40fb-4ec9-bd38-48b06bfee016-cert\") pod \"ingress-canary-m4795\" (UID: \"60daec24-40fb-4ec9-bd38-48b06bfee016\") " pod="openshift-ingress-canary/ingress-canary-m4795" May 27 14:06:23.496576 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:23.496539 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-74t66" event={"ID":"e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710","Type":"ContainerStarted","Data":"785bdf651273d77652d2d0136fa337d4f6f62eb528fded76e92f10726564137e"} May 27 14:06:23.496576 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:23.496581 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-74t66" event={"ID":"e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710","Type":"ContainerStarted","Data":"48d9811abb6c232b163969d82868427d2eb2f947af2175ab1664f424c9b3d152"} May 27 14:06:23.621424 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:23.621390 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dcgs8\"" May 27 14:06:23.628343 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:23.628304 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h4llj" May 27 14:06:23.635671 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:23.635440 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rb76g\"" May 27 14:06:23.642232 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:23.642151 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m4795" May 27 14:06:24.085846 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.085795 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-77kzh\" (UniqueName: \"kubernetes.io/projected/6a8d3b41-b8d0-4b23-9658-c239ee121858-kube-api-access-77kzh\") pod \"network-check-target-cr7vm\" (UID: \"6a8d3b41-b8d0-4b23-9658-c239ee121858\") " pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:06:24.086021 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.085861 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1a2947c-37ec-4483-b026-f7d0e5a6365d-metrics-certs\") pod \"network-metrics-daemon-58m9b\" (UID: \"f1a2947c-37ec-4483-b026-f7d0e5a6365d\") " pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:06:24.090874 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.090778 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 14:06:24.091159 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.091138 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 14:06:24.099809 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.099784 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1a2947c-37ec-4483-b026-f7d0e5a6365d-metrics-certs\") pod \"network-metrics-daemon-58m9b\" (UID: \"f1a2947c-37ec-4483-b026-f7d0e5a6365d\") " pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:06:24.100160 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.099982 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 14:06:24.111044 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.110991 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77kzh\" (UniqueName: \"kubernetes.io/projected/6a8d3b41-b8d0-4b23-9658-c239ee121858-kube-api-access-77kzh\") pod \"network-check-target-cr7vm\" (UID: \"6a8d3b41-b8d0-4b23-9658-c239ee121858\") " pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:06:24.129079 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.128846 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f8ff469fd-5d8b9"] May 27 14:06:24.183984 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.183953 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kjqwb\"" May 27 14:06:24.191235 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.191206 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:06:24.213802 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.213780 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f8ff469fd-5d8b9"] May 27 14:06:24.214733 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.213918 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:06:24.218030 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.217798 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 27 14:06:24.218030 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.217859 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 27 14:06:24.218030 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.217896 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 27 14:06:24.218230 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.218057 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 27 14:06:24.218230 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.218225 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7mkr7\"" May 27 14:06:24.219044 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.219019 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 27 14:06:24.262345 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.262284 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1" path="/var/lib/kubelet/pods/cf15b9c5-20e4-43f1-9ed3-45d6ee8d2be1/volumes" May 27 14:06:24.288174 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.288144 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72bd02e1-d71f-4f37-ad52-b3996805f3fd-console-oauth-config\") pod \"console-5f8ff469fd-5d8b9\" (UID: \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\") " pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:06:24.288294 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.288193 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27tnr\" (UniqueName: \"kubernetes.io/projected/72bd02e1-d71f-4f37-ad52-b3996805f3fd-kube-api-access-27tnr\") pod \"console-5f8ff469fd-5d8b9\" (UID: \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\") " pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:06:24.288294 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.288266 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72bd02e1-d71f-4f37-ad52-b3996805f3fd-console-serving-cert\") pod \"console-5f8ff469fd-5d8b9\" (UID: \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\") " pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:06:24.288463 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.288304 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72bd02e1-d71f-4f37-ad52-b3996805f3fd-service-ca\") pod \"console-5f8ff469fd-5d8b9\" (UID: \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\") " pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:06:24.288463 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.288380 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72bd02e1-d71f-4f37-ad52-b3996805f3fd-console-config\") pod \"console-5f8ff469fd-5d8b9\" (UID: \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\") " pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:06:24.288463 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.288411 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72bd02e1-d71f-4f37-ad52-b3996805f3fd-oauth-serving-cert\") pod \"console-5f8ff469fd-5d8b9\" (UID: \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\") " pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:06:24.372650 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.372566 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jlrrx\"" May 27 14:06:24.380602 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.380148 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58m9b" May 27 14:06:24.389233 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.389163 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72bd02e1-d71f-4f37-ad52-b3996805f3fd-console-config\") pod \"console-5f8ff469fd-5d8b9\" (UID: \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\") " pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:06:24.389233 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.389206 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72bd02e1-d71f-4f37-ad52-b3996805f3fd-oauth-serving-cert\") pod \"console-5f8ff469fd-5d8b9\" (UID: \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\") " pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:06:24.389946 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.389284 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72bd02e1-d71f-4f37-ad52-b3996805f3fd-console-oauth-config\") pod \"console-5f8ff469fd-5d8b9\" (UID: \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\") " pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:06:24.389946 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.389337 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-27tnr\" (UniqueName: \"kubernetes.io/projected/72bd02e1-d71f-4f37-ad52-b3996805f3fd-kube-api-access-27tnr\") pod \"console-5f8ff469fd-5d8b9\" (UID: \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\") " pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:06:24.389946 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.389645 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72bd02e1-d71f-4f37-ad52-b3996805f3fd-console-serving-cert\") pod \"console-5f8ff469fd-5d8b9\" (UID: \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\") " pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:06:24.389946 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.389685 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72bd02e1-d71f-4f37-ad52-b3996805f3fd-service-ca\") pod \"console-5f8ff469fd-5d8b9\" (UID: \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\") " pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:06:24.389946 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.389925 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72bd02e1-d71f-4f37-ad52-b3996805f3fd-console-config\") pod \"console-5f8ff469fd-5d8b9\" (UID: \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\") " pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:06:24.390813 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.390765 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72bd02e1-d71f-4f37-ad52-b3996805f3fd-service-ca\") pod \"console-5f8ff469fd-5d8b9\" (UID: \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\") " pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:06:24.391169 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.391104 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72bd02e1-d71f-4f37-ad52-b3996805f3fd-oauth-serving-cert\") pod \"console-5f8ff469fd-5d8b9\" (UID: \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\") " pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:06:24.393488 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.393445 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72bd02e1-d71f-4f37-ad52-b3996805f3fd-console-oauth-config\") pod \"console-5f8ff469fd-5d8b9\" (UID: \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\") " pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:06:24.394575 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.394550 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72bd02e1-d71f-4f37-ad52-b3996805f3fd-console-serving-cert\") pod \"console-5f8ff469fd-5d8b9\" (UID: \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\") " pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:06:24.402186 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.402163 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27tnr\" (UniqueName: \"kubernetes.io/projected/72bd02e1-d71f-4f37-ad52-b3996805f3fd-kube-api-access-27tnr\") pod \"console-5f8ff469fd-5d8b9\" (UID: \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\") " pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:06:24.526183 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:24.526142 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:06:27.390203 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:27.390000 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m4795"] May 27 14:06:27.426823 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:06:27.426748 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60daec24_40fb_4ec9_bd38_48b06bfee016.slice/crio-7158e861a0b024f246effa07e8c119c3cedeb60a65e30b7931da9a29d3036585 WatchSource:0}: Error finding container 7158e861a0b024f246effa07e8c119c3cedeb60a65e30b7931da9a29d3036585: Status 404 returned error can't find the container with id 7158e861a0b024f246effa07e8c119c3cedeb60a65e30b7931da9a29d3036585 May 27 14:06:27.454915 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:27.454843 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h4llj"] May 27 14:06:27.473663 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:06:27.473629 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59575ced_2733_424b_91f8_04efa7a3d4f3.slice/crio-6064a3a078863d3f6e9ca0defa315af3ff7e49711cd64510a64d7c9264418bab WatchSource:0}: Error finding container 6064a3a078863d3f6e9ca0defa315af3ff7e49711cd64510a64d7c9264418bab: Status 404 returned error can't find the container with id 6064a3a078863d3f6e9ca0defa315af3ff7e49711cd64510a64d7c9264418bab May 27 14:06:27.509385 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:27.509353 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h4llj" event={"ID":"59575ced-2733-424b-91f8-04efa7a3d4f3","Type":"ContainerStarted","Data":"6064a3a078863d3f6e9ca0defa315af3ff7e49711cd64510a64d7c9264418bab"} May 27 14:06:27.510978 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:27.510941 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m4795" event={"ID":"60daec24-40fb-4ec9-bd38-48b06bfee016","Type":"ContainerStarted","Data":"7158e861a0b024f246effa07e8c119c3cedeb60a65e30b7931da9a29d3036585"} May 27 14:06:27.513926 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:27.513513 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9d7c5f7b-f9ktk" event={"ID":"28f0d06a-4a7b-4eed-a047-d2a9716c4ee4","Type":"ContainerStarted","Data":"ac3b64caeb7dc9e7c9ca692bed00edf3009a395d92733685a1260c73c9d97de6"} May 27 14:06:27.533494 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:27.532110 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9d7c5f7b-f9ktk" podStartSLOduration=0.885935932 podStartE2EDuration="6.532093834s" podCreationTimestamp="2026-05-27 14:06:21 +0000 UTC" firstStartedPulling="2026-05-27 14:06:21.526846566 +0000 UTC m=+63.879671680" lastFinishedPulling="2026-05-27 14:06:27.173004466 +0000 UTC m=+69.525829582" observedRunningTime="2026-05-27 14:06:27.531726505 +0000 UTC m=+69.884551642" watchObservedRunningTime="2026-05-27 14:06:27.532093834 +0000 UTC m=+69.884918974" May 27 14:06:27.613624 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:27.613503 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-58m9b"] May 27 14:06:27.616558 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:27.616499 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cr7vm"] May 27 14:06:27.617141 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:06:27.617112 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1a2947c_37ec_4483_b026_f7d0e5a6365d.slice/crio-5427695bb234d8795c291c1d23374eb2c24508ebc718b3959229530769b3a544 WatchSource:0}: Error finding container 5427695bb234d8795c291c1d23374eb2c24508ebc718b3959229530769b3a544: Status 404 returned error can't find the container with id 5427695bb234d8795c291c1d23374eb2c24508ebc718b3959229530769b3a544 May 27 14:06:27.617624 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:27.617603 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f8ff469fd-5d8b9"] May 27 14:06:27.621784 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:06:27.621728 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a8d3b41_b8d0_4b23_9658_c239ee121858.slice/crio-4adb6018f313bcb2ec125752169e57fcca60cb400d6052389c98807752e68aff WatchSource:0}: Error finding container 4adb6018f313bcb2ec125752169e57fcca60cb400d6052389c98807752e68aff: Status 404 returned error can't find the container with id 4adb6018f313bcb2ec125752169e57fcca60cb400d6052389c98807752e68aff May 27 14:06:27.622072 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:06:27.622052 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72bd02e1_d71f_4f37_ad52_b3996805f3fd.slice/crio-d98ccd51826d302ab50c433855265ced201ffd92c3969fb5ac6d8a3f87d939a5 WatchSource:0}: Error finding container d98ccd51826d302ab50c433855265ced201ffd92c3969fb5ac6d8a3f87d939a5: Status 404 returned error can't find the container with id d98ccd51826d302ab50c433855265ced201ffd92c3969fb5ac6d8a3f87d939a5 May 27 14:06:28.521035 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:28.520990 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8ff469fd-5d8b9" event={"ID":"72bd02e1-d71f-4f37-ad52-b3996805f3fd","Type":"ContainerStarted","Data":"d98ccd51826d302ab50c433855265ced201ffd92c3969fb5ac6d8a3f87d939a5"} May 27 14:06:28.530485 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:28.530456 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-74t66" event={"ID":"e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710","Type":"ContainerStarted","Data":"29fa8a767cf43c415643aab4d6ef799290dc9b881cca0d7d77838829a6c60388"} May 27 14:06:28.540013 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:28.539986 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cr7vm" event={"ID":"6a8d3b41-b8d0-4b23-9658-c239ee121858","Type":"ContainerStarted","Data":"4adb6018f313bcb2ec125752169e57fcca60cb400d6052389c98807752e68aff"} May 27 14:06:28.545995 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:28.545947 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-58m9b" event={"ID":"f1a2947c-37ec-4483-b026-f7d0e5a6365d","Type":"ContainerStarted","Data":"5427695bb234d8795c291c1d23374eb2c24508ebc718b3959229530769b3a544"} May 27 14:06:28.549690 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:28.549362 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d865d9df9-gx6rt" event={"ID":"035fb20f-7857-43ed-88b0-880dea582600","Type":"ContainerStarted","Data":"c12c2cc6cbec704c06ffdd2f88adc300a5654a530d01a95595239cf0537eccc9"} May 27 14:06:28.549690 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:28.549651 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d865d9df9-gx6rt" May 27 14:06:28.551801 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:28.551773 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d865d9df9-gx6rt" May 27 14:06:28.570143 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:28.569997 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d865d9df9-gx6rt" podStartSLOduration=1.608410357 podStartE2EDuration="7.569981859s" podCreationTimestamp="2026-05-27 14:06:21 +0000 UTC" firstStartedPulling="2026-05-27 14:06:21.510747883 +0000 UTC m=+63.863573001" lastFinishedPulling="2026-05-27 14:06:27.472319376 +0000 UTC m=+69.825144503" observedRunningTime="2026-05-27 14:06:28.568119765 +0000 UTC m=+70.920944902" watchObservedRunningTime="2026-05-27 14:06:28.569981859 +0000 UTC m=+70.922806997" May 27 14:06:34.572237 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:34.572192 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h4llj" event={"ID":"59575ced-2733-424b-91f8-04efa7a3d4f3","Type":"ContainerStarted","Data":"c0a0ab374df51fdc4c44f831cf40821d37cc52253d66ad6c8be7eac20c174ec7"} May 27 14:06:34.572237 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:34.572235 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h4llj" event={"ID":"59575ced-2733-424b-91f8-04efa7a3d4f3","Type":"ContainerStarted","Data":"68341fb4d822fab05367424e1655dc8bd2ec06b406a4d67545c324da018a73ae"} May 27 14:06:34.572712 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:34.572276 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-h4llj" May 27 14:06:34.573428 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:34.573404 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m4795" event={"ID":"60daec24-40fb-4ec9-bd38-48b06bfee016","Type":"ContainerStarted","Data":"9d8d30736f95ed1a5376056ae22a6bba2907bfedd65ea602bde33e5e9b9721a5"} May 27 14:06:34.575351 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:34.575308 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8ff469fd-5d8b9" event={"ID":"72bd02e1-d71f-4f37-ad52-b3996805f3fd","Type":"ContainerStarted","Data":"90d13604fc8ae9cea83d2798efe186186a699072f4cc6329220d85a05070e312"} May 27 14:06:34.579288 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:34.579267 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-74t66" event={"ID":"e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710","Type":"ContainerStarted","Data":"29c700b92b408096fe60b20b6981dd2f27e6a8c194a90bda4e3d01bbd7018bd8"} May 27 14:06:34.580471 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:34.580452 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cr7vm" event={"ID":"6a8d3b41-b8d0-4b23-9658-c239ee121858","Type":"ContainerStarted","Data":"9ea54b724acfa6bb8493f3547675be85e1fdfc04b311dc55aec2ec9d66cbfe5b"} May 27 14:06:34.580588 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:34.580566 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:06:34.581866 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:34.581845 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-58m9b" event={"ID":"f1a2947c-37ec-4483-b026-f7d0e5a6365d","Type":"ContainerStarted","Data":"8195fe3ebb97489fc846dcaa131f9146ad843627c189dcddb216a54c7959c583"} May 27 14:06:34.581944 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:34.581873 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-58m9b" event={"ID":"f1a2947c-37ec-4483-b026-f7d0e5a6365d","Type":"ContainerStarted","Data":"f8035521ea2f0144a86bb1a00b3d46585659892c72852c403760002e220ea039"} May 27 14:06:34.599478 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:34.599433 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-h4llj" podStartSLOduration=37.633872853 podStartE2EDuration="43.599420098s" podCreationTimestamp="2026-05-27 14:05:51 +0000 UTC" firstStartedPulling="2026-05-27 14:06:27.475678949 +0000 UTC m=+69.828504277" lastFinishedPulling="2026-05-27 14:06:33.441226393 +0000 UTC m=+75.794051522" observedRunningTime="2026-05-27 14:06:34.598590385 +0000 UTC m=+76.951415523" watchObservedRunningTime="2026-05-27 14:06:34.599420098 +0000 UTC m=+76.952245234" May 27 14:06:34.626343 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:34.626273 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-58m9b" podStartSLOduration=70.815076718 podStartE2EDuration="1m16.626256309s" podCreationTimestamp="2026-05-27 14:05:18 +0000 UTC" firstStartedPulling="2026-05-27 14:06:27.619573916 +0000 UTC m=+69.972399030" lastFinishedPulling="2026-05-27 14:06:33.430753507 +0000 UTC m=+75.783578621" observedRunningTime="2026-05-27 14:06:34.625481755 +0000 UTC m=+76.978306892" watchObservedRunningTime="2026-05-27 14:06:34.626256309 +0000 UTC m=+76.979081447" May 27 14:06:34.649397 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:34.649343 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5f8ff469fd-5d8b9" podStartSLOduration=4.8245728660000005 podStartE2EDuration="10.649312529s" podCreationTimestamp="2026-05-27 14:06:24 +0000 UTC" firstStartedPulling="2026-05-27 14:06:27.624281189 +0000 UTC m=+69.977106306" lastFinishedPulling="2026-05-27 14:06:33.44902085 +0000 UTC m=+75.801845969" observedRunningTime="2026-05-27 14:06:34.647467076 +0000 UTC m=+77.000292217" watchObservedRunningTime="2026-05-27 14:06:34.649312529 +0000 UTC m=+77.002137666" May 27 14:06:34.679246 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:34.678889 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cr7vm" podStartSLOduration=70.836112526 podStartE2EDuration="1m16.678872714s" podCreationTimestamp="2026-05-27 14:05:18 +0000 UTC" firstStartedPulling="2026-05-27 14:06:27.623547454 +0000 UTC m=+69.976372570" lastFinishedPulling="2026-05-27 14:06:33.466307632 +0000 UTC m=+75.819132758" observedRunningTime="2026-05-27 14:06:34.678783008 +0000 UTC m=+77.031608145" watchObservedRunningTime="2026-05-27 14:06:34.678872714 +0000 UTC m=+77.031697851" May 27 14:06:34.719203 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:34.719151 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-74t66" podStartSLOduration=3.378162269 podStartE2EDuration="13.719138482s" podCreationTimestamp="2026-05-27 14:06:21 +0000 UTC" firstStartedPulling="2026-05-27 14:06:23.100741427 +0000 UTC m=+65.453566546" lastFinishedPulling="2026-05-27 14:06:33.441717631 +0000 UTC m=+75.794542759" observedRunningTime="2026-05-27 14:06:34.718439586 +0000 UTC m=+77.071264723" watchObservedRunningTime="2026-05-27 14:06:34.719138482 +0000 UTC m=+77.071963617" May 27 14:06:34.738048 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:34.737994 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m4795" podStartSLOduration=37.725279948 podStartE2EDuration="43.737977842s" podCreationTimestamp="2026-05-27 14:05:51 +0000 UTC" firstStartedPulling="2026-05-27 14:06:27.429501018 +0000 UTC m=+69.782326132" lastFinishedPulling="2026-05-27 14:06:33.442198903 +0000 UTC m=+75.795024026" observedRunningTime="2026-05-27 14:06:34.736904899 +0000 UTC m=+77.089730036" watchObservedRunningTime="2026-05-27 14:06:34.737977842 +0000 UTC m=+77.090802978" May 27 14:06:40.213588 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.213433 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6tmpr"] May 27 14:06:40.264419 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.264389 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.267850 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.267824 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 27 14:06:40.268144 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.268069 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 27 14:06:40.268448 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.268268 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 27 14:06:40.268448 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.268365 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 27 14:06:40.269407 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.269388 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 27 14:06:40.269522 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.269502 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 27 14:06:40.269670 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.269396 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cdvtl\"" May 27 14:06:40.426095 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.425966 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-node-exporter-wtmp\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.426095 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.426019 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xr9l\" (UniqueName: \"kubernetes.io/projected/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-kube-api-access-8xr9l\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.426095 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.426053 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-node-exporter-accelerators-collector-config\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.426095 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.426083 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-node-exporter-tls\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.426422 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.426112 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.426422 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.426162 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-sys\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.426422 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.426225 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-root\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.426422 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.426253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-metrics-client-ca\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.426422 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.426282 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-node-exporter-textfile\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.527599 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.527555 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-root\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.527599 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.527602 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-metrics-client-ca\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.527843 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.527631 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-node-exporter-textfile\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.527843 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.527667 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-root\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.527843 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.527674 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-node-exporter-wtmp\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.527843 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.527729 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xr9l\" (UniqueName: \"kubernetes.io/projected/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-kube-api-access-8xr9l\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.527843 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.527757 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-node-exporter-accelerators-collector-config\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.527843 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.527784 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-node-exporter-tls\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.527843 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.527796 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-node-exporter-wtmp\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.527843 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.527810 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.528272 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.527859 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-sys\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.528272 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.527953 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-sys\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.528401 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.528285 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-node-exporter-textfile\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.528401 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.528356 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-metrics-client-ca\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.528744 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.528702 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-node-exporter-accelerators-collector-config\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.531267 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.531241 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-node-exporter-tls\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.531525 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.531491 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.537506 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.537468 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xr9l\" (UniqueName: \"kubernetes.io/projected/acaf7477-4d53-4853-a4c2-c09d1b07c9fe-kube-api-access-8xr9l\") pod \"node-exporter-6tmpr\" (UID: \"acaf7477-4d53-4853-a4c2-c09d1b07c9fe\") " pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:40.575563 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:40.575538 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6tmpr" May 27 14:06:41.519836 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:06:41.519807 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacaf7477_4d53_4853_a4c2_c09d1b07c9fe.slice/crio-43d96160ffc789299bc5539359f83787a8cf8c4c8b25e8a29d866d3f1711d627 WatchSource:0}: Error finding container 43d96160ffc789299bc5539359f83787a8cf8c4c8b25e8a29d866d3f1711d627: Status 404 returned error can't find the container with id 43d96160ffc789299bc5539359f83787a8cf8c4c8b25e8a29d866d3f1711d627 May 27 14:06:41.609060 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:41.609016 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6tmpr" event={"ID":"acaf7477-4d53-4853-a4c2-c09d1b07c9fe","Type":"ContainerStarted","Data":"43d96160ffc789299bc5539359f83787a8cf8c4c8b25e8a29d866d3f1711d627"} May 27 14:06:41.724985 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:41.724952 2576 patch_prober.go:28] interesting pod/image-registry-f7d4789c6-b8lwr container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 27 14:06:41.725171 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:41.725022 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" podUID="51fef4bf-a781-4a70-abb7-69f09f1b2e02" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 27 14:06:42.614384 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:42.614347 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-4gvg6" event={"ID":"26c67875-8892-4213-ac40-1cbd327af5d2","Type":"ContainerStarted","Data":"dbe81f8ebc5dc3243f5fc01f1761c5ea7f57bc9bb38ce3083a58668691969b00"} May 27 14:06:42.614765 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:42.614662 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-4gvg6" May 27 14:06:42.616592 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:42.616493 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6tmpr" event={"ID":"acaf7477-4d53-4853-a4c2-c09d1b07c9fe","Type":"ContainerStarted","Data":"9f66d67b685e7505aaba71270b02741826228f02ca39d7ea30975cbfff07e1be"} May 27 14:06:42.621962 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:42.621936 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-4gvg6" May 27 14:06:42.642975 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:42.642920 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-4gvg6" podStartSLOduration=1.465964713 podStartE2EDuration="21.642901817s" podCreationTimestamp="2026-05-27 14:06:21 +0000 UTC" firstStartedPulling="2026-05-27 14:06:21.728006852 +0000 UTC m=+64.080831970" lastFinishedPulling="2026-05-27 14:06:41.904943961 +0000 UTC m=+84.257769074" observedRunningTime="2026-05-27 14:06:42.642386753 +0000 UTC m=+84.995211889" watchObservedRunningTime="2026-05-27 14:06:42.642901817 +0000 UTC m=+84.995726952" May 27 14:06:43.622002 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:43.621961 2576 generic.go:358] "Generic (PLEG): container finished" podID="acaf7477-4d53-4853-a4c2-c09d1b07c9fe" containerID="9f66d67b685e7505aaba71270b02741826228f02ca39d7ea30975cbfff07e1be" exitCode=0 May 27 14:06:43.622587 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:43.622248 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6tmpr" event={"ID":"acaf7477-4d53-4853-a4c2-c09d1b07c9fe","Type":"ContainerDied","Data":"9f66d67b685e7505aaba71270b02741826228f02ca39d7ea30975cbfff07e1be"} May 27 14:06:43.622587 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:43.622288 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6tmpr" event={"ID":"acaf7477-4d53-4853-a4c2-c09d1b07c9fe","Type":"ContainerStarted","Data":"5ccb63eddf2943aaf4b1c4c5e255d5d83d3b67205dd0c13b827d309f824426d9"} May 27 14:06:43.622587 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:43.622303 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6tmpr" event={"ID":"acaf7477-4d53-4853-a4c2-c09d1b07c9fe","Type":"ContainerStarted","Data":"25d2d465cd5ddfc5b42394949bffd4a82150a14aa36cb372b1749045bcda30a2"} May 27 14:06:43.652442 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:43.652379 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6tmpr" podStartSLOduration=2.733470935 podStartE2EDuration="3.652360865s" podCreationTimestamp="2026-05-27 14:06:40 +0000 UTC" firstStartedPulling="2026-05-27 14:06:41.521690604 +0000 UTC m=+83.874515719" lastFinishedPulling="2026-05-27 14:06:42.440580531 +0000 UTC m=+84.793405649" observedRunningTime="2026-05-27 14:06:43.649115997 +0000 UTC m=+86.001941146" watchObservedRunningTime="2026-05-27 14:06:43.652360865 +0000 UTC m=+86.005186001" May 27 14:06:44.504949 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:44.504915 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f7d4789c6-b8lwr" May 27 14:06:44.526241 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:44.526206 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:06:44.526456 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:44.526291 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:06:44.532207 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:44.532184 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:06:44.588739 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:44.588701 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-h4llj" May 27 14:06:44.632774 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:44.632741 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:06:45.401693 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:06:45.401656 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f8ff469fd-5d8b9"] May 27 14:07:04.097111 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:04.097076 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m4795_60daec24-40fb-4ec9-bd38-48b06bfee016/serve-healthcheck-canary/0.log" May 27 14:07:05.588845 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:05.588816 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cr7vm" May 27 14:07:11.655544 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:11.655481 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5f8ff469fd-5d8b9" podUID="72bd02e1-d71f-4f37-ad52-b3996805f3fd" containerName="console" containerID="cri-o://90d13604fc8ae9cea83d2798efe186186a699072f4cc6329220d85a05070e312" gracePeriod=15 May 27 14:07:11.913446 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:11.913391 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f8ff469fd-5d8b9_72bd02e1-d71f-4f37-ad52-b3996805f3fd/console/0.log" May 27 14:07:11.913547 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:11.913452 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:07:11.965904 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:11.965861 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72bd02e1-d71f-4f37-ad52-b3996805f3fd-console-config\") pod \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\" (UID: \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\") " May 27 14:07:11.965904 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:11.965911 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72bd02e1-d71f-4f37-ad52-b3996805f3fd-console-serving-cert\") pod \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\" (UID: \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\") " May 27 14:07:11.966133 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:11.965943 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72bd02e1-d71f-4f37-ad52-b3996805f3fd-oauth-serving-cert\") pod \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\" (UID: \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\") " May 27 14:07:11.966133 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:11.966115 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27tnr\" (UniqueName: \"kubernetes.io/projected/72bd02e1-d71f-4f37-ad52-b3996805f3fd-kube-api-access-27tnr\") pod \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\" (UID: \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\") " May 27 14:07:11.966238 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:11.966197 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72bd02e1-d71f-4f37-ad52-b3996805f3fd-service-ca\") pod \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\" (UID: \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\") " May 27 14:07:11.966290 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:11.966243 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72bd02e1-d71f-4f37-ad52-b3996805f3fd-console-oauth-config\") pod \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\" (UID: \"72bd02e1-d71f-4f37-ad52-b3996805f3fd\") " May 27 14:07:11.966385 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:11.966360 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72bd02e1-d71f-4f37-ad52-b3996805f3fd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "72bd02e1-d71f-4f37-ad52-b3996805f3fd" (UID: "72bd02e1-d71f-4f37-ad52-b3996805f3fd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 14:07:11.966442 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:11.966369 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72bd02e1-d71f-4f37-ad52-b3996805f3fd-console-config" (OuterVolumeSpecName: "console-config") pod "72bd02e1-d71f-4f37-ad52-b3996805f3fd" (UID: "72bd02e1-d71f-4f37-ad52-b3996805f3fd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 14:07:11.966615 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:11.966598 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72bd02e1-d71f-4f37-ad52-b3996805f3fd-oauth-serving-cert\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:07:11.966667 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:11.966622 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72bd02e1-d71f-4f37-ad52-b3996805f3fd-console-config\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:07:11.966667 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:11.966613 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72bd02e1-d71f-4f37-ad52-b3996805f3fd-service-ca" (OuterVolumeSpecName: "service-ca") pod "72bd02e1-d71f-4f37-ad52-b3996805f3fd" (UID: "72bd02e1-d71f-4f37-ad52-b3996805f3fd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 14:07:11.968355 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:11.968310 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72bd02e1-d71f-4f37-ad52-b3996805f3fd-kube-api-access-27tnr" (OuterVolumeSpecName: "kube-api-access-27tnr") pod "72bd02e1-d71f-4f37-ad52-b3996805f3fd" (UID: "72bd02e1-d71f-4f37-ad52-b3996805f3fd"). InnerVolumeSpecName "kube-api-access-27tnr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:07:11.968434 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:11.968348 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72bd02e1-d71f-4f37-ad52-b3996805f3fd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "72bd02e1-d71f-4f37-ad52-b3996805f3fd" (UID: "72bd02e1-d71f-4f37-ad52-b3996805f3fd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 14:07:11.968516 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:11.968494 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72bd02e1-d71f-4f37-ad52-b3996805f3fd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "72bd02e1-d71f-4f37-ad52-b3996805f3fd" (UID: "72bd02e1-d71f-4f37-ad52-b3996805f3fd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 14:07:12.067960 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:12.067926 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27tnr\" (UniqueName: \"kubernetes.io/projected/72bd02e1-d71f-4f37-ad52-b3996805f3fd-kube-api-access-27tnr\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:07:12.067960 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:12.067956 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72bd02e1-d71f-4f37-ad52-b3996805f3fd-service-ca\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:07:12.067960 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:12.067966 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72bd02e1-d71f-4f37-ad52-b3996805f3fd-console-oauth-config\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:07:12.068187 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:12.067975 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72bd02e1-d71f-4f37-ad52-b3996805f3fd-console-serving-cert\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:07:12.703200 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:12.703130 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f8ff469fd-5d8b9_72bd02e1-d71f-4f37-ad52-b3996805f3fd/console/0.log" May 27 14:07:12.703200 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:12.703165 2576 generic.go:358] "Generic (PLEG): container finished" podID="72bd02e1-d71f-4f37-ad52-b3996805f3fd" containerID="90d13604fc8ae9cea83d2798efe186186a699072f4cc6329220d85a05070e312" exitCode=2 May 27 14:07:12.703694 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:12.703201 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8ff469fd-5d8b9" event={"ID":"72bd02e1-d71f-4f37-ad52-b3996805f3fd","Type":"ContainerDied","Data":"90d13604fc8ae9cea83d2798efe186186a699072f4cc6329220d85a05070e312"} May 27 14:07:12.703694 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:12.703228 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8ff469fd-5d8b9" May 27 14:07:12.703694 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:12.703252 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8ff469fd-5d8b9" event={"ID":"72bd02e1-d71f-4f37-ad52-b3996805f3fd","Type":"ContainerDied","Data":"d98ccd51826d302ab50c433855265ced201ffd92c3969fb5ac6d8a3f87d939a5"} May 27 14:07:12.703694 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:12.703268 2576 scope.go:117] "RemoveContainer" containerID="90d13604fc8ae9cea83d2798efe186186a699072f4cc6329220d85a05070e312" May 27 14:07:12.710662 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:12.710646 2576 scope.go:117] "RemoveContainer" containerID="90d13604fc8ae9cea83d2798efe186186a699072f4cc6329220d85a05070e312" May 27 14:07:12.710928 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:07:12.710912 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90d13604fc8ae9cea83d2798efe186186a699072f4cc6329220d85a05070e312\": container with ID starting with 90d13604fc8ae9cea83d2798efe186186a699072f4cc6329220d85a05070e312 not found: ID does not exist" containerID="90d13604fc8ae9cea83d2798efe186186a699072f4cc6329220d85a05070e312" May 27 14:07:12.710987 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:12.710935 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90d13604fc8ae9cea83d2798efe186186a699072f4cc6329220d85a05070e312"} err="failed to get container status \"90d13604fc8ae9cea83d2798efe186186a699072f4cc6329220d85a05070e312\": rpc error: code = NotFound desc = could not find container \"90d13604fc8ae9cea83d2798efe186186a699072f4cc6329220d85a05070e312\": container with ID starting with 90d13604fc8ae9cea83d2798efe186186a699072f4cc6329220d85a05070e312 not found: ID does not exist" May 27 14:07:12.721990 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:12.721968 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f8ff469fd-5d8b9"] May 27 14:07:12.724432 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:12.724409 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f8ff469fd-5d8b9"] May 27 14:07:14.262967 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:07:14.262939 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72bd02e1-d71f-4f37-ad52-b3996805f3fd" path="/var/lib/kubelet/pods/72bd02e1-d71f-4f37-ad52-b3996805f3fd/volumes" May 27 14:08:08.351970 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.351883 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-749b58d9c7-g4vw6"] May 27 14:08:08.352522 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.352220 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72bd02e1-d71f-4f37-ad52-b3996805f3fd" containerName="console" May 27 14:08:08.352522 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.352238 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="72bd02e1-d71f-4f37-ad52-b3996805f3fd" containerName="console" May 27 14:08:08.352522 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.352300 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="72bd02e1-d71f-4f37-ad52-b3996805f3fd" containerName="console" May 27 14:08:08.355052 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.355031 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:08.358307 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.358283 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 27 14:08:08.358307 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.358299 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 27 14:08:08.359694 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.359667 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7mkr7\"" May 27 14:08:08.359795 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.359717 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 27 14:08:08.359854 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.359792 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 27 14:08:08.359932 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.359914 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 27 14:08:08.364138 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.364119 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 27 14:08:08.365536 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.365519 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-749b58d9c7-g4vw6"] May 27 14:08:08.480122 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.480078 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpxh8\" (UniqueName: \"kubernetes.io/projected/77495a6c-5c22-4466-b49c-54bc28af4c1f-kube-api-access-kpxh8\") pod \"console-749b58d9c7-g4vw6\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:08.480122 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.480118 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77495a6c-5c22-4466-b49c-54bc28af4c1f-console-config\") pod \"console-749b58d9c7-g4vw6\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:08.480371 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.480144 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77495a6c-5c22-4466-b49c-54bc28af4c1f-trusted-ca-bundle\") pod \"console-749b58d9c7-g4vw6\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:08.480371 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.480211 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77495a6c-5c22-4466-b49c-54bc28af4c1f-oauth-serving-cert\") pod \"console-749b58d9c7-g4vw6\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:08.480371 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.480248 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77495a6c-5c22-4466-b49c-54bc28af4c1f-service-ca\") pod \"console-749b58d9c7-g4vw6\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:08.480371 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.480286 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77495a6c-5c22-4466-b49c-54bc28af4c1f-console-oauth-config\") pod \"console-749b58d9c7-g4vw6\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:08.480371 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.480316 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77495a6c-5c22-4466-b49c-54bc28af4c1f-console-serving-cert\") pod \"console-749b58d9c7-g4vw6\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:08.580641 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.580611 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77495a6c-5c22-4466-b49c-54bc28af4c1f-trusted-ca-bundle\") pod \"console-749b58d9c7-g4vw6\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:08.580838 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.580650 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77495a6c-5c22-4466-b49c-54bc28af4c1f-oauth-serving-cert\") pod \"console-749b58d9c7-g4vw6\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:08.580838 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.580697 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77495a6c-5c22-4466-b49c-54bc28af4c1f-service-ca\") pod \"console-749b58d9c7-g4vw6\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:08.580838 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.580739 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77495a6c-5c22-4466-b49c-54bc28af4c1f-console-oauth-config\") pod \"console-749b58d9c7-g4vw6\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:08.580838 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.580800 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77495a6c-5c22-4466-b49c-54bc28af4c1f-console-serving-cert\") pod \"console-749b58d9c7-g4vw6\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:08.581109 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.580850 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kpxh8\" (UniqueName: \"kubernetes.io/projected/77495a6c-5c22-4466-b49c-54bc28af4c1f-kube-api-access-kpxh8\") pod \"console-749b58d9c7-g4vw6\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:08.581109 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.580911 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77495a6c-5c22-4466-b49c-54bc28af4c1f-console-config\") pod \"console-749b58d9c7-g4vw6\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:08.581544 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.581517 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77495a6c-5c22-4466-b49c-54bc28af4c1f-oauth-serving-cert\") pod \"console-749b58d9c7-g4vw6\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:08.581544 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.581540 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77495a6c-5c22-4466-b49c-54bc28af4c1f-service-ca\") pod \"console-749b58d9c7-g4vw6\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:08.581711 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.581616 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77495a6c-5c22-4466-b49c-54bc28af4c1f-console-config\") pod \"console-749b58d9c7-g4vw6\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:08.581768 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.581712 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77495a6c-5c22-4466-b49c-54bc28af4c1f-trusted-ca-bundle\") pod \"console-749b58d9c7-g4vw6\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:08.583642 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.583615 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77495a6c-5c22-4466-b49c-54bc28af4c1f-console-serving-cert\") pod \"console-749b58d9c7-g4vw6\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:08.583737 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.583669 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77495a6c-5c22-4466-b49c-54bc28af4c1f-console-oauth-config\") pod \"console-749b58d9c7-g4vw6\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:08.590692 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.590664 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpxh8\" (UniqueName: \"kubernetes.io/projected/77495a6c-5c22-4466-b49c-54bc28af4c1f-kube-api-access-kpxh8\") pod \"console-749b58d9c7-g4vw6\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:08.664456 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.664366 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:08.791404 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.791370 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-749b58d9c7-g4vw6"] May 27 14:08:08.795023 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:08:08.794999 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77495a6c_5c22_4466_b49c_54bc28af4c1f.slice/crio-f58c6a59aa1aa782f725760518ec901806e357862d3652c982600428b7188a12 WatchSource:0}: Error finding container f58c6a59aa1aa782f725760518ec901806e357862d3652c982600428b7188a12: Status 404 returned error can't find the container with id f58c6a59aa1aa782f725760518ec901806e357862d3652c982600428b7188a12 May 27 14:08:08.859027 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:08.858994 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-749b58d9c7-g4vw6" event={"ID":"77495a6c-5c22-4466-b49c-54bc28af4c1f","Type":"ContainerStarted","Data":"f58c6a59aa1aa782f725760518ec901806e357862d3652c982600428b7188a12"} May 27 14:08:09.863152 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:09.863114 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-749b58d9c7-g4vw6" event={"ID":"77495a6c-5c22-4466-b49c-54bc28af4c1f","Type":"ContainerStarted","Data":"01cc5f1892a8a342e5f0136fd543d4ba6850d2f4423743c594019d84688d6859"} May 27 14:08:09.882925 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:09.882872 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-749b58d9c7-g4vw6" podStartSLOduration=1.8828557639999999 podStartE2EDuration="1.882855764s" podCreationTimestamp="2026-05-27 14:08:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 14:08:09.881899839 +0000 UTC m=+172.234724975" watchObservedRunningTime="2026-05-27 14:08:09.882855764 +0000 UTC m=+172.235680903" May 27 14:08:15.553031 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.552995 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-749b58d9c7-g4vw6"] May 27 14:08:15.588698 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.588670 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c985fd5f9-495dg"] May 27 14:08:15.591801 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.591779 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:15.610698 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.610669 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c985fd5f9-495dg"] May 27 14:08:15.733982 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.733950 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba023335-6961-4379-a547-bb9624782a00-trusted-ca-bundle\") pod \"console-7c985fd5f9-495dg\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:15.733982 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.733987 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6579\" (UniqueName: \"kubernetes.io/projected/ba023335-6961-4379-a547-bb9624782a00-kube-api-access-d6579\") pod \"console-7c985fd5f9-495dg\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:15.734229 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.734013 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba023335-6961-4379-a547-bb9624782a00-console-config\") pod \"console-7c985fd5f9-495dg\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:15.734229 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.734040 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba023335-6961-4379-a547-bb9624782a00-console-oauth-config\") pod \"console-7c985fd5f9-495dg\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:15.734229 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.734093 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba023335-6961-4379-a547-bb9624782a00-oauth-serving-cert\") pod \"console-7c985fd5f9-495dg\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:15.734229 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.734161 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba023335-6961-4379-a547-bb9624782a00-console-serving-cert\") pod \"console-7c985fd5f9-495dg\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:15.734229 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.734191 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba023335-6961-4379-a547-bb9624782a00-service-ca\") pod \"console-7c985fd5f9-495dg\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:15.835025 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.834949 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba023335-6961-4379-a547-bb9624782a00-trusted-ca-bundle\") pod \"console-7c985fd5f9-495dg\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:15.835025 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.834985 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d6579\" (UniqueName: \"kubernetes.io/projected/ba023335-6961-4379-a547-bb9624782a00-kube-api-access-d6579\") pod \"console-7c985fd5f9-495dg\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:15.835025 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.835005 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba023335-6961-4379-a547-bb9624782a00-console-config\") pod \"console-7c985fd5f9-495dg\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:15.835240 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.835060 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba023335-6961-4379-a547-bb9624782a00-console-oauth-config\") pod \"console-7c985fd5f9-495dg\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:15.835240 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.835101 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba023335-6961-4379-a547-bb9624782a00-oauth-serving-cert\") pod \"console-7c985fd5f9-495dg\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:15.835240 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.835150 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba023335-6961-4379-a547-bb9624782a00-console-serving-cert\") pod \"console-7c985fd5f9-495dg\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:15.835240 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.835181 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba023335-6961-4379-a547-bb9624782a00-service-ca\") pod \"console-7c985fd5f9-495dg\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:15.835870 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.835844 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba023335-6961-4379-a547-bb9624782a00-console-config\") pod \"console-7c985fd5f9-495dg\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:15.835999 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.835900 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba023335-6961-4379-a547-bb9624782a00-service-ca\") pod \"console-7c985fd5f9-495dg\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:15.835999 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.835905 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba023335-6961-4379-a547-bb9624782a00-oauth-serving-cert\") pod \"console-7c985fd5f9-495dg\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:15.835999 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.835931 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba023335-6961-4379-a547-bb9624782a00-trusted-ca-bundle\") pod \"console-7c985fd5f9-495dg\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:15.838147 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.838126 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba023335-6961-4379-a547-bb9624782a00-console-serving-cert\") pod \"console-7c985fd5f9-495dg\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:15.838236 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.838149 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba023335-6961-4379-a547-bb9624782a00-console-oauth-config\") pod \"console-7c985fd5f9-495dg\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:15.843642 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.843623 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6579\" (UniqueName: \"kubernetes.io/projected/ba023335-6961-4379-a547-bb9624782a00-kube-api-access-d6579\") pod \"console-7c985fd5f9-495dg\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:15.900184 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:15.900150 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:16.030034 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:16.030009 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c985fd5f9-495dg"] May 27 14:08:16.032508 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:08:16.032482 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba023335_6961_4379_a547_bb9624782a00.slice/crio-ef4096e77e77b8a86530c83bbddca27c0db368d6bde3c7d485e6e9ad923dd1e7 WatchSource:0}: Error finding container ef4096e77e77b8a86530c83bbddca27c0db368d6bde3c7d485e6e9ad923dd1e7: Status 404 returned error can't find the container with id ef4096e77e77b8a86530c83bbddca27c0db368d6bde3c7d485e6e9ad923dd1e7 May 27 14:08:16.884901 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:16.884866 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c985fd5f9-495dg" event={"ID":"ba023335-6961-4379-a547-bb9624782a00","Type":"ContainerStarted","Data":"dc67fb0654606c366483729c3a0d7b8421064027ee474515d3538532ca01c66c"} May 27 14:08:16.884901 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:16.884897 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c985fd5f9-495dg" event={"ID":"ba023335-6961-4379-a547-bb9624782a00","Type":"ContainerStarted","Data":"ef4096e77e77b8a86530c83bbddca27c0db368d6bde3c7d485e6e9ad923dd1e7"} May 27 14:08:16.905704 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:16.905657 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7c985fd5f9-495dg" podStartSLOduration=1.905644561 podStartE2EDuration="1.905644561s" podCreationTimestamp="2026-05-27 14:08:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 14:08:16.905226002 +0000 UTC m=+179.258051139" watchObservedRunningTime="2026-05-27 14:08:16.905644561 +0000 UTC m=+179.258469694" May 27 14:08:18.665258 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:18.665211 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:25.900924 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:25.900888 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:25.900924 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:25.900932 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:25.905623 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:25.905599 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:25.914910 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:25.914886 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:08:40.571159 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.571120 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-749b58d9c7-g4vw6" podUID="77495a6c-5c22-4466-b49c-54bc28af4c1f" containerName="console" containerID="cri-o://01cc5f1892a8a342e5f0136fd543d4ba6850d2f4423743c594019d84688d6859" gracePeriod=15 May 27 14:08:40.812336 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.812301 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-749b58d9c7-g4vw6_77495a6c-5c22-4466-b49c-54bc28af4c1f/console/0.log" May 27 14:08:40.812449 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.812376 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:40.903117 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.903035 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpxh8\" (UniqueName: \"kubernetes.io/projected/77495a6c-5c22-4466-b49c-54bc28af4c1f-kube-api-access-kpxh8\") pod \"77495a6c-5c22-4466-b49c-54bc28af4c1f\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " May 27 14:08:40.903117 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.903075 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77495a6c-5c22-4466-b49c-54bc28af4c1f-service-ca\") pod \"77495a6c-5c22-4466-b49c-54bc28af4c1f\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " May 27 14:08:40.903117 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.903100 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77495a6c-5c22-4466-b49c-54bc28af4c1f-trusted-ca-bundle\") pod \"77495a6c-5c22-4466-b49c-54bc28af4c1f\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " May 27 14:08:40.903414 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.903129 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77495a6c-5c22-4466-b49c-54bc28af4c1f-console-oauth-config\") pod \"77495a6c-5c22-4466-b49c-54bc28af4c1f\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " May 27 14:08:40.903414 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.903187 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77495a6c-5c22-4466-b49c-54bc28af4c1f-console-serving-cert\") pod \"77495a6c-5c22-4466-b49c-54bc28af4c1f\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " May 27 14:08:40.903414 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.903225 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77495a6c-5c22-4466-b49c-54bc28af4c1f-oauth-serving-cert\") pod \"77495a6c-5c22-4466-b49c-54bc28af4c1f\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " May 27 14:08:40.903414 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.903252 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77495a6c-5c22-4466-b49c-54bc28af4c1f-console-config\") pod \"77495a6c-5c22-4466-b49c-54bc28af4c1f\" (UID: \"77495a6c-5c22-4466-b49c-54bc28af4c1f\") " May 27 14:08:40.903663 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.903637 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77495a6c-5c22-4466-b49c-54bc28af4c1f-service-ca" (OuterVolumeSpecName: "service-ca") pod "77495a6c-5c22-4466-b49c-54bc28af4c1f" (UID: "77495a6c-5c22-4466-b49c-54bc28af4c1f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 14:08:40.903720 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.903673 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77495a6c-5c22-4466-b49c-54bc28af4c1f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "77495a6c-5c22-4466-b49c-54bc28af4c1f" (UID: "77495a6c-5c22-4466-b49c-54bc28af4c1f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 14:08:40.903720 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.903679 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77495a6c-5c22-4466-b49c-54bc28af4c1f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "77495a6c-5c22-4466-b49c-54bc28af4c1f" (UID: "77495a6c-5c22-4466-b49c-54bc28af4c1f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 14:08:40.903720 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.903711 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77495a6c-5c22-4466-b49c-54bc28af4c1f-console-config" (OuterVolumeSpecName: "console-config") pod "77495a6c-5c22-4466-b49c-54bc28af4c1f" (UID: "77495a6c-5c22-4466-b49c-54bc28af4c1f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 14:08:40.905285 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.905259 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77495a6c-5c22-4466-b49c-54bc28af4c1f-kube-api-access-kpxh8" (OuterVolumeSpecName: "kube-api-access-kpxh8") pod "77495a6c-5c22-4466-b49c-54bc28af4c1f" (UID: "77495a6c-5c22-4466-b49c-54bc28af4c1f"). InnerVolumeSpecName "kube-api-access-kpxh8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:08:40.905453 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.905435 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77495a6c-5c22-4466-b49c-54bc28af4c1f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "77495a6c-5c22-4466-b49c-54bc28af4c1f" (UID: "77495a6c-5c22-4466-b49c-54bc28af4c1f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 14:08:40.905549 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.905526 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77495a6c-5c22-4466-b49c-54bc28af4c1f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "77495a6c-5c22-4466-b49c-54bc28af4c1f" (UID: "77495a6c-5c22-4466-b49c-54bc28af4c1f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 14:08:40.951679 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.951653 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-749b58d9c7-g4vw6_77495a6c-5c22-4466-b49c-54bc28af4c1f/console/0.log" May 27 14:08:40.951850 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.951694 2576 generic.go:358] "Generic (PLEG): container finished" podID="77495a6c-5c22-4466-b49c-54bc28af4c1f" containerID="01cc5f1892a8a342e5f0136fd543d4ba6850d2f4423743c594019d84688d6859" exitCode=2 May 27 14:08:40.951850 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.951731 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-749b58d9c7-g4vw6" event={"ID":"77495a6c-5c22-4466-b49c-54bc28af4c1f","Type":"ContainerDied","Data":"01cc5f1892a8a342e5f0136fd543d4ba6850d2f4423743c594019d84688d6859"} May 27 14:08:40.951850 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.951761 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-749b58d9c7-g4vw6" May 27 14:08:40.951850 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.951780 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-749b58d9c7-g4vw6" event={"ID":"77495a6c-5c22-4466-b49c-54bc28af4c1f","Type":"ContainerDied","Data":"f58c6a59aa1aa782f725760518ec901806e357862d3652c982600428b7188a12"} May 27 14:08:40.951850 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.951800 2576 scope.go:117] "RemoveContainer" containerID="01cc5f1892a8a342e5f0136fd543d4ba6850d2f4423743c594019d84688d6859" May 27 14:08:40.959546 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.959529 2576 scope.go:117] "RemoveContainer" containerID="01cc5f1892a8a342e5f0136fd543d4ba6850d2f4423743c594019d84688d6859" May 27 14:08:40.959825 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:08:40.959802 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01cc5f1892a8a342e5f0136fd543d4ba6850d2f4423743c594019d84688d6859\": container with ID starting with 01cc5f1892a8a342e5f0136fd543d4ba6850d2f4423743c594019d84688d6859 not found: ID does not exist" containerID="01cc5f1892a8a342e5f0136fd543d4ba6850d2f4423743c594019d84688d6859" May 27 14:08:40.959873 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.959837 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01cc5f1892a8a342e5f0136fd543d4ba6850d2f4423743c594019d84688d6859"} err="failed to get container status \"01cc5f1892a8a342e5f0136fd543d4ba6850d2f4423743c594019d84688d6859\": rpc error: code = NotFound desc = could not find container \"01cc5f1892a8a342e5f0136fd543d4ba6850d2f4423743c594019d84688d6859\": container with ID starting with 01cc5f1892a8a342e5f0136fd543d4ba6850d2f4423743c594019d84688d6859 not found: ID does not exist" May 27 14:08:40.973642 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.973592 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-749b58d9c7-g4vw6"] May 27 14:08:40.979033 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:40.979009 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-749b58d9c7-g4vw6"] May 27 14:08:41.004060 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:41.004032 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77495a6c-5c22-4466-b49c-54bc28af4c1f-console-serving-cert\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:08:41.004060 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:41.004056 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77495a6c-5c22-4466-b49c-54bc28af4c1f-oauth-serving-cert\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:08:41.004060 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:41.004066 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77495a6c-5c22-4466-b49c-54bc28af4c1f-console-config\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:08:41.004297 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:41.004075 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpxh8\" (UniqueName: \"kubernetes.io/projected/77495a6c-5c22-4466-b49c-54bc28af4c1f-kube-api-access-kpxh8\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:08:41.004297 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:41.004085 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77495a6c-5c22-4466-b49c-54bc28af4c1f-service-ca\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:08:41.004297 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:41.004093 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77495a6c-5c22-4466-b49c-54bc28af4c1f-trusted-ca-bundle\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:08:41.004297 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:41.004101 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77495a6c-5c22-4466-b49c-54bc28af4c1f-console-oauth-config\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:08:42.264877 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:08:42.264846 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77495a6c-5c22-4466-b49c-54bc28af4c1f" path="/var/lib/kubelet/pods/77495a6c-5c22-4466-b49c-54bc28af4c1f/volumes" May 27 14:09:17.063046 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:17.063011 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v"] May 27 14:09:17.063525 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:17.063256 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77495a6c-5c22-4466-b49c-54bc28af4c1f" containerName="console" May 27 14:09:17.063525 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:17.063265 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="77495a6c-5c22-4466-b49c-54bc28af4c1f" containerName="console" May 27 14:09:17.063525 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:17.063308 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="77495a6c-5c22-4466-b49c-54bc28af4c1f" containerName="console" May 27 14:09:17.066139 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:17.066120 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v" May 27 14:09:17.069834 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:17.069814 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 14:09:17.069905 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:17.069874 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 14:09:17.071510 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:17.071490 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cnlnn\"" May 27 14:09:17.079808 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:17.079788 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v"] May 27 14:09:17.150217 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:17.150193 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c16b52a-cd9a-4aee-97e2-7849077cd776-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v\" (UID: \"3c16b52a-cd9a-4aee-97e2-7849077cd776\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v" May 27 14:09:17.150364 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:17.150235 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c16b52a-cd9a-4aee-97e2-7849077cd776-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v\" (UID: \"3c16b52a-cd9a-4aee-97e2-7849077cd776\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v" May 27 14:09:17.150364 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:17.150261 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vszw6\" (UniqueName: \"kubernetes.io/projected/3c16b52a-cd9a-4aee-97e2-7849077cd776-kube-api-access-vszw6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v\" (UID: \"3c16b52a-cd9a-4aee-97e2-7849077cd776\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v" May 27 14:09:17.251101 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:17.251069 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c16b52a-cd9a-4aee-97e2-7849077cd776-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v\" (UID: \"3c16b52a-cd9a-4aee-97e2-7849077cd776\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v" May 27 14:09:17.251253 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:17.251110 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vszw6\" (UniqueName: \"kubernetes.io/projected/3c16b52a-cd9a-4aee-97e2-7849077cd776-kube-api-access-vszw6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v\" (UID: \"3c16b52a-cd9a-4aee-97e2-7849077cd776\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v" May 27 14:09:17.251253 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:17.251165 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c16b52a-cd9a-4aee-97e2-7849077cd776-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v\" (UID: \"3c16b52a-cd9a-4aee-97e2-7849077cd776\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v" May 27 14:09:17.251546 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:17.251524 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c16b52a-cd9a-4aee-97e2-7849077cd776-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v\" (UID: \"3c16b52a-cd9a-4aee-97e2-7849077cd776\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v" May 27 14:09:17.251609 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:17.251550 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c16b52a-cd9a-4aee-97e2-7849077cd776-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v\" (UID: \"3c16b52a-cd9a-4aee-97e2-7849077cd776\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v" May 27 14:09:17.268579 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:17.268556 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vszw6\" (UniqueName: \"kubernetes.io/projected/3c16b52a-cd9a-4aee-97e2-7849077cd776-kube-api-access-vszw6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v\" (UID: \"3c16b52a-cd9a-4aee-97e2-7849077cd776\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v" May 27 14:09:17.374355 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:17.374239 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v" May 27 14:09:17.497735 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:17.497702 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v"] May 27 14:09:17.500984 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:09:17.500958 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c16b52a_cd9a_4aee_97e2_7849077cd776.slice/crio-85218d474b5373cd735e30184242694a3cc48e91cd9312d78bced75bfb5f67ae WatchSource:0}: Error finding container 85218d474b5373cd735e30184242694a3cc48e91cd9312d78bced75bfb5f67ae: Status 404 returned error can't find the container with id 85218d474b5373cd735e30184242694a3cc48e91cd9312d78bced75bfb5f67ae May 27 14:09:18.048983 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:18.048942 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v" event={"ID":"3c16b52a-cd9a-4aee-97e2-7849077cd776","Type":"ContainerStarted","Data":"85218d474b5373cd735e30184242694a3cc48e91cd9312d78bced75bfb5f67ae"} May 27 14:09:24.067333 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:24.067297 2576 generic.go:358] "Generic (PLEG): container finished" podID="3c16b52a-cd9a-4aee-97e2-7849077cd776" containerID="9d0457bd70b4f0ddc1ae92a223379123a3322eee9347f94d08dd853fe3d40972" exitCode=0 May 27 14:09:24.067709 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:24.067389 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v" event={"ID":"3c16b52a-cd9a-4aee-97e2-7849077cd776","Type":"ContainerDied","Data":"9d0457bd70b4f0ddc1ae92a223379123a3322eee9347f94d08dd853fe3d40972"} May 27 14:09:27.076859 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:27.076822 2576 generic.go:358] "Generic (PLEG): container finished" podID="3c16b52a-cd9a-4aee-97e2-7849077cd776" containerID="88b1696f302a752b60caaa27b254f99bbefb587af1ce37753295ab37a9e4ed74" exitCode=0 May 27 14:09:27.077225 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:27.076870 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v" event={"ID":"3c16b52a-cd9a-4aee-97e2-7849077cd776","Type":"ContainerDied","Data":"88b1696f302a752b60caaa27b254f99bbefb587af1ce37753295ab37a9e4ed74"} May 27 14:09:34.099498 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:34.099463 2576 generic.go:358] "Generic (PLEG): container finished" podID="3c16b52a-cd9a-4aee-97e2-7849077cd776" containerID="85be02ca2105e81229454e80416cae5d44b54a79ded0622685d398fc49a47bff" exitCode=0 May 27 14:09:34.099917 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:34.099533 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v" event={"ID":"3c16b52a-cd9a-4aee-97e2-7849077cd776","Type":"ContainerDied","Data":"85be02ca2105e81229454e80416cae5d44b54a79ded0622685d398fc49a47bff"} May 27 14:09:35.220948 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:35.220924 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v" May 27 14:09:35.297224 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:35.297192 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vszw6\" (UniqueName: \"kubernetes.io/projected/3c16b52a-cd9a-4aee-97e2-7849077cd776-kube-api-access-vszw6\") pod \"3c16b52a-cd9a-4aee-97e2-7849077cd776\" (UID: \"3c16b52a-cd9a-4aee-97e2-7849077cd776\") " May 27 14:09:35.297411 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:35.297298 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c16b52a-cd9a-4aee-97e2-7849077cd776-bundle\") pod \"3c16b52a-cd9a-4aee-97e2-7849077cd776\" (UID: \"3c16b52a-cd9a-4aee-97e2-7849077cd776\") " May 27 14:09:35.297411 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:35.297341 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c16b52a-cd9a-4aee-97e2-7849077cd776-util\") pod \"3c16b52a-cd9a-4aee-97e2-7849077cd776\" (UID: \"3c16b52a-cd9a-4aee-97e2-7849077cd776\") " May 27 14:09:35.297916 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:35.297887 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c16b52a-cd9a-4aee-97e2-7849077cd776-bundle" (OuterVolumeSpecName: "bundle") pod "3c16b52a-cd9a-4aee-97e2-7849077cd776" (UID: "3c16b52a-cd9a-4aee-97e2-7849077cd776"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:09:35.299388 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:35.299357 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c16b52a-cd9a-4aee-97e2-7849077cd776-kube-api-access-vszw6" (OuterVolumeSpecName: "kube-api-access-vszw6") pod "3c16b52a-cd9a-4aee-97e2-7849077cd776" (UID: "3c16b52a-cd9a-4aee-97e2-7849077cd776"). InnerVolumeSpecName "kube-api-access-vszw6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:09:35.301348 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:35.301306 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c16b52a-cd9a-4aee-97e2-7849077cd776-util" (OuterVolumeSpecName: "util") pod "3c16b52a-cd9a-4aee-97e2-7849077cd776" (UID: "3c16b52a-cd9a-4aee-97e2-7849077cd776"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:09:35.398702 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:35.398605 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c16b52a-cd9a-4aee-97e2-7849077cd776-bundle\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:09:35.398882 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:35.398866 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c16b52a-cd9a-4aee-97e2-7849077cd776-util\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:09:35.398926 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:35.398886 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vszw6\" (UniqueName: \"kubernetes.io/projected/3c16b52a-cd9a-4aee-97e2-7849077cd776-kube-api-access-vszw6\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:09:36.105600 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:36.105565 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v" event={"ID":"3c16b52a-cd9a-4aee-97e2-7849077cd776","Type":"ContainerDied","Data":"85218d474b5373cd735e30184242694a3cc48e91cd9312d78bced75bfb5f67ae"} May 27 14:09:36.105600 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:36.105597 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85218d474b5373cd735e30184242694a3cc48e91cd9312d78bced75bfb5f67ae" May 27 14:09:36.105840 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:36.105624 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfwn6v" May 27 14:09:40.315493 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:40.315414 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-fj9h4"] May 27 14:09:40.315827 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:40.315685 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c16b52a-cd9a-4aee-97e2-7849077cd776" containerName="pull" May 27 14:09:40.315827 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:40.315697 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c16b52a-cd9a-4aee-97e2-7849077cd776" containerName="pull" May 27 14:09:40.315827 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:40.315704 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c16b52a-cd9a-4aee-97e2-7849077cd776" containerName="extract" May 27 14:09:40.315827 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:40.315709 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c16b52a-cd9a-4aee-97e2-7849077cd776" containerName="extract" May 27 14:09:40.315827 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:40.315720 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c16b52a-cd9a-4aee-97e2-7849077cd776" containerName="util" May 27 14:09:40.315827 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:40.315725 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c16b52a-cd9a-4aee-97e2-7849077cd776" containerName="util" May 27 14:09:40.315827 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:40.315778 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c16b52a-cd9a-4aee-97e2-7849077cd776" containerName="extract" May 27 14:09:40.380349 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:40.380309 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-fj9h4"] May 27 14:09:40.380495 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:40.380352 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-fj9h4" May 27 14:09:40.383424 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:40.383404 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 27 14:09:40.383573 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:40.383541 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 27 14:09:40.383628 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:40.383580 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-gx99p\"" May 27 14:09:40.538018 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:40.537987 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b033f2d-3853-4b44-8259-7825c8ceeb6d-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-fj9h4\" (UID: \"7b033f2d-3853-4b44-8259-7825c8ceeb6d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-fj9h4" May 27 14:09:40.538199 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:40.538041 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2hct\" (UniqueName: \"kubernetes.io/projected/7b033f2d-3853-4b44-8259-7825c8ceeb6d-kube-api-access-n2hct\") pod \"cert-manager-operator-controller-manager-54b9655956-fj9h4\" (UID: \"7b033f2d-3853-4b44-8259-7825c8ceeb6d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-fj9h4" May 27 14:09:40.639230 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:40.639149 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2hct\" (UniqueName: \"kubernetes.io/projected/7b033f2d-3853-4b44-8259-7825c8ceeb6d-kube-api-access-n2hct\") pod \"cert-manager-operator-controller-manager-54b9655956-fj9h4\" (UID: \"7b033f2d-3853-4b44-8259-7825c8ceeb6d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-fj9h4" May 27 14:09:40.639230 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:40.639208 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b033f2d-3853-4b44-8259-7825c8ceeb6d-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-fj9h4\" (UID: \"7b033f2d-3853-4b44-8259-7825c8ceeb6d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-fj9h4" May 27 14:09:40.639581 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:40.639565 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b033f2d-3853-4b44-8259-7825c8ceeb6d-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-fj9h4\" (UID: \"7b033f2d-3853-4b44-8259-7825c8ceeb6d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-fj9h4" May 27 14:09:40.648358 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:40.648338 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2hct\" (UniqueName: \"kubernetes.io/projected/7b033f2d-3853-4b44-8259-7825c8ceeb6d-kube-api-access-n2hct\") pod \"cert-manager-operator-controller-manager-54b9655956-fj9h4\" (UID: \"7b033f2d-3853-4b44-8259-7825c8ceeb6d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-fj9h4" May 27 14:09:40.689340 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:40.689298 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-fj9h4" May 27 14:09:40.818365 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:40.818339 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-fj9h4"] May 27 14:09:40.820946 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:09:40.820917 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b033f2d_3853_4b44_8259_7825c8ceeb6d.slice/crio-f4469857380f44ca118ca0f18f970edc13e6879884a51456bfdc16731aa08585 WatchSource:0}: Error finding container f4469857380f44ca118ca0f18f970edc13e6879884a51456bfdc16731aa08585: Status 404 returned error can't find the container with id f4469857380f44ca118ca0f18f970edc13e6879884a51456bfdc16731aa08585 May 27 14:09:41.120317 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:41.120278 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-fj9h4" event={"ID":"7b033f2d-3853-4b44-8259-7825c8ceeb6d","Type":"ContainerStarted","Data":"f4469857380f44ca118ca0f18f970edc13e6879884a51456bfdc16731aa08585"} May 27 14:09:44.131873 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:44.131840 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-fj9h4" event={"ID":"7b033f2d-3853-4b44-8259-7825c8ceeb6d","Type":"ContainerStarted","Data":"820cfc642c6d1143b42ac6745ad7820ff07511dbd131ab28795d3efeb0c31e2b"} May 27 14:09:44.158966 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:44.158922 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-fj9h4" podStartSLOduration=1.041852195 podStartE2EDuration="4.158897004s" podCreationTimestamp="2026-05-27 14:09:40 +0000 UTC" firstStartedPulling="2026-05-27 14:09:40.823470582 +0000 UTC m=+263.176295697" lastFinishedPulling="2026-05-27 14:09:43.940515389 +0000 UTC m=+266.293340506" observedRunningTime="2026-05-27 14:09:44.15644654 +0000 UTC m=+266.509271675" watchObservedRunningTime="2026-05-27 14:09:44.158897004 +0000 UTC m=+266.511722141" May 27 14:09:44.927106 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:44.927066 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f"] May 27 14:09:44.945267 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:44.945242 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f" May 27 14:09:44.951158 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:44.951130 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 14:09:44.951535 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:44.951477 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 14:09:44.951654 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:44.951588 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cnlnn\"" May 27 14:09:44.952365 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:44.952342 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f"] May 27 14:09:45.075953 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:45.075914 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e18d180-07b9-4aef-9305-9bdd648d091d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f\" (UID: \"1e18d180-07b9-4aef-9305-9bdd648d091d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f" May 27 14:09:45.076134 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:45.075993 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlqs9\" (UniqueName: \"kubernetes.io/projected/1e18d180-07b9-4aef-9305-9bdd648d091d-kube-api-access-hlqs9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f\" (UID: \"1e18d180-07b9-4aef-9305-9bdd648d091d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f" May 27 14:09:45.076134 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:45.076031 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e18d180-07b9-4aef-9305-9bdd648d091d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f\" (UID: \"1e18d180-07b9-4aef-9305-9bdd648d091d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f" May 27 14:09:45.176519 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:45.176486 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hlqs9\" (UniqueName: \"kubernetes.io/projected/1e18d180-07b9-4aef-9305-9bdd648d091d-kube-api-access-hlqs9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f\" (UID: \"1e18d180-07b9-4aef-9305-9bdd648d091d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f" May 27 14:09:45.176990 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:45.176533 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e18d180-07b9-4aef-9305-9bdd648d091d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f\" (UID: \"1e18d180-07b9-4aef-9305-9bdd648d091d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f" May 27 14:09:45.176990 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:45.176632 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e18d180-07b9-4aef-9305-9bdd648d091d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f\" (UID: \"1e18d180-07b9-4aef-9305-9bdd648d091d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f" May 27 14:09:45.176990 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:45.176845 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e18d180-07b9-4aef-9305-9bdd648d091d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f\" (UID: \"1e18d180-07b9-4aef-9305-9bdd648d091d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f" May 27 14:09:45.176990 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:45.176921 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e18d180-07b9-4aef-9305-9bdd648d091d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f\" (UID: \"1e18d180-07b9-4aef-9305-9bdd648d091d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f" May 27 14:09:45.193924 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:45.193860 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlqs9\" (UniqueName: \"kubernetes.io/projected/1e18d180-07b9-4aef-9305-9bdd648d091d-kube-api-access-hlqs9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f\" (UID: \"1e18d180-07b9-4aef-9305-9bdd648d091d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f" May 27 14:09:45.255675 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:45.255641 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f" May 27 14:09:45.384005 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:45.383978 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f"] May 27 14:09:45.386726 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:09:45.386702 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e18d180_07b9_4aef_9305_9bdd648d091d.slice/crio-31e837aa5955e7d2b7b58ad226da1215169b2a48c029f38eb625cc897862ddeb WatchSource:0}: Error finding container 31e837aa5955e7d2b7b58ad226da1215169b2a48c029f38eb625cc897862ddeb: Status 404 returned error can't find the container with id 31e837aa5955e7d2b7b58ad226da1215169b2a48c029f38eb625cc897862ddeb May 27 14:09:46.139306 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:46.139273 2576 generic.go:358] "Generic (PLEG): container finished" podID="1e18d180-07b9-4aef-9305-9bdd648d091d" containerID="f7ef013d33761621755408b2c310c4fc07b2884799a29a05dc64eac36a5064c8" exitCode=0 May 27 14:09:46.139489 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:46.139360 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f" event={"ID":"1e18d180-07b9-4aef-9305-9bdd648d091d","Type":"ContainerDied","Data":"f7ef013d33761621755408b2c310c4fc07b2884799a29a05dc64eac36a5064c8"} May 27 14:09:46.139489 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:46.139393 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f" event={"ID":"1e18d180-07b9-4aef-9305-9bdd648d091d","Type":"ContainerStarted","Data":"31e837aa5955e7d2b7b58ad226da1215169b2a48c029f38eb625cc897862ddeb"} May 27 14:09:49.149248 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:49.149214 2576 generic.go:358] "Generic (PLEG): container finished" podID="1e18d180-07b9-4aef-9305-9bdd648d091d" containerID="82bdc568f1eb92eb565642668f268efdff2b42c2f1d540b5f75700364f5b42fb" exitCode=0 May 27 14:09:49.149644 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:49.149277 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f" event={"ID":"1e18d180-07b9-4aef-9305-9bdd648d091d","Type":"ContainerDied","Data":"82bdc568f1eb92eb565642668f268efdff2b42c2f1d540b5f75700364f5b42fb"} May 27 14:09:50.154746 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:50.154710 2576 generic.go:358] "Generic (PLEG): container finished" podID="1e18d180-07b9-4aef-9305-9bdd648d091d" containerID="2e2cf1ae8c03087e85e39bc539fdf03faf7772dd253906e938504c002a2b82a5" exitCode=0 May 27 14:09:50.155127 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:50.154779 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f" event={"ID":"1e18d180-07b9-4aef-9305-9bdd648d091d","Type":"ContainerDied","Data":"2e2cf1ae8c03087e85e39bc539fdf03faf7772dd253906e938504c002a2b82a5"} May 27 14:09:51.274404 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:51.274381 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f" May 27 14:09:51.426396 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:51.426299 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlqs9\" (UniqueName: \"kubernetes.io/projected/1e18d180-07b9-4aef-9305-9bdd648d091d-kube-api-access-hlqs9\") pod \"1e18d180-07b9-4aef-9305-9bdd648d091d\" (UID: \"1e18d180-07b9-4aef-9305-9bdd648d091d\") " May 27 14:09:51.426396 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:51.426377 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e18d180-07b9-4aef-9305-9bdd648d091d-bundle\") pod \"1e18d180-07b9-4aef-9305-9bdd648d091d\" (UID: \"1e18d180-07b9-4aef-9305-9bdd648d091d\") " May 27 14:09:51.426396 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:51.426392 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e18d180-07b9-4aef-9305-9bdd648d091d-util\") pod \"1e18d180-07b9-4aef-9305-9bdd648d091d\" (UID: \"1e18d180-07b9-4aef-9305-9bdd648d091d\") " May 27 14:09:51.426809 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:51.426780 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e18d180-07b9-4aef-9305-9bdd648d091d-bundle" (OuterVolumeSpecName: "bundle") pod "1e18d180-07b9-4aef-9305-9bdd648d091d" (UID: "1e18d180-07b9-4aef-9305-9bdd648d091d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:09:51.428310 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:51.428286 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e18d180-07b9-4aef-9305-9bdd648d091d-kube-api-access-hlqs9" (OuterVolumeSpecName: "kube-api-access-hlqs9") pod "1e18d180-07b9-4aef-9305-9bdd648d091d" (UID: "1e18d180-07b9-4aef-9305-9bdd648d091d"). InnerVolumeSpecName "kube-api-access-hlqs9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:09:51.431011 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:51.430974 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e18d180-07b9-4aef-9305-9bdd648d091d-util" (OuterVolumeSpecName: "util") pod "1e18d180-07b9-4aef-9305-9bdd648d091d" (UID: "1e18d180-07b9-4aef-9305-9bdd648d091d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:09:51.526777 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:51.526748 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlqs9\" (UniqueName: \"kubernetes.io/projected/1e18d180-07b9-4aef-9305-9bdd648d091d-kube-api-access-hlqs9\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:09:51.526777 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:51.526772 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e18d180-07b9-4aef-9305-9bdd648d091d-bundle\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:09:51.526777 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:51.526781 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e18d180-07b9-4aef-9305-9bdd648d091d-util\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:09:52.162096 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:52.162062 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f" event={"ID":"1e18d180-07b9-4aef-9305-9bdd648d091d","Type":"ContainerDied","Data":"31e837aa5955e7d2b7b58ad226da1215169b2a48c029f38eb625cc897862ddeb"} May 27 14:09:52.162096 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:52.162087 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr956f" May 27 14:09:52.162293 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:52.162093 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31e837aa5955e7d2b7b58ad226da1215169b2a48c029f38eb625cc897862ddeb" May 27 14:09:57.995089 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:57.995056 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-brq7n"] May 27 14:09:57.995625 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:57.995432 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e18d180-07b9-4aef-9305-9bdd648d091d" containerName="extract" May 27 14:09:57.995625 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:57.995453 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e18d180-07b9-4aef-9305-9bdd648d091d" containerName="extract" May 27 14:09:57.995625 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:57.995483 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e18d180-07b9-4aef-9305-9bdd648d091d" containerName="util" May 27 14:09:57.995625 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:57.995493 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e18d180-07b9-4aef-9305-9bdd648d091d" containerName="util" May 27 14:09:57.995625 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:57.995506 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e18d180-07b9-4aef-9305-9bdd648d091d" containerName="pull" May 27 14:09:57.995625 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:57.995514 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e18d180-07b9-4aef-9305-9bdd648d091d" containerName="pull" May 27 14:09:57.995625 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:57.995571 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="1e18d180-07b9-4aef-9305-9bdd648d091d" containerName="extract" May 27 14:09:57.997822 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:57.997801 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-brq7n" May 27 14:09:58.000622 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:58.000601 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 27 14:09:58.000704 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:58.000655 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-phvhx\"" May 27 14:09:58.001909 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:58.001885 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 27 14:09:58.008746 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:58.008706 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-brq7n"] May 27 14:09:58.173948 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:58.173914 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psfmg\" (UniqueName: \"kubernetes.io/projected/08e132af-ed79-43fd-bbf2-f16d95b0f18e-kube-api-access-psfmg\") pod \"cert-manager-79c8d999ff-brq7n\" (UID: \"08e132af-ed79-43fd-bbf2-f16d95b0f18e\") " pod="cert-manager/cert-manager-79c8d999ff-brq7n" May 27 14:09:58.174123 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:58.173963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08e132af-ed79-43fd-bbf2-f16d95b0f18e-bound-sa-token\") pod \"cert-manager-79c8d999ff-brq7n\" (UID: \"08e132af-ed79-43fd-bbf2-f16d95b0f18e\") " pod="cert-manager/cert-manager-79c8d999ff-brq7n" May 27 14:09:58.274420 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:58.274333 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-psfmg\" (UniqueName: \"kubernetes.io/projected/08e132af-ed79-43fd-bbf2-f16d95b0f18e-kube-api-access-psfmg\") pod \"cert-manager-79c8d999ff-brq7n\" (UID: \"08e132af-ed79-43fd-bbf2-f16d95b0f18e\") " pod="cert-manager/cert-manager-79c8d999ff-brq7n" May 27 14:09:58.274420 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:58.274398 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08e132af-ed79-43fd-bbf2-f16d95b0f18e-bound-sa-token\") pod \"cert-manager-79c8d999ff-brq7n\" (UID: \"08e132af-ed79-43fd-bbf2-f16d95b0f18e\") " pod="cert-manager/cert-manager-79c8d999ff-brq7n" May 27 14:09:58.284012 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:58.283972 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08e132af-ed79-43fd-bbf2-f16d95b0f18e-bound-sa-token\") pod \"cert-manager-79c8d999ff-brq7n\" (UID: \"08e132af-ed79-43fd-bbf2-f16d95b0f18e\") " pod="cert-manager/cert-manager-79c8d999ff-brq7n" May 27 14:09:58.284139 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:58.284116 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psfmg\" (UniqueName: \"kubernetes.io/projected/08e132af-ed79-43fd-bbf2-f16d95b0f18e-kube-api-access-psfmg\") pod \"cert-manager-79c8d999ff-brq7n\" (UID: \"08e132af-ed79-43fd-bbf2-f16d95b0f18e\") " pod="cert-manager/cert-manager-79c8d999ff-brq7n" May 27 14:09:58.305861 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:58.305842 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-brq7n" May 27 14:09:58.426870 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:58.426847 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-brq7n"] May 27 14:09:58.429261 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:09:58.429233 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08e132af_ed79_43fd_bbf2_f16d95b0f18e.slice/crio-14d35a1a09db9d5dd7e7b60c53d74e28e606efeba00733f0521e2140dd791738 WatchSource:0}: Error finding container 14d35a1a09db9d5dd7e7b60c53d74e28e606efeba00733f0521e2140dd791738: Status 404 returned error can't find the container with id 14d35a1a09db9d5dd7e7b60c53d74e28e606efeba00733f0521e2140dd791738 May 27 14:09:59.185071 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:09:59.185025 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-brq7n" event={"ID":"08e132af-ed79-43fd-bbf2-f16d95b0f18e","Type":"ContainerStarted","Data":"14d35a1a09db9d5dd7e7b60c53d74e28e606efeba00733f0521e2140dd791738"} May 27 14:10:01.192899 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:01.192814 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-brq7n" event={"ID":"08e132af-ed79-43fd-bbf2-f16d95b0f18e","Type":"ContainerStarted","Data":"eb89c3e0cf58e30a12da04814ef77efedbf07b0588292fedb18cca1f31271ad9"} May 27 14:10:01.212465 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:01.212419 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-brq7n" podStartSLOduration=1.816434833 podStartE2EDuration="4.212404633s" podCreationTimestamp="2026-05-27 14:09:57 +0000 UTC" firstStartedPulling="2026-05-27 14:09:58.431191721 +0000 UTC m=+280.784016836" lastFinishedPulling="2026-05-27 14:10:00.827161511 +0000 UTC m=+283.179986636" observedRunningTime="2026-05-27 14:10:01.210778992 +0000 UTC m=+283.563604128" watchObservedRunningTime="2026-05-27 14:10:01.212404633 +0000 UTC m=+283.565229768" May 27 14:10:01.339053 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:01.339017 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-xc6sp"] May 27 14:10:01.340847 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:01.340831 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xc6sp" May 27 14:10:01.343546 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:01.343524 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 27 14:10:01.343656 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:01.343588 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 27 14:10:01.343711 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:01.343665 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-9rxgg\"" May 27 14:10:01.351907 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:01.351878 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-xc6sp"] May 27 14:10:01.397231 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:01.397196 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f9f3a79-59c0-4fe2-a210-2d3fe8c3c8fd-tmp\") pod \"openshift-lws-operator-bfc7f696d-xc6sp\" (UID: \"8f9f3a79-59c0-4fe2-a210-2d3fe8c3c8fd\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xc6sp" May 27 14:10:01.397392 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:01.397253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qnsj\" (UniqueName: \"kubernetes.io/projected/8f9f3a79-59c0-4fe2-a210-2d3fe8c3c8fd-kube-api-access-2qnsj\") pod \"openshift-lws-operator-bfc7f696d-xc6sp\" (UID: \"8f9f3a79-59c0-4fe2-a210-2d3fe8c3c8fd\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xc6sp" May 27 14:10:01.498257 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:01.498226 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2qnsj\" (UniqueName: \"kubernetes.io/projected/8f9f3a79-59c0-4fe2-a210-2d3fe8c3c8fd-kube-api-access-2qnsj\") pod \"openshift-lws-operator-bfc7f696d-xc6sp\" (UID: \"8f9f3a79-59c0-4fe2-a210-2d3fe8c3c8fd\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xc6sp" May 27 14:10:01.498419 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:01.498362 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f9f3a79-59c0-4fe2-a210-2d3fe8c3c8fd-tmp\") pod \"openshift-lws-operator-bfc7f696d-xc6sp\" (UID: \"8f9f3a79-59c0-4fe2-a210-2d3fe8c3c8fd\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xc6sp" May 27 14:10:01.498697 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:01.498680 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f9f3a79-59c0-4fe2-a210-2d3fe8c3c8fd-tmp\") pod \"openshift-lws-operator-bfc7f696d-xc6sp\" (UID: \"8f9f3a79-59c0-4fe2-a210-2d3fe8c3c8fd\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xc6sp" May 27 14:10:01.507620 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:01.507597 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qnsj\" (UniqueName: \"kubernetes.io/projected/8f9f3a79-59c0-4fe2-a210-2d3fe8c3c8fd-kube-api-access-2qnsj\") pod \"openshift-lws-operator-bfc7f696d-xc6sp\" (UID: \"8f9f3a79-59c0-4fe2-a210-2d3fe8c3c8fd\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xc6sp" May 27 14:10:01.651059 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:01.651017 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xc6sp" May 27 14:10:01.776302 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:01.776276 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-xc6sp"] May 27 14:10:01.778876 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:10:01.778842 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f9f3a79_59c0_4fe2_a210_2d3fe8c3c8fd.slice/crio-0d8101317eda602120b8ce082efa68548b0f62a1264612a0a27a7c4233061d28 WatchSource:0}: Error finding container 0d8101317eda602120b8ce082efa68548b0f62a1264612a0a27a7c4233061d28: Status 404 returned error can't find the container with id 0d8101317eda602120b8ce082efa68548b0f62a1264612a0a27a7c4233061d28 May 27 14:10:02.197967 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:02.197878 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xc6sp" event={"ID":"8f9f3a79-59c0-4fe2-a210-2d3fe8c3c8fd","Type":"ContainerStarted","Data":"0d8101317eda602120b8ce082efa68548b0f62a1264612a0a27a7c4233061d28"} May 27 14:10:05.208188 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:05.208149 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xc6sp" event={"ID":"8f9f3a79-59c0-4fe2-a210-2d3fe8c3c8fd","Type":"ContainerStarted","Data":"caf4225e29ace59cadc4a1a12de643c5e4ff9eb412774281861c67c68229ee80"} May 27 14:10:05.228605 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:05.228556 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-xc6sp" podStartSLOduration=1.768966622 podStartE2EDuration="4.228543261s" podCreationTimestamp="2026-05-27 14:10:01 +0000 UTC" firstStartedPulling="2026-05-27 14:10:01.780476244 +0000 UTC m=+284.133301361" lastFinishedPulling="2026-05-27 14:10:04.240052886 +0000 UTC m=+286.592878000" observedRunningTime="2026-05-27 14:10:05.226311692 +0000 UTC m=+287.579136827" watchObservedRunningTime="2026-05-27 14:10:05.228543261 +0000 UTC m=+287.581368398" May 27 14:10:08.502550 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:08.502509 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg"] May 27 14:10:08.504719 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:08.504697 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg" May 27 14:10:08.507614 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:08.507594 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 14:10:08.507707 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:08.507592 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cnlnn\"" May 27 14:10:08.508874 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:08.508859 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 14:10:08.514427 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:08.514403 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg"] May 27 14:10:08.547658 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:08.547636 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52459b98-2a0f-4913-a7d1-0449952037fb-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg\" (UID: \"52459b98-2a0f-4913-a7d1-0449952037fb\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg" May 27 14:10:08.547753 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:08.547662 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52459b98-2a0f-4913-a7d1-0449952037fb-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg\" (UID: \"52459b98-2a0f-4913-a7d1-0449952037fb\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg" May 27 14:10:08.547753 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:08.547684 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x77h\" (UniqueName: \"kubernetes.io/projected/52459b98-2a0f-4913-a7d1-0449952037fb-kube-api-access-7x77h\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg\" (UID: \"52459b98-2a0f-4913-a7d1-0449952037fb\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg" May 27 14:10:08.648347 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:08.648292 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52459b98-2a0f-4913-a7d1-0449952037fb-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg\" (UID: \"52459b98-2a0f-4913-a7d1-0449952037fb\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg" May 27 14:10:08.648519 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:08.648354 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52459b98-2a0f-4913-a7d1-0449952037fb-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg\" (UID: \"52459b98-2a0f-4913-a7d1-0449952037fb\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg" May 27 14:10:08.648519 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:08.648390 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7x77h\" (UniqueName: \"kubernetes.io/projected/52459b98-2a0f-4913-a7d1-0449952037fb-kube-api-access-7x77h\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg\" (UID: \"52459b98-2a0f-4913-a7d1-0449952037fb\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg" May 27 14:10:08.648828 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:08.648803 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52459b98-2a0f-4913-a7d1-0449952037fb-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg\" (UID: \"52459b98-2a0f-4913-a7d1-0449952037fb\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg" May 27 14:10:08.648890 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:08.648803 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52459b98-2a0f-4913-a7d1-0449952037fb-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg\" (UID: \"52459b98-2a0f-4913-a7d1-0449952037fb\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg" May 27 14:10:08.664005 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:08.663985 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x77h\" (UniqueName: \"kubernetes.io/projected/52459b98-2a0f-4913-a7d1-0449952037fb-kube-api-access-7x77h\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg\" (UID: \"52459b98-2a0f-4913-a7d1-0449952037fb\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg" May 27 14:10:08.813471 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:08.813393 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg" May 27 14:10:08.941293 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:08.941176 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg"] May 27 14:10:08.943772 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:10:08.943742 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52459b98_2a0f_4913_a7d1_0449952037fb.slice/crio-420db3a54a794186a2b3fa1d4eb1db8d0e79f9326a3e78c7ddaf76ff66004bbc WatchSource:0}: Error finding container 420db3a54a794186a2b3fa1d4eb1db8d0e79f9326a3e78c7ddaf76ff66004bbc: Status 404 returned error can't find the container with id 420db3a54a794186a2b3fa1d4eb1db8d0e79f9326a3e78c7ddaf76ff66004bbc May 27 14:10:09.223377 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:09.223276 2576 generic.go:358] "Generic (PLEG): container finished" podID="52459b98-2a0f-4913-a7d1-0449952037fb" containerID="1a009c8930643a5fa1352298a1dbbf697a828c3709005ab8165e0a8b30780809" exitCode=0 May 27 14:10:09.223377 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:09.223368 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg" event={"ID":"52459b98-2a0f-4913-a7d1-0449952037fb","Type":"ContainerDied","Data":"1a009c8930643a5fa1352298a1dbbf697a828c3709005ab8165e0a8b30780809"} May 27 14:10:09.223549 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:09.223399 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg" event={"ID":"52459b98-2a0f-4913-a7d1-0449952037fb","Type":"ContainerStarted","Data":"420db3a54a794186a2b3fa1d4eb1db8d0e79f9326a3e78c7ddaf76ff66004bbc"} May 27 14:10:10.227669 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:10.227625 2576 generic.go:358] "Generic (PLEG): container finished" podID="52459b98-2a0f-4913-a7d1-0449952037fb" containerID="07f0195feab6c10eb4c5ef2e3b53bc112ff9de89080be2b5be67975efbad0969" exitCode=0 May 27 14:10:10.228063 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:10.227703 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg" event={"ID":"52459b98-2a0f-4913-a7d1-0449952037fb","Type":"ContainerDied","Data":"07f0195feab6c10eb4c5ef2e3b53bc112ff9de89080be2b5be67975efbad0969"} May 27 14:10:11.232274 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:11.232245 2576 generic.go:358] "Generic (PLEG): container finished" podID="52459b98-2a0f-4913-a7d1-0449952037fb" containerID="47699f964d128f3d4dd2dd40239079cddefbd2d5f62bb3e580a88396a7777343" exitCode=0 May 27 14:10:11.232635 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:11.232343 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg" event={"ID":"52459b98-2a0f-4913-a7d1-0449952037fb","Type":"ContainerDied","Data":"47699f964d128f3d4dd2dd40239079cddefbd2d5f62bb3e580a88396a7777343"} May 27 14:10:12.358668 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:12.358643 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg" May 27 14:10:12.375065 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:12.375041 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7x77h\" (UniqueName: \"kubernetes.io/projected/52459b98-2a0f-4913-a7d1-0449952037fb-kube-api-access-7x77h\") pod \"52459b98-2a0f-4913-a7d1-0449952037fb\" (UID: \"52459b98-2a0f-4913-a7d1-0449952037fb\") " May 27 14:10:12.375182 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:12.375104 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52459b98-2a0f-4913-a7d1-0449952037fb-bundle\") pod \"52459b98-2a0f-4913-a7d1-0449952037fb\" (UID: \"52459b98-2a0f-4913-a7d1-0449952037fb\") " May 27 14:10:12.375182 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:12.375135 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52459b98-2a0f-4913-a7d1-0449952037fb-util\") pod \"52459b98-2a0f-4913-a7d1-0449952037fb\" (UID: \"52459b98-2a0f-4913-a7d1-0449952037fb\") " May 27 14:10:12.375849 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:12.375824 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52459b98-2a0f-4913-a7d1-0449952037fb-bundle" (OuterVolumeSpecName: "bundle") pod "52459b98-2a0f-4913-a7d1-0449952037fb" (UID: "52459b98-2a0f-4913-a7d1-0449952037fb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:10:12.377156 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:12.377133 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52459b98-2a0f-4913-a7d1-0449952037fb-kube-api-access-7x77h" (OuterVolumeSpecName: "kube-api-access-7x77h") pod "52459b98-2a0f-4913-a7d1-0449952037fb" (UID: "52459b98-2a0f-4913-a7d1-0449952037fb"). InnerVolumeSpecName "kube-api-access-7x77h". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:10:12.381491 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:12.381462 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52459b98-2a0f-4913-a7d1-0449952037fb-util" (OuterVolumeSpecName: "util") pod "52459b98-2a0f-4913-a7d1-0449952037fb" (UID: "52459b98-2a0f-4913-a7d1-0449952037fb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:10:12.475703 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:12.475665 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52459b98-2a0f-4913-a7d1-0449952037fb-util\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:10:12.475703 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:12.475697 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7x77h\" (UniqueName: \"kubernetes.io/projected/52459b98-2a0f-4913-a7d1-0449952037fb-kube-api-access-7x77h\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:10:12.475703 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:12.475708 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52459b98-2a0f-4913-a7d1-0449952037fb-bundle\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:10:13.240549 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:13.240512 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg" event={"ID":"52459b98-2a0f-4913-a7d1-0449952037fb","Type":"ContainerDied","Data":"420db3a54a794186a2b3fa1d4eb1db8d0e79f9326a3e78c7ddaf76ff66004bbc"} May 27 14:10:13.240549 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:13.240533 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c59dnjg" May 27 14:10:13.240549 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:13.240542 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="420db3a54a794186a2b3fa1d4eb1db8d0e79f9326a3e78c7ddaf76ff66004bbc" May 27 14:10:18.183940 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.183911 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wd4m8_61335746-8301-4cff-bbe5-8da818657d5d/ovn-acl-logging/0.log" May 27 14:10:18.184539 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.184355 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wd4m8_61335746-8301-4cff-bbe5-8da818657d5d/ovn-acl-logging/0.log" May 27 14:10:18.187311 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.187293 2576 kubelet.go:1628] "Image garbage collection succeeded" May 27 14:10:18.510424 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.510391 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz"] May 27 14:10:18.512599 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.510683 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52459b98-2a0f-4913-a7d1-0449952037fb" containerName="extract" May 27 14:10:18.512599 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.510694 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="52459b98-2a0f-4913-a7d1-0449952037fb" containerName="extract" May 27 14:10:18.512599 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.510702 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52459b98-2a0f-4913-a7d1-0449952037fb" containerName="util" May 27 14:10:18.512599 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.510707 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="52459b98-2a0f-4913-a7d1-0449952037fb" containerName="util" May 27 14:10:18.512599 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.510717 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52459b98-2a0f-4913-a7d1-0449952037fb" containerName="pull" May 27 14:10:18.512599 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.510726 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="52459b98-2a0f-4913-a7d1-0449952037fb" containerName="pull" May 27 14:10:18.512599 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.510769 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="52459b98-2a0f-4913-a7d1-0449952037fb" containerName="extract" May 27 14:10:18.513538 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.513523 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz" May 27 14:10:18.516282 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.516256 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cnlnn\"" May 27 14:10:18.516451 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.516434 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 14:10:18.517574 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.517556 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 14:10:18.522024 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.522001 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz"] May 27 14:10:18.621481 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.621447 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ac3e464-af57-4431-9718-6b6d409f3431-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz\" (UID: \"0ac3e464-af57-4431-9718-6b6d409f3431\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz" May 27 14:10:18.621669 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.621524 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ac3e464-af57-4431-9718-6b6d409f3431-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz\" (UID: \"0ac3e464-af57-4431-9718-6b6d409f3431\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz" May 27 14:10:18.621669 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.621560 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv65h\" (UniqueName: \"kubernetes.io/projected/0ac3e464-af57-4431-9718-6b6d409f3431-kube-api-access-bv65h\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz\" (UID: \"0ac3e464-af57-4431-9718-6b6d409f3431\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz" May 27 14:10:18.722208 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.722169 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ac3e464-af57-4431-9718-6b6d409f3431-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz\" (UID: \"0ac3e464-af57-4431-9718-6b6d409f3431\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz" May 27 14:10:18.722454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.722215 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bv65h\" (UniqueName: \"kubernetes.io/projected/0ac3e464-af57-4431-9718-6b6d409f3431-kube-api-access-bv65h\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz\" (UID: \"0ac3e464-af57-4431-9718-6b6d409f3431\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz" May 27 14:10:18.722454 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.722279 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ac3e464-af57-4431-9718-6b6d409f3431-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz\" (UID: \"0ac3e464-af57-4431-9718-6b6d409f3431\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz" May 27 14:10:18.722593 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.722555 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ac3e464-af57-4431-9718-6b6d409f3431-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz\" (UID: \"0ac3e464-af57-4431-9718-6b6d409f3431\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz" May 27 14:10:18.722669 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.722648 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ac3e464-af57-4431-9718-6b6d409f3431-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz\" (UID: \"0ac3e464-af57-4431-9718-6b6d409f3431\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz" May 27 14:10:18.732538 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.732515 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv65h\" (UniqueName: \"kubernetes.io/projected/0ac3e464-af57-4431-9718-6b6d409f3431-kube-api-access-bv65h\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz\" (UID: \"0ac3e464-af57-4431-9718-6b6d409f3431\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz" May 27 14:10:18.823209 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.823128 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz" May 27 14:10:18.948218 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:18.948152 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz"] May 27 14:10:18.954094 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:10:18.954062 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ac3e464_af57_4431_9718_6b6d409f3431.slice/crio-aad594974041732a86049d315df845c93379804b2e35ca320a4bff83a6daf4d0 WatchSource:0}: Error finding container aad594974041732a86049d315df845c93379804b2e35ca320a4bff83a6daf4d0: Status 404 returned error can't find the container with id aad594974041732a86049d315df845c93379804b2e35ca320a4bff83a6daf4d0 May 27 14:10:19.260593 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:19.260562 2576 generic.go:358] "Generic (PLEG): container finished" podID="0ac3e464-af57-4431-9718-6b6d409f3431" containerID="1d90d4fea5d587aae843676cf2529e22c87245075f9a96993d0a563f8a44f860" exitCode=0 May 27 14:10:19.261033 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:19.260603 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz" event={"ID":"0ac3e464-af57-4431-9718-6b6d409f3431","Type":"ContainerDied","Data":"1d90d4fea5d587aae843676cf2529e22c87245075f9a96993d0a563f8a44f860"} May 27 14:10:19.261033 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:19.260622 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz" event={"ID":"0ac3e464-af57-4431-9718-6b6d409f3431","Type":"ContainerStarted","Data":"aad594974041732a86049d315df845c93379804b2e35ca320a4bff83a6daf4d0"} May 27 14:10:20.269252 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:20.269205 2576 generic.go:358] "Generic (PLEG): container finished" podID="0ac3e464-af57-4431-9718-6b6d409f3431" containerID="cf8dd9723e2b952d1e3e576a223cc5cf0c8f72fe4b404da80ae200e9287ea665" exitCode=0 May 27 14:10:20.269642 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:20.269284 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz" event={"ID":"0ac3e464-af57-4431-9718-6b6d409f3431","Type":"ContainerDied","Data":"cf8dd9723e2b952d1e3e576a223cc5cf0c8f72fe4b404da80ae200e9287ea665"} May 27 14:10:20.270397 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:20.270378 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 14:10:20.285719 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:20.285694 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-7pzfh"] May 27 14:10:20.290410 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:20.290386 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-7pzfh" May 27 14:10:20.295026 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:20.295005 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 27 14:10:20.295120 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:20.295103 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 27 14:10:20.295676 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:20.295662 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5l4zf\"" May 27 14:10:20.296080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:20.296065 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 27 14:10:20.298421 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:20.298408 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 27 14:10:20.311242 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:20.311219 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-7pzfh"] May 27 14:10:20.331799 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:20.331774 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/284a1001-72b8-4cd9-b65a-80716497cffc-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f4c796d7c-7pzfh\" (UID: \"284a1001-72b8-4cd9-b65a-80716497cffc\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-7pzfh" May 27 14:10:20.331905 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:20.331829 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k9cp\" (UniqueName: \"kubernetes.io/projected/284a1001-72b8-4cd9-b65a-80716497cffc-kube-api-access-7k9cp\") pod \"opendatahub-operator-controller-manager-5f4c796d7c-7pzfh\" (UID: \"284a1001-72b8-4cd9-b65a-80716497cffc\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-7pzfh" May 27 14:10:20.331955 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:20.331927 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/284a1001-72b8-4cd9-b65a-80716497cffc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f4c796d7c-7pzfh\" (UID: \"284a1001-72b8-4cd9-b65a-80716497cffc\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-7pzfh" May 27 14:10:20.432976 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:20.432946 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/284a1001-72b8-4cd9-b65a-80716497cffc-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f4c796d7c-7pzfh\" (UID: \"284a1001-72b8-4cd9-b65a-80716497cffc\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-7pzfh" May 27 14:10:20.433101 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:20.433008 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7k9cp\" (UniqueName: \"kubernetes.io/projected/284a1001-72b8-4cd9-b65a-80716497cffc-kube-api-access-7k9cp\") pod \"opendatahub-operator-controller-manager-5f4c796d7c-7pzfh\" (UID: \"284a1001-72b8-4cd9-b65a-80716497cffc\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-7pzfh" May 27 14:10:20.433101 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:20.433093 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/284a1001-72b8-4cd9-b65a-80716497cffc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f4c796d7c-7pzfh\" (UID: \"284a1001-72b8-4cd9-b65a-80716497cffc\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-7pzfh" May 27 14:10:20.435158 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:20.435134 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/284a1001-72b8-4cd9-b65a-80716497cffc-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f4c796d7c-7pzfh\" (UID: \"284a1001-72b8-4cd9-b65a-80716497cffc\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-7pzfh" May 27 14:10:20.435253 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:20.435228 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/284a1001-72b8-4cd9-b65a-80716497cffc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f4c796d7c-7pzfh\" (UID: \"284a1001-72b8-4cd9-b65a-80716497cffc\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-7pzfh" May 27 14:10:20.442069 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:20.442045 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k9cp\" (UniqueName: \"kubernetes.io/projected/284a1001-72b8-4cd9-b65a-80716497cffc-kube-api-access-7k9cp\") pod \"opendatahub-operator-controller-manager-5f4c796d7c-7pzfh\" (UID: \"284a1001-72b8-4cd9-b65a-80716497cffc\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-7pzfh" May 27 14:10:20.612288 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:20.612207 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-7pzfh" May 27 14:10:20.746424 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:20.746401 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-7pzfh"] May 27 14:10:20.748873 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:10:20.748841 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod284a1001_72b8_4cd9_b65a_80716497cffc.slice/crio-1f0a1feecd55b4748aea1a129a90ea994542b52869505560302713ff575fb5c2 WatchSource:0}: Error finding container 1f0a1feecd55b4748aea1a129a90ea994542b52869505560302713ff575fb5c2: Status 404 returned error can't find the container with id 1f0a1feecd55b4748aea1a129a90ea994542b52869505560302713ff575fb5c2 May 27 14:10:21.274703 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:21.274665 2576 generic.go:358] "Generic (PLEG): container finished" podID="0ac3e464-af57-4431-9718-6b6d409f3431" containerID="2721ee1fd2a30cb19827247a89f71e368fa057f89e9074449463cb1b5bfb42ce" exitCode=0 May 27 14:10:21.275171 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:21.274744 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz" event={"ID":"0ac3e464-af57-4431-9718-6b6d409f3431","Type":"ContainerDied","Data":"2721ee1fd2a30cb19827247a89f71e368fa057f89e9074449463cb1b5bfb42ce"} May 27 14:10:21.276045 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:21.276021 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-7pzfh" event={"ID":"284a1001-72b8-4cd9-b65a-80716497cffc","Type":"ContainerStarted","Data":"1f0a1feecd55b4748aea1a129a90ea994542b52869505560302713ff575fb5c2"} May 27 14:10:23.148272 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:23.148249 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz" May 27 14:10:23.258579 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:23.258548 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ac3e464-af57-4431-9718-6b6d409f3431-util\") pod \"0ac3e464-af57-4431-9718-6b6d409f3431\" (UID: \"0ac3e464-af57-4431-9718-6b6d409f3431\") " May 27 14:10:23.258742 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:23.258597 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bv65h\" (UniqueName: \"kubernetes.io/projected/0ac3e464-af57-4431-9718-6b6d409f3431-kube-api-access-bv65h\") pod \"0ac3e464-af57-4431-9718-6b6d409f3431\" (UID: \"0ac3e464-af57-4431-9718-6b6d409f3431\") " May 27 14:10:23.258742 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:23.258637 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ac3e464-af57-4431-9718-6b6d409f3431-bundle\") pod \"0ac3e464-af57-4431-9718-6b6d409f3431\" (UID: \"0ac3e464-af57-4431-9718-6b6d409f3431\") " May 27 14:10:23.259612 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:23.259587 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ac3e464-af57-4431-9718-6b6d409f3431-bundle" (OuterVolumeSpecName: "bundle") pod "0ac3e464-af57-4431-9718-6b6d409f3431" (UID: "0ac3e464-af57-4431-9718-6b6d409f3431"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:10:23.260644 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:23.260613 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ac3e464-af57-4431-9718-6b6d409f3431-kube-api-access-bv65h" (OuterVolumeSpecName: "kube-api-access-bv65h") pod "0ac3e464-af57-4431-9718-6b6d409f3431" (UID: "0ac3e464-af57-4431-9718-6b6d409f3431"). InnerVolumeSpecName "kube-api-access-bv65h". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:10:23.263849 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:23.263806 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ac3e464-af57-4431-9718-6b6d409f3431-util" (OuterVolumeSpecName: "util") pod "0ac3e464-af57-4431-9718-6b6d409f3431" (UID: "0ac3e464-af57-4431-9718-6b6d409f3431"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:10:23.284227 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:23.284194 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz" event={"ID":"0ac3e464-af57-4431-9718-6b6d409f3431","Type":"ContainerDied","Data":"aad594974041732a86049d315df845c93379804b2e35ca320a4bff83a6daf4d0"} May 27 14:10:23.284227 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:23.284225 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c94ltfz" May 27 14:10:23.284227 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:23.284234 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aad594974041732a86049d315df845c93379804b2e35ca320a4bff83a6daf4d0" May 27 14:10:23.285749 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:23.285700 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-7pzfh" event={"ID":"284a1001-72b8-4cd9-b65a-80716497cffc","Type":"ContainerStarted","Data":"ca62e5a6ffd92f2587d13d3ff727738f22625b1e7b16959b1311c2460eeab883"} May 27 14:10:23.285889 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:23.285809 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-7pzfh" May 27 14:10:23.315572 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:23.315527 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-7pzfh" podStartSLOduration=0.898257817 podStartE2EDuration="3.315512404s" podCreationTimestamp="2026-05-27 14:10:20 +0000 UTC" firstStartedPulling="2026-05-27 14:10:20.750690388 +0000 UTC m=+303.103515508" lastFinishedPulling="2026-05-27 14:10:23.167944977 +0000 UTC m=+305.520770095" observedRunningTime="2026-05-27 14:10:23.314538971 +0000 UTC m=+305.667364107" watchObservedRunningTime="2026-05-27 14:10:23.315512404 +0000 UTC m=+305.668337541" May 27 14:10:23.359796 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:23.359759 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ac3e464-af57-4431-9718-6b6d409f3431-util\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:10:23.359796 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:23.359794 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bv65h\" (UniqueName: \"kubernetes.io/projected/0ac3e464-af57-4431-9718-6b6d409f3431-kube-api-access-bv65h\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:10:23.360021 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:23.359808 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ac3e464-af57-4431-9718-6b6d409f3431-bundle\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:10:34.290812 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:34.290782 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f4c796d7c-7pzfh" May 27 14:10:37.596030 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:37.595991 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls"] May 27 14:10:37.596430 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:37.596251 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ac3e464-af57-4431-9718-6b6d409f3431" containerName="util" May 27 14:10:37.596430 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:37.596262 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ac3e464-af57-4431-9718-6b6d409f3431" containerName="util" May 27 14:10:37.596430 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:37.596277 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ac3e464-af57-4431-9718-6b6d409f3431" containerName="extract" May 27 14:10:37.596430 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:37.596283 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ac3e464-af57-4431-9718-6b6d409f3431" containerName="extract" May 27 14:10:37.596430 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:37.596291 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ac3e464-af57-4431-9718-6b6d409f3431" containerName="pull" May 27 14:10:37.596430 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:37.596296 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ac3e464-af57-4431-9718-6b6d409f3431" containerName="pull" May 27 14:10:37.596430 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:37.596353 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="0ac3e464-af57-4431-9718-6b6d409f3431" containerName="extract" May 27 14:10:37.601512 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:37.601493 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls" May 27 14:10:37.605217 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:37.605200 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cnlnn\"" May 27 14:10:37.605410 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:37.605393 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 14:10:37.606548 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:37.606522 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 14:10:37.623103 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:37.623076 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls"] May 27 14:10:37.672061 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:37.672031 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75042a2f-a990-4718-a5d7-26e6c24ecba9-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls\" (UID: \"75042a2f-a990-4718-a5d7-26e6c24ecba9\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls" May 27 14:10:37.672209 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:37.672068 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7khs\" (UniqueName: \"kubernetes.io/projected/75042a2f-a990-4718-a5d7-26e6c24ecba9-kube-api-access-q7khs\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls\" (UID: \"75042a2f-a990-4718-a5d7-26e6c24ecba9\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls" May 27 14:10:37.672209 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:37.672114 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75042a2f-a990-4718-a5d7-26e6c24ecba9-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls\" (UID: \"75042a2f-a990-4718-a5d7-26e6c24ecba9\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls" May 27 14:10:37.772528 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:37.772495 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75042a2f-a990-4718-a5d7-26e6c24ecba9-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls\" (UID: \"75042a2f-a990-4718-a5d7-26e6c24ecba9\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls" May 27 14:10:37.772731 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:37.772551 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75042a2f-a990-4718-a5d7-26e6c24ecba9-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls\" (UID: \"75042a2f-a990-4718-a5d7-26e6c24ecba9\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls" May 27 14:10:37.772813 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:37.772796 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q7khs\" (UniqueName: \"kubernetes.io/projected/75042a2f-a990-4718-a5d7-26e6c24ecba9-kube-api-access-q7khs\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls\" (UID: \"75042a2f-a990-4718-a5d7-26e6c24ecba9\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls" May 27 14:10:37.773005 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:37.772981 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75042a2f-a990-4718-a5d7-26e6c24ecba9-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls\" (UID: \"75042a2f-a990-4718-a5d7-26e6c24ecba9\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls" May 27 14:10:37.773057 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:37.773005 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75042a2f-a990-4718-a5d7-26e6c24ecba9-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls\" (UID: \"75042a2f-a990-4718-a5d7-26e6c24ecba9\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls" May 27 14:10:37.798524 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:37.798492 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7khs\" (UniqueName: \"kubernetes.io/projected/75042a2f-a990-4718-a5d7-26e6c24ecba9-kube-api-access-q7khs\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls\" (UID: \"75042a2f-a990-4718-a5d7-26e6c24ecba9\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls" May 27 14:10:37.910517 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:37.910423 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls" May 27 14:10:38.061652 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:38.061621 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls"] May 27 14:10:38.063642 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:10:38.063609 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75042a2f_a990_4718_a5d7_26e6c24ecba9.slice/crio-202305fc6d13fdc9d27f9c276d5d00ab978c7daa303ba106d2c5602b6ec9df10 WatchSource:0}: Error finding container 202305fc6d13fdc9d27f9c276d5d00ab978c7daa303ba106d2c5602b6ec9df10: Status 404 returned error can't find the container with id 202305fc6d13fdc9d27f9c276d5d00ab978c7daa303ba106d2c5602b6ec9df10 May 27 14:10:38.333063 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:38.333024 2576 generic.go:358] "Generic (PLEG): container finished" podID="75042a2f-a990-4718-a5d7-26e6c24ecba9" containerID="a48cd32ad3f81a8ad9d9e7fbdc74fd949e368ea163f561e9e6a2bfcb59ac9af1" exitCode=0 May 27 14:10:38.333248 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:38.333110 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls" event={"ID":"75042a2f-a990-4718-a5d7-26e6c24ecba9","Type":"ContainerDied","Data":"a48cd32ad3f81a8ad9d9e7fbdc74fd949e368ea163f561e9e6a2bfcb59ac9af1"} May 27 14:10:38.333248 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:38.333147 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls" event={"ID":"75042a2f-a990-4718-a5d7-26e6c24ecba9","Type":"ContainerStarted","Data":"202305fc6d13fdc9d27f9c276d5d00ab978c7daa303ba106d2c5602b6ec9df10"} May 27 14:10:38.832762 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:38.832733 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6f84cc5569-224hw"] May 27 14:10:38.835825 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:38.835806 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f84cc5569-224hw" May 27 14:10:38.838938 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:38.838912 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 27 14:10:38.840308 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:38.840293 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 27 14:10:38.840574 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:38.840560 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qqtj5\"" May 27 14:10:38.840642 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:38.840562 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 27 14:10:38.840642 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:38.840559 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 27 14:10:38.852519 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:38.848217 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f84cc5569-224hw"] May 27 14:10:38.882229 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:38.882189 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3343c1aa-3a4a-45ea-80b2-ec85164b503a-tmp\") pod \"kube-auth-proxy-6f84cc5569-224hw\" (UID: \"3343c1aa-3a4a-45ea-80b2-ec85164b503a\") " pod="openshift-ingress/kube-auth-proxy-6f84cc5569-224hw" May 27 14:10:38.882429 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:38.882253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3343c1aa-3a4a-45ea-80b2-ec85164b503a-tls-certs\") pod \"kube-auth-proxy-6f84cc5569-224hw\" (UID: \"3343c1aa-3a4a-45ea-80b2-ec85164b503a\") " pod="openshift-ingress/kube-auth-proxy-6f84cc5569-224hw" May 27 14:10:38.882429 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:38.882307 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d44xr\" (UniqueName: \"kubernetes.io/projected/3343c1aa-3a4a-45ea-80b2-ec85164b503a-kube-api-access-d44xr\") pod \"kube-auth-proxy-6f84cc5569-224hw\" (UID: \"3343c1aa-3a4a-45ea-80b2-ec85164b503a\") " pod="openshift-ingress/kube-auth-proxy-6f84cc5569-224hw" May 27 14:10:38.983600 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:38.983566 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3343c1aa-3a4a-45ea-80b2-ec85164b503a-tls-certs\") pod \"kube-auth-proxy-6f84cc5569-224hw\" (UID: \"3343c1aa-3a4a-45ea-80b2-ec85164b503a\") " pod="openshift-ingress/kube-auth-proxy-6f84cc5569-224hw" May 27 14:10:38.983772 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:38.983620 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d44xr\" (UniqueName: \"kubernetes.io/projected/3343c1aa-3a4a-45ea-80b2-ec85164b503a-kube-api-access-d44xr\") pod \"kube-auth-proxy-6f84cc5569-224hw\" (UID: \"3343c1aa-3a4a-45ea-80b2-ec85164b503a\") " pod="openshift-ingress/kube-auth-proxy-6f84cc5569-224hw" May 27 14:10:38.983772 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:38.983668 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3343c1aa-3a4a-45ea-80b2-ec85164b503a-tmp\") pod \"kube-auth-proxy-6f84cc5569-224hw\" (UID: \"3343c1aa-3a4a-45ea-80b2-ec85164b503a\") " pod="openshift-ingress/kube-auth-proxy-6f84cc5569-224hw" May 27 14:10:38.985875 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:38.985848 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3343c1aa-3a4a-45ea-80b2-ec85164b503a-tmp\") pod \"kube-auth-proxy-6f84cc5569-224hw\" (UID: \"3343c1aa-3a4a-45ea-80b2-ec85164b503a\") " pod="openshift-ingress/kube-auth-proxy-6f84cc5569-224hw" May 27 14:10:38.986200 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:38.986176 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3343c1aa-3a4a-45ea-80b2-ec85164b503a-tls-certs\") pod \"kube-auth-proxy-6f84cc5569-224hw\" (UID: \"3343c1aa-3a4a-45ea-80b2-ec85164b503a\") " pod="openshift-ingress/kube-auth-proxy-6f84cc5569-224hw" May 27 14:10:38.993822 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:38.993794 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d44xr\" (UniqueName: \"kubernetes.io/projected/3343c1aa-3a4a-45ea-80b2-ec85164b503a-kube-api-access-d44xr\") pod \"kube-auth-proxy-6f84cc5569-224hw\" (UID: \"3343c1aa-3a4a-45ea-80b2-ec85164b503a\") " pod="openshift-ingress/kube-auth-proxy-6f84cc5569-224hw" May 27 14:10:39.144974 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:39.144950 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f84cc5569-224hw" May 27 14:10:39.279499 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:39.279475 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f84cc5569-224hw"] May 27 14:10:39.280834 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:10:39.280806 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3343c1aa_3a4a_45ea_80b2_ec85164b503a.slice/crio-ea1525d429c20cceaeac250fb50d2c3b9d4a53d903892725ab58e5fac93bfb9a WatchSource:0}: Error finding container ea1525d429c20cceaeac250fb50d2c3b9d4a53d903892725ab58e5fac93bfb9a: Status 404 returned error can't find the container with id ea1525d429c20cceaeac250fb50d2c3b9d4a53d903892725ab58e5fac93bfb9a May 27 14:10:39.338499 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:39.338403 2576 generic.go:358] "Generic (PLEG): container finished" podID="75042a2f-a990-4718-a5d7-26e6c24ecba9" containerID="db07ec1d4bc01f953557205ea2318e5b5e9b47e542b275ad83b25094354b119c" exitCode=0 May 27 14:10:39.338499 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:39.338479 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls" event={"ID":"75042a2f-a990-4718-a5d7-26e6c24ecba9","Type":"ContainerDied","Data":"db07ec1d4bc01f953557205ea2318e5b5e9b47e542b275ad83b25094354b119c"} May 27 14:10:39.339531 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:39.339508 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f84cc5569-224hw" event={"ID":"3343c1aa-3a4a-45ea-80b2-ec85164b503a","Type":"ContainerStarted","Data":"ea1525d429c20cceaeac250fb50d2c3b9d4a53d903892725ab58e5fac93bfb9a"} May 27 14:10:40.345099 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:40.345058 2576 generic.go:358] "Generic (PLEG): container finished" podID="75042a2f-a990-4718-a5d7-26e6c24ecba9" containerID="9ab8d9dea3a0b1563c9780a5b643335fe76e38cfa824a7f324ec070fc82601a7" exitCode=0 May 27 14:10:40.345471 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:40.345140 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls" event={"ID":"75042a2f-a990-4718-a5d7-26e6c24ecba9","Type":"ContainerDied","Data":"9ab8d9dea3a0b1563c9780a5b643335fe76e38cfa824a7f324ec070fc82601a7"} May 27 14:10:41.483532 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:41.483503 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls" May 27 14:10:41.602640 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:41.602561 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75042a2f-a990-4718-a5d7-26e6c24ecba9-bundle\") pod \"75042a2f-a990-4718-a5d7-26e6c24ecba9\" (UID: \"75042a2f-a990-4718-a5d7-26e6c24ecba9\") " May 27 14:10:41.602640 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:41.602611 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7khs\" (UniqueName: \"kubernetes.io/projected/75042a2f-a990-4718-a5d7-26e6c24ecba9-kube-api-access-q7khs\") pod \"75042a2f-a990-4718-a5d7-26e6c24ecba9\" (UID: \"75042a2f-a990-4718-a5d7-26e6c24ecba9\") " May 27 14:10:41.602859 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:41.602650 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75042a2f-a990-4718-a5d7-26e6c24ecba9-util\") pod \"75042a2f-a990-4718-a5d7-26e6c24ecba9\" (UID: \"75042a2f-a990-4718-a5d7-26e6c24ecba9\") " May 27 14:10:41.603770 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:41.603739 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75042a2f-a990-4718-a5d7-26e6c24ecba9-bundle" (OuterVolumeSpecName: "bundle") pod "75042a2f-a990-4718-a5d7-26e6c24ecba9" (UID: "75042a2f-a990-4718-a5d7-26e6c24ecba9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:10:41.605208 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:41.605180 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75042a2f-a990-4718-a5d7-26e6c24ecba9-kube-api-access-q7khs" (OuterVolumeSpecName: "kube-api-access-q7khs") pod "75042a2f-a990-4718-a5d7-26e6c24ecba9" (UID: "75042a2f-a990-4718-a5d7-26e6c24ecba9"). InnerVolumeSpecName "kube-api-access-q7khs". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:10:41.609525 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:41.609498 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75042a2f-a990-4718-a5d7-26e6c24ecba9-util" (OuterVolumeSpecName: "util") pod "75042a2f-a990-4718-a5d7-26e6c24ecba9" (UID: "75042a2f-a990-4718-a5d7-26e6c24ecba9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:10:41.703549 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:41.703515 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7khs\" (UniqueName: \"kubernetes.io/projected/75042a2f-a990-4718-a5d7-26e6c24ecba9-kube-api-access-q7khs\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:10:41.703549 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:41.703545 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75042a2f-a990-4718-a5d7-26e6c24ecba9-util\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:10:41.703549 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:41.703556 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75042a2f-a990-4718-a5d7-26e6c24ecba9-bundle\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:10:42.262859 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:42.262823 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-t8crp"] May 27 14:10:42.263234 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:42.263215 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75042a2f-a990-4718-a5d7-26e6c24ecba9" containerName="util" May 27 14:10:42.263234 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:42.263234 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="75042a2f-a990-4718-a5d7-26e6c24ecba9" containerName="util" May 27 14:10:42.263423 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:42.263260 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75042a2f-a990-4718-a5d7-26e6c24ecba9" containerName="pull" May 27 14:10:42.263423 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:42.263269 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="75042a2f-a990-4718-a5d7-26e6c24ecba9" containerName="pull" May 27 14:10:42.263423 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:42.263285 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75042a2f-a990-4718-a5d7-26e6c24ecba9" containerName="extract" May 27 14:10:42.263423 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:42.263294 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="75042a2f-a990-4718-a5d7-26e6c24ecba9" containerName="extract" May 27 14:10:42.263423 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:42.263381 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="75042a2f-a990-4718-a5d7-26e6c24ecba9" containerName="extract" May 27 14:10:42.267417 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:42.267395 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-t8crp" May 27 14:10:42.272768 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:42.272050 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 27 14:10:42.272768 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:42.272067 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-wtfq9\"" May 27 14:10:42.275609 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:42.275584 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-t8crp"] May 27 14:10:42.354134 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:42.354088 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls" event={"ID":"75042a2f-a990-4718-a5d7-26e6c24ecba9","Type":"ContainerDied","Data":"202305fc6d13fdc9d27f9c276d5d00ab978c7daa303ba106d2c5602b6ec9df10"} May 27 14:10:42.354134 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:42.354130 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="202305fc6d13fdc9d27f9c276d5d00ab978c7daa303ba106d2c5602b6ec9df10" May 27 14:10:42.354337 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:42.354159 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gwxls" May 27 14:10:42.408374 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:42.408305 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/542a89ff-4ca4-45db-ac83-6d9463732d5d-cert\") pod \"odh-model-controller-858dbf95b8-t8crp\" (UID: \"542a89ff-4ca4-45db-ac83-6d9463732d5d\") " pod="opendatahub/odh-model-controller-858dbf95b8-t8crp" May 27 14:10:42.408547 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:42.408408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcgxr\" (UniqueName: \"kubernetes.io/projected/542a89ff-4ca4-45db-ac83-6d9463732d5d-kube-api-access-wcgxr\") pod \"odh-model-controller-858dbf95b8-t8crp\" (UID: \"542a89ff-4ca4-45db-ac83-6d9463732d5d\") " pod="opendatahub/odh-model-controller-858dbf95b8-t8crp" May 27 14:10:42.509193 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:42.509161 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/542a89ff-4ca4-45db-ac83-6d9463732d5d-cert\") pod \"odh-model-controller-858dbf95b8-t8crp\" (UID: \"542a89ff-4ca4-45db-ac83-6d9463732d5d\") " pod="opendatahub/odh-model-controller-858dbf95b8-t8crp" May 27 14:10:42.509667 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:42.509221 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wcgxr\" (UniqueName: \"kubernetes.io/projected/542a89ff-4ca4-45db-ac83-6d9463732d5d-kube-api-access-wcgxr\") pod \"odh-model-controller-858dbf95b8-t8crp\" (UID: \"542a89ff-4ca4-45db-ac83-6d9463732d5d\") " pod="opendatahub/odh-model-controller-858dbf95b8-t8crp" May 27 14:10:42.509667 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:10:42.509347 2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 27 14:10:42.509667 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:10:42.509438 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/542a89ff-4ca4-45db-ac83-6d9463732d5d-cert podName:542a89ff-4ca4-45db-ac83-6d9463732d5d nodeName:}" failed. No retries permitted until 2026-05-27 14:10:43.009415386 +0000 UTC m=+325.362240500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/542a89ff-4ca4-45db-ac83-6d9463732d5d-cert") pod "odh-model-controller-858dbf95b8-t8crp" (UID: "542a89ff-4ca4-45db-ac83-6d9463732d5d") : secret "odh-model-controller-webhook-cert" not found May 27 14:10:42.519697 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:42.519631 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcgxr\" (UniqueName: \"kubernetes.io/projected/542a89ff-4ca4-45db-ac83-6d9463732d5d-kube-api-access-wcgxr\") pod \"odh-model-controller-858dbf95b8-t8crp\" (UID: \"542a89ff-4ca4-45db-ac83-6d9463732d5d\") " pod="opendatahub/odh-model-controller-858dbf95b8-t8crp" May 27 14:10:43.014481 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:43.014452 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/542a89ff-4ca4-45db-ac83-6d9463732d5d-cert\") pod \"odh-model-controller-858dbf95b8-t8crp\" (UID: \"542a89ff-4ca4-45db-ac83-6d9463732d5d\") " pod="opendatahub/odh-model-controller-858dbf95b8-t8crp" May 27 14:10:43.014652 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:10:43.014608 2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 27 14:10:43.014706 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:10:43.014691 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/542a89ff-4ca4-45db-ac83-6d9463732d5d-cert podName:542a89ff-4ca4-45db-ac83-6d9463732d5d nodeName:}" failed. No retries permitted until 2026-05-27 14:10:44.014674713 +0000 UTC m=+326.367499828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/542a89ff-4ca4-45db-ac83-6d9463732d5d-cert") pod "odh-model-controller-858dbf95b8-t8crp" (UID: "542a89ff-4ca4-45db-ac83-6d9463732d5d") : secret "odh-model-controller-webhook-cert" not found May 27 14:10:43.358728 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:43.358632 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f84cc5569-224hw" event={"ID":"3343c1aa-3a4a-45ea-80b2-ec85164b503a","Type":"ContainerStarted","Data":"cc4611eab0c8c1d630749257fc1bbe2da6050d0b6178fd893ded8c591a749e84"} May 27 14:10:43.398238 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:43.398190 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6f84cc5569-224hw" podStartSLOduration=1.5805451449999999 podStartE2EDuration="5.398174044s" podCreationTimestamp="2026-05-27 14:10:38 +0000 UTC" firstStartedPulling="2026-05-27 14:10:39.282629115 +0000 UTC m=+321.635454228" lastFinishedPulling="2026-05-27 14:10:43.100258013 +0000 UTC m=+325.453083127" observedRunningTime="2026-05-27 14:10:43.397943607 +0000 UTC m=+325.750768744" watchObservedRunningTime="2026-05-27 14:10:43.398174044 +0000 UTC m=+325.750999180" May 27 14:10:44.022748 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:44.022696 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/542a89ff-4ca4-45db-ac83-6d9463732d5d-cert\") pod \"odh-model-controller-858dbf95b8-t8crp\" (UID: \"542a89ff-4ca4-45db-ac83-6d9463732d5d\") " pod="opendatahub/odh-model-controller-858dbf95b8-t8crp" May 27 14:10:44.023225 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:10:44.022845 2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 27 14:10:44.023225 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:10:44.022910 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/542a89ff-4ca4-45db-ac83-6d9463732d5d-cert podName:542a89ff-4ca4-45db-ac83-6d9463732d5d nodeName:}" failed. No retries permitted until 2026-05-27 14:10:46.022895962 +0000 UTC m=+328.375721081 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/542a89ff-4ca4-45db-ac83-6d9463732d5d-cert") pod "odh-model-controller-858dbf95b8-t8crp" (UID: "542a89ff-4ca4-45db-ac83-6d9463732d5d") : secret "odh-model-controller-webhook-cert" not found May 27 14:10:46.038008 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:46.037964 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/542a89ff-4ca4-45db-ac83-6d9463732d5d-cert\") pod \"odh-model-controller-858dbf95b8-t8crp\" (UID: \"542a89ff-4ca4-45db-ac83-6d9463732d5d\") " pod="opendatahub/odh-model-controller-858dbf95b8-t8crp" May 27 14:10:46.040451 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:46.040429 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/542a89ff-4ca4-45db-ac83-6d9463732d5d-cert\") pod \"odh-model-controller-858dbf95b8-t8crp\" (UID: \"542a89ff-4ca4-45db-ac83-6d9463732d5d\") " pod="opendatahub/odh-model-controller-858dbf95b8-t8crp" May 27 14:10:46.185686 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:46.185648 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-t8crp" May 27 14:10:46.533953 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:46.533921 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-t8crp"] May 27 14:10:46.536804 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:10:46.536766 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod542a89ff_4ca4_45db_ac83_6d9463732d5d.slice/crio-6f7b6bebb9129e3c4bd5feb501577030dfa7f45ce8f00cc47ddbc98bacdf1eaa WatchSource:0}: Error finding container 6f7b6bebb9129e3c4bd5feb501577030dfa7f45ce8f00cc47ddbc98bacdf1eaa: Status 404 returned error can't find the container with id 6f7b6bebb9129e3c4bd5feb501577030dfa7f45ce8f00cc47ddbc98bacdf1eaa May 27 14:10:47.373577 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:47.373541 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-t8crp" event={"ID":"542a89ff-4ca4-45db-ac83-6d9463732d5d","Type":"ContainerStarted","Data":"6f7b6bebb9129e3c4bd5feb501577030dfa7f45ce8f00cc47ddbc98bacdf1eaa"} May 27 14:10:47.410431 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:47.410389 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs"] May 27 14:10:47.415350 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:47.415305 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs" May 27 14:10:47.422902 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:47.422865 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs"] May 27 14:10:47.423101 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:47.423081 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cnlnn\"" May 27 14:10:47.423950 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:47.423925 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 27 14:10:47.424881 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:47.424854 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 27 14:10:47.553229 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:47.553177 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6beef91b-6af1-4409-82e4-262937496ec1-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs\" (UID: \"6beef91b-6af1-4409-82e4-262937496ec1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs" May 27 14:10:47.553436 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:47.553308 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnbxj\" (UniqueName: \"kubernetes.io/projected/6beef91b-6af1-4409-82e4-262937496ec1-kube-api-access-qnbxj\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs\" (UID: \"6beef91b-6af1-4409-82e4-262937496ec1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs" May 27 14:10:47.553436 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:47.553403 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6beef91b-6af1-4409-82e4-262937496ec1-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs\" (UID: \"6beef91b-6af1-4409-82e4-262937496ec1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs" May 27 14:10:47.654109 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:47.654020 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qnbxj\" (UniqueName: \"kubernetes.io/projected/6beef91b-6af1-4409-82e4-262937496ec1-kube-api-access-qnbxj\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs\" (UID: \"6beef91b-6af1-4409-82e4-262937496ec1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs" May 27 14:10:47.654109 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:47.654088 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6beef91b-6af1-4409-82e4-262937496ec1-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs\" (UID: \"6beef91b-6af1-4409-82e4-262937496ec1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs" May 27 14:10:47.654345 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:47.654148 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6beef91b-6af1-4409-82e4-262937496ec1-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs\" (UID: \"6beef91b-6af1-4409-82e4-262937496ec1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs" May 27 14:10:47.654494 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:47.654463 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6beef91b-6af1-4409-82e4-262937496ec1-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs\" (UID: \"6beef91b-6af1-4409-82e4-262937496ec1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs" May 27 14:10:47.654559 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:47.654519 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6beef91b-6af1-4409-82e4-262937496ec1-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs\" (UID: \"6beef91b-6af1-4409-82e4-262937496ec1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs" May 27 14:10:47.682348 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:47.682261 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnbxj\" (UniqueName: \"kubernetes.io/projected/6beef91b-6af1-4409-82e4-262937496ec1-kube-api-access-qnbxj\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs\" (UID: \"6beef91b-6af1-4409-82e4-262937496ec1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs" May 27 14:10:47.733918 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:47.733886 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs" May 27 14:10:47.936993 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:47.936913 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs"] May 27 14:10:47.939243 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:10:47.939215 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6beef91b_6af1_4409_82e4_262937496ec1.slice/crio-205a50f923990f8e3a5222cef27461b744d5d044404ef2553975a46b930c050c WatchSource:0}: Error finding container 205a50f923990f8e3a5222cef27461b744d5d044404ef2553975a46b930c050c: Status 404 returned error can't find the container with id 205a50f923990f8e3a5222cef27461b744d5d044404ef2553975a46b930c050c May 27 14:10:48.378733 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:48.378699 2576 generic.go:358] "Generic (PLEG): container finished" podID="6beef91b-6af1-4409-82e4-262937496ec1" containerID="32bbdc84d67aac315b77998541152eb8d364781769c85d72f3dbf42ae046a927" exitCode=0 May 27 14:10:48.379160 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:48.378796 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs" event={"ID":"6beef91b-6af1-4409-82e4-262937496ec1","Type":"ContainerDied","Data":"32bbdc84d67aac315b77998541152eb8d364781769c85d72f3dbf42ae046a927"} May 27 14:10:48.379160 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:48.378825 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs" event={"ID":"6beef91b-6af1-4409-82e4-262937496ec1","Type":"ContainerStarted","Data":"205a50f923990f8e3a5222cef27461b744d5d044404ef2553975a46b930c050c"} May 27 14:10:50.388624 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:50.388590 2576 generic.go:358] "Generic (PLEG): container finished" podID="6beef91b-6af1-4409-82e4-262937496ec1" containerID="9a0a9d17b4272071b4fc6c48b372a0255df7b46f2f538df6c8b0cb884e273198" exitCode=0 May 27 14:10:50.389142 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:50.388667 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs" event={"ID":"6beef91b-6af1-4409-82e4-262937496ec1","Type":"ContainerDied","Data":"9a0a9d17b4272071b4fc6c48b372a0255df7b46f2f538df6c8b0cb884e273198"} May 27 14:10:50.390702 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:50.390675 2576 generic.go:358] "Generic (PLEG): container finished" podID="542a89ff-4ca4-45db-ac83-6d9463732d5d" containerID="995009c0e61950284b7e7bdb36923b8d0854a42748fb7a112339100bcb9e706e" exitCode=1 May 27 14:10:50.390824 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:50.390713 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-t8crp" event={"ID":"542a89ff-4ca4-45db-ac83-6d9463732d5d","Type":"ContainerDied","Data":"995009c0e61950284b7e7bdb36923b8d0854a42748fb7a112339100bcb9e706e"} May 27 14:10:50.390954 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:50.390939 2576 scope.go:117] "RemoveContainer" containerID="995009c0e61950284b7e7bdb36923b8d0854a42748fb7a112339100bcb9e706e" May 27 14:10:50.627947 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:50.627911 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-lnk76"] May 27 14:10:50.631315 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:50.631292 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-lnk76" May 27 14:10:50.646922 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:50.646873 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 27 14:10:50.647188 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:50.647173 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-mbmjf\"" May 27 14:10:50.674482 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:50.674429 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-lnk76"] May 27 14:10:50.788160 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:50.788132 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b8909ba-f07b-4796-83d2-6fb24226780a-cert\") pod \"kserve-controller-manager-856948b99f-lnk76\" (UID: \"9b8909ba-f07b-4796-83d2-6fb24226780a\") " pod="opendatahub/kserve-controller-manager-856948b99f-lnk76" May 27 14:10:50.788274 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:50.788227 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trp6w\" (UniqueName: \"kubernetes.io/projected/9b8909ba-f07b-4796-83d2-6fb24226780a-kube-api-access-trp6w\") pod \"kserve-controller-manager-856948b99f-lnk76\" (UID: \"9b8909ba-f07b-4796-83d2-6fb24226780a\") " pod="opendatahub/kserve-controller-manager-856948b99f-lnk76" May 27 14:10:50.889731 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:50.889683 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b8909ba-f07b-4796-83d2-6fb24226780a-cert\") pod \"kserve-controller-manager-856948b99f-lnk76\" (UID: \"9b8909ba-f07b-4796-83d2-6fb24226780a\") " pod="opendatahub/kserve-controller-manager-856948b99f-lnk76" May 27 14:10:50.889941 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:50.889744 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-trp6w\" (UniqueName: \"kubernetes.io/projected/9b8909ba-f07b-4796-83d2-6fb24226780a-kube-api-access-trp6w\") pod \"kserve-controller-manager-856948b99f-lnk76\" (UID: \"9b8909ba-f07b-4796-83d2-6fb24226780a\") " pod="opendatahub/kserve-controller-manager-856948b99f-lnk76" May 27 14:10:50.889941 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:10:50.889848 2576 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 27 14:10:50.889941 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:10:50.889929 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b8909ba-f07b-4796-83d2-6fb24226780a-cert podName:9b8909ba-f07b-4796-83d2-6fb24226780a nodeName:}" failed. No retries permitted until 2026-05-27 14:10:51.38990726 +0000 UTC m=+333.742732389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9b8909ba-f07b-4796-83d2-6fb24226780a-cert") pod "kserve-controller-manager-856948b99f-lnk76" (UID: "9b8909ba-f07b-4796-83d2-6fb24226780a") : secret "kserve-webhook-server-cert" not found May 27 14:10:50.918807 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:50.918779 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trp6w\" (UniqueName: \"kubernetes.io/projected/9b8909ba-f07b-4796-83d2-6fb24226780a-kube-api-access-trp6w\") pod \"kserve-controller-manager-856948b99f-lnk76\" (UID: \"9b8909ba-f07b-4796-83d2-6fb24226780a\") " pod="opendatahub/kserve-controller-manager-856948b99f-lnk76" May 27 14:10:51.394880 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:51.394846 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b8909ba-f07b-4796-83d2-6fb24226780a-cert\") pod \"kserve-controller-manager-856948b99f-lnk76\" (UID: \"9b8909ba-f07b-4796-83d2-6fb24226780a\") " pod="opendatahub/kserve-controller-manager-856948b99f-lnk76" May 27 14:10:51.395344 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:10:51.394994 2576 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 27 14:10:51.395344 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:10:51.395054 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b8909ba-f07b-4796-83d2-6fb24226780a-cert podName:9b8909ba-f07b-4796-83d2-6fb24226780a nodeName:}" failed. No retries permitted until 2026-05-27 14:10:52.395036222 +0000 UTC m=+334.747861342 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9b8909ba-f07b-4796-83d2-6fb24226780a-cert") pod "kserve-controller-manager-856948b99f-lnk76" (UID: "9b8909ba-f07b-4796-83d2-6fb24226780a") : secret "kserve-webhook-server-cert" not found May 27 14:10:51.395780 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:51.395761 2576 generic.go:358] "Generic (PLEG): container finished" podID="542a89ff-4ca4-45db-ac83-6d9463732d5d" containerID="b7d780f956be624094bf90b1493d57160dfb18d9f3f50d6dd39b45d6c739f550" exitCode=1 May 27 14:10:51.395860 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:51.395840 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-t8crp" event={"ID":"542a89ff-4ca4-45db-ac83-6d9463732d5d","Type":"ContainerDied","Data":"b7d780f956be624094bf90b1493d57160dfb18d9f3f50d6dd39b45d6c739f550"} May 27 14:10:51.395903 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:51.395883 2576 scope.go:117] "RemoveContainer" containerID="995009c0e61950284b7e7bdb36923b8d0854a42748fb7a112339100bcb9e706e" May 27 14:10:51.396075 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:51.396056 2576 scope.go:117] "RemoveContainer" containerID="b7d780f956be624094bf90b1493d57160dfb18d9f3f50d6dd39b45d6c739f550" May 27 14:10:51.396274 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:10:51.396251 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-t8crp_opendatahub(542a89ff-4ca4-45db-ac83-6d9463732d5d)\"" pod="opendatahub/odh-model-controller-858dbf95b8-t8crp" podUID="542a89ff-4ca4-45db-ac83-6d9463732d5d" May 27 14:10:51.397667 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:51.397647 2576 generic.go:358] "Generic (PLEG): container finished" podID="6beef91b-6af1-4409-82e4-262937496ec1" containerID="6b1858d1fdba1710ecb13a60807f5539dd908820db49db7b152d79d2f63f5680" exitCode=0 May 27 14:10:51.397764 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:51.397699 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs" event={"ID":"6beef91b-6af1-4409-82e4-262937496ec1","Type":"ContainerDied","Data":"6b1858d1fdba1710ecb13a60807f5539dd908820db49db7b152d79d2f63f5680"} May 27 14:10:51.635384 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:51.635351 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-qwjvt"] May 27 14:10:51.639784 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:51.639764 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qwjvt" May 27 14:10:51.657228 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:51.657208 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 27 14:10:51.657489 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:51.657474 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-fct49\"" May 27 14:10:51.657930 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:51.657917 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 27 14:10:51.672636 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:51.672613 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-qwjvt"] May 27 14:10:51.797617 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:51.797583 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/6506fe31-559b-4af0-8e8d-21f954e86802-operator-config\") pod \"servicemesh-operator3-55f49c5f94-qwjvt\" (UID: \"6506fe31-559b-4af0-8e8d-21f954e86802\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-qwjvt" May 27 14:10:51.797796 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:51.797661 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsxsf\" (UniqueName: \"kubernetes.io/projected/6506fe31-559b-4af0-8e8d-21f954e86802-kube-api-access-xsxsf\") pod \"servicemesh-operator3-55f49c5f94-qwjvt\" (UID: \"6506fe31-559b-4af0-8e8d-21f954e86802\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-qwjvt" May 27 14:10:51.898352 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:51.898224 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/6506fe31-559b-4af0-8e8d-21f954e86802-operator-config\") pod \"servicemesh-operator3-55f49c5f94-qwjvt\" (UID: \"6506fe31-559b-4af0-8e8d-21f954e86802\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-qwjvt" May 27 14:10:51.898526 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:51.898359 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xsxsf\" (UniqueName: \"kubernetes.io/projected/6506fe31-559b-4af0-8e8d-21f954e86802-kube-api-access-xsxsf\") pod \"servicemesh-operator3-55f49c5f94-qwjvt\" (UID: \"6506fe31-559b-4af0-8e8d-21f954e86802\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-qwjvt" May 27 14:10:51.900753 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:51.900733 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/6506fe31-559b-4af0-8e8d-21f954e86802-operator-config\") pod \"servicemesh-operator3-55f49c5f94-qwjvt\" (UID: \"6506fe31-559b-4af0-8e8d-21f954e86802\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-qwjvt" May 27 14:10:51.909959 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:51.909932 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsxsf\" (UniqueName: \"kubernetes.io/projected/6506fe31-559b-4af0-8e8d-21f954e86802-kube-api-access-xsxsf\") pod \"servicemesh-operator3-55f49c5f94-qwjvt\" (UID: \"6506fe31-559b-4af0-8e8d-21f954e86802\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-qwjvt" May 27 14:10:51.948921 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:51.948893 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qwjvt" May 27 14:10:52.096151 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:52.096128 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-qwjvt"] May 27 14:10:52.097811 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:10:52.097779 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6506fe31_559b_4af0_8e8d_21f954e86802.slice/crio-dfb53ac8e68af33c679962d9d09729bae27a6c0bee54b1b2102534830f772e51 WatchSource:0}: Error finding container dfb53ac8e68af33c679962d9d09729bae27a6c0bee54b1b2102534830f772e51: Status 404 returned error can't find the container with id dfb53ac8e68af33c679962d9d09729bae27a6c0bee54b1b2102534830f772e51 May 27 14:10:52.401284 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:52.401252 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b8909ba-f07b-4796-83d2-6fb24226780a-cert\") pod \"kserve-controller-manager-856948b99f-lnk76\" (UID: \"9b8909ba-f07b-4796-83d2-6fb24226780a\") " pod="opendatahub/kserve-controller-manager-856948b99f-lnk76" May 27 14:10:52.401950 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:52.401924 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qwjvt" event={"ID":"6506fe31-559b-4af0-8e8d-21f954e86802","Type":"ContainerStarted","Data":"dfb53ac8e68af33c679962d9d09729bae27a6c0bee54b1b2102534830f772e51"} May 27 14:10:52.403750 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:52.403636 2576 scope.go:117] "RemoveContainer" containerID="b7d780f956be624094bf90b1493d57160dfb18d9f3f50d6dd39b45d6c739f550" May 27 14:10:52.403874 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:10:52.403854 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-t8crp_opendatahub(542a89ff-4ca4-45db-ac83-6d9463732d5d)\"" pod="opendatahub/odh-model-controller-858dbf95b8-t8crp" podUID="542a89ff-4ca4-45db-ac83-6d9463732d5d" May 27 14:10:52.403985 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:52.403969 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b8909ba-f07b-4796-83d2-6fb24226780a-cert\") pod \"kserve-controller-manager-856948b99f-lnk76\" (UID: \"9b8909ba-f07b-4796-83d2-6fb24226780a\") " pod="opendatahub/kserve-controller-manager-856948b99f-lnk76" May 27 14:10:52.441094 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:52.441057 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-lnk76" May 27 14:10:52.529698 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:52.529675 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs" May 27 14:10:52.602239 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:52.602201 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnbxj\" (UniqueName: \"kubernetes.io/projected/6beef91b-6af1-4409-82e4-262937496ec1-kube-api-access-qnbxj\") pod \"6beef91b-6af1-4409-82e4-262937496ec1\" (UID: \"6beef91b-6af1-4409-82e4-262937496ec1\") " May 27 14:10:52.602387 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:52.602256 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6beef91b-6af1-4409-82e4-262937496ec1-util\") pod \"6beef91b-6af1-4409-82e4-262937496ec1\" (UID: \"6beef91b-6af1-4409-82e4-262937496ec1\") " May 27 14:10:52.602387 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:52.602355 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6beef91b-6af1-4409-82e4-262937496ec1-bundle\") pod \"6beef91b-6af1-4409-82e4-262937496ec1\" (UID: \"6beef91b-6af1-4409-82e4-262937496ec1\") " May 27 14:10:52.603950 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:52.603909 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6beef91b-6af1-4409-82e4-262937496ec1-bundle" (OuterVolumeSpecName: "bundle") pod "6beef91b-6af1-4409-82e4-262937496ec1" (UID: "6beef91b-6af1-4409-82e4-262937496ec1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:10:52.604701 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:52.604679 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6beef91b-6af1-4409-82e4-262937496ec1-kube-api-access-qnbxj" (OuterVolumeSpecName: "kube-api-access-qnbxj") pod "6beef91b-6af1-4409-82e4-262937496ec1" (UID: "6beef91b-6af1-4409-82e4-262937496ec1"). InnerVolumeSpecName "kube-api-access-qnbxj". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:10:52.604856 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:52.604837 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-lnk76"] May 27 14:10:52.605523 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:10:52.605492 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b8909ba_f07b_4796_83d2_6fb24226780a.slice/crio-8126740b13f7690372622d1be6c601293f5c8d85f086c7698e0d72504fd6a39d WatchSource:0}: Error finding container 8126740b13f7690372622d1be6c601293f5c8d85f086c7698e0d72504fd6a39d: Status 404 returned error can't find the container with id 8126740b13f7690372622d1be6c601293f5c8d85f086c7698e0d72504fd6a39d May 27 14:10:52.608950 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:52.608931 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6beef91b-6af1-4409-82e4-262937496ec1-util" (OuterVolumeSpecName: "util") pod "6beef91b-6af1-4409-82e4-262937496ec1" (UID: "6beef91b-6af1-4409-82e4-262937496ec1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:10:52.703575 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:52.703488 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnbxj\" (UniqueName: \"kubernetes.io/projected/6beef91b-6af1-4409-82e4-262937496ec1-kube-api-access-qnbxj\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:10:52.703575 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:52.703516 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6beef91b-6af1-4409-82e4-262937496ec1-util\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:10:52.703575 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:52.703525 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6beef91b-6af1-4409-82e4-262937496ec1-bundle\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:10:53.409080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:53.409040 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs" May 27 14:10:53.409593 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:53.409039 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762arqrcs" event={"ID":"6beef91b-6af1-4409-82e4-262937496ec1","Type":"ContainerDied","Data":"205a50f923990f8e3a5222cef27461b744d5d044404ef2553975a46b930c050c"} May 27 14:10:53.409593 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:53.409162 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="205a50f923990f8e3a5222cef27461b744d5d044404ef2553975a46b930c050c" May 27 14:10:53.410412 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:53.410392 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-lnk76" event={"ID":"9b8909ba-f07b-4796-83d2-6fb24226780a","Type":"ContainerStarted","Data":"8126740b13f7690372622d1be6c601293f5c8d85f086c7698e0d72504fd6a39d"} May 27 14:10:56.186173 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:56.186049 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-t8crp" May 27 14:10:56.186668 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:56.186594 2576 scope.go:117] "RemoveContainer" containerID="b7d780f956be624094bf90b1493d57160dfb18d9f3f50d6dd39b45d6c739f550" May 27 14:10:56.186840 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:10:56.186818 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-t8crp_opendatahub(542a89ff-4ca4-45db-ac83-6d9463732d5d)\"" pod="opendatahub/odh-model-controller-858dbf95b8-t8crp" podUID="542a89ff-4ca4-45db-ac83-6d9463732d5d" May 27 14:10:56.424528 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:56.424474 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qwjvt" event={"ID":"6506fe31-559b-4af0-8e8d-21f954e86802","Type":"ContainerStarted","Data":"11061670a824a1b811b4ebcfd12f39c2bc94d3e454b29b413031a92364ed870d"} May 27 14:10:56.424707 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:56.424651 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qwjvt" May 27 14:10:56.454367 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:56.454155 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qwjvt" podStartSLOduration=1.7423704309999999 podStartE2EDuration="5.454135017s" podCreationTimestamp="2026-05-27 14:10:51 +0000 UTC" firstStartedPulling="2026-05-27 14:10:52.100208371 +0000 UTC m=+334.453033488" lastFinishedPulling="2026-05-27 14:10:55.811972961 +0000 UTC m=+338.164798074" observedRunningTime="2026-05-27 14:10:56.451406806 +0000 UTC m=+338.804231944" watchObservedRunningTime="2026-05-27 14:10:56.454135017 +0000 UTC m=+338.806960364" May 27 14:10:57.137388 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.137356 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff"] May 27 14:10:57.137649 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.137637 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6beef91b-6af1-4409-82e4-262937496ec1" containerName="pull" May 27 14:10:57.137649 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.137650 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6beef91b-6af1-4409-82e4-262937496ec1" containerName="pull" May 27 14:10:57.137778 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.137656 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6beef91b-6af1-4409-82e4-262937496ec1" containerName="extract" May 27 14:10:57.137778 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.137661 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6beef91b-6af1-4409-82e4-262937496ec1" containerName="extract" May 27 14:10:57.137778 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.137674 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6beef91b-6af1-4409-82e4-262937496ec1" containerName="util" May 27 14:10:57.137778 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.137679 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6beef91b-6af1-4409-82e4-262937496ec1" containerName="util" May 27 14:10:57.137778 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.137724 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="6beef91b-6af1-4409-82e4-262937496ec1" containerName="extract" May 27 14:10:57.139501 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.139480 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:10:57.148166 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.148146 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 27 14:10:57.148396 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.148381 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 27 14:10:57.148447 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.148428 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 27 14:10:57.148538 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.148524 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mnhpf\"" May 27 14:10:57.148828 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.148815 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 27 14:10:57.172468 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.172444 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff"] May 27 14:10:57.246819 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.246787 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/26e3710d-88c6-4a88-a226-d85392421ba8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-rcgff\" (UID: \"26e3710d-88c6-4a88-a226-d85392421ba8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:10:57.247246 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.246831 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26e3710d-88c6-4a88-a226-d85392421ba8-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-rcgff\" (UID: \"26e3710d-88c6-4a88-a226-d85392421ba8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:10:57.247246 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.246866 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/26e3710d-88c6-4a88-a226-d85392421ba8-local-certs\") pod \"istiod-openshift-gateway-798958bb55-rcgff\" (UID: \"26e3710d-88c6-4a88-a226-d85392421ba8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:10:57.247246 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.246905 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26e3710d-88c6-4a88-a226-d85392421ba8-istio-token\") pod \"istiod-openshift-gateway-798958bb55-rcgff\" (UID: \"26e3710d-88c6-4a88-a226-d85392421ba8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:10:57.247246 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.246947 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/26e3710d-88c6-4a88-a226-d85392421ba8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-rcgff\" (UID: \"26e3710d-88c6-4a88-a226-d85392421ba8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:10:57.247246 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.246980 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/26e3710d-88c6-4a88-a226-d85392421ba8-cacerts\") pod \"istiod-openshift-gateway-798958bb55-rcgff\" (UID: \"26e3710d-88c6-4a88-a226-d85392421ba8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:10:57.247246 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.247032 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6g2j\" (UniqueName: \"kubernetes.io/projected/26e3710d-88c6-4a88-a226-d85392421ba8-kube-api-access-j6g2j\") pod \"istiod-openshift-gateway-798958bb55-rcgff\" (UID: \"26e3710d-88c6-4a88-a226-d85392421ba8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:10:57.347864 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.347833 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/26e3710d-88c6-4a88-a226-d85392421ba8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-rcgff\" (UID: \"26e3710d-88c6-4a88-a226-d85392421ba8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:10:57.348035 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.347875 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26e3710d-88c6-4a88-a226-d85392421ba8-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-rcgff\" (UID: \"26e3710d-88c6-4a88-a226-d85392421ba8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:10:57.348035 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.347895 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/26e3710d-88c6-4a88-a226-d85392421ba8-local-certs\") pod \"istiod-openshift-gateway-798958bb55-rcgff\" (UID: \"26e3710d-88c6-4a88-a226-d85392421ba8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:10:57.348035 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.348009 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26e3710d-88c6-4a88-a226-d85392421ba8-istio-token\") pod \"istiod-openshift-gateway-798958bb55-rcgff\" (UID: \"26e3710d-88c6-4a88-a226-d85392421ba8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:10:57.348182 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.348043 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/26e3710d-88c6-4a88-a226-d85392421ba8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-rcgff\" (UID: \"26e3710d-88c6-4a88-a226-d85392421ba8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:10:57.348182 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.348066 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/26e3710d-88c6-4a88-a226-d85392421ba8-cacerts\") pod \"istiod-openshift-gateway-798958bb55-rcgff\" (UID: \"26e3710d-88c6-4a88-a226-d85392421ba8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:10:57.348182 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.348100 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j6g2j\" (UniqueName: \"kubernetes.io/projected/26e3710d-88c6-4a88-a226-d85392421ba8-kube-api-access-j6g2j\") pod \"istiod-openshift-gateway-798958bb55-rcgff\" (UID: \"26e3710d-88c6-4a88-a226-d85392421ba8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:10:57.348849 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.348822 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/26e3710d-88c6-4a88-a226-d85392421ba8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-rcgff\" (UID: \"26e3710d-88c6-4a88-a226-d85392421ba8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:10:57.350248 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.350223 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/26e3710d-88c6-4a88-a226-d85392421ba8-local-certs\") pod \"istiod-openshift-gateway-798958bb55-rcgff\" (UID: \"26e3710d-88c6-4a88-a226-d85392421ba8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:10:57.350384 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.350274 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/26e3710d-88c6-4a88-a226-d85392421ba8-cacerts\") pod \"istiod-openshift-gateway-798958bb55-rcgff\" (UID: \"26e3710d-88c6-4a88-a226-d85392421ba8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:10:57.350384 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.350366 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26e3710d-88c6-4a88-a226-d85392421ba8-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-rcgff\" (UID: \"26e3710d-88c6-4a88-a226-d85392421ba8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:10:57.350694 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.350677 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/26e3710d-88c6-4a88-a226-d85392421ba8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-rcgff\" (UID: \"26e3710d-88c6-4a88-a226-d85392421ba8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:10:57.361870 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.361849 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26e3710d-88c6-4a88-a226-d85392421ba8-istio-token\") pod \"istiod-openshift-gateway-798958bb55-rcgff\" (UID: \"26e3710d-88c6-4a88-a226-d85392421ba8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:10:57.362474 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.362452 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6g2j\" (UniqueName: \"kubernetes.io/projected/26e3710d-88c6-4a88-a226-d85392421ba8-kube-api-access-j6g2j\") pod \"istiod-openshift-gateway-798958bb55-rcgff\" (UID: \"26e3710d-88c6-4a88-a226-d85392421ba8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:10:57.431467 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.431290 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-lnk76" event={"ID":"9b8909ba-f07b-4796-83d2-6fb24226780a","Type":"ContainerStarted","Data":"b70bce342a80a26e15e22e1e3b381c412b28c1b04ba55f608f37bae3c373137a"} May 27 14:10:57.431467 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.431398 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-lnk76" May 27 14:10:57.448377 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.448342 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:10:57.502494 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.502378 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-lnk76" podStartSLOduration=3.378502027 podStartE2EDuration="7.50235809s" podCreationTimestamp="2026-05-27 14:10:50 +0000 UTC" firstStartedPulling="2026-05-27 14:10:52.607290675 +0000 UTC m=+334.960115789" lastFinishedPulling="2026-05-27 14:10:56.731146723 +0000 UTC m=+339.083971852" observedRunningTime="2026-05-27 14:10:57.499113018 +0000 UTC m=+339.851938155" watchObservedRunningTime="2026-05-27 14:10:57.50235809 +0000 UTC m=+339.855183226" May 27 14:10:57.627974 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:57.627946 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff"] May 27 14:10:57.629619 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:10:57.629594 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26e3710d_88c6_4a88_a226_d85392421ba8.slice/crio-cd5c073f27e64a282a5dae6ca7b2fd74d95dfe979ade9da772ef73e6f83ff694 WatchSource:0}: Error finding container cd5c073f27e64a282a5dae6ca7b2fd74d95dfe979ade9da772ef73e6f83ff694: Status 404 returned error can't find the container with id cd5c073f27e64a282a5dae6ca7b2fd74d95dfe979ade9da772ef73e6f83ff694 May 27 14:10:58.436077 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:10:58.436034 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" event={"ID":"26e3710d-88c6-4a88-a226-d85392421ba8","Type":"ContainerStarted","Data":"cd5c073f27e64a282a5dae6ca7b2fd74d95dfe979ade9da772ef73e6f83ff694"} May 27 14:11:00.713635 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:00.713595 2576 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 14:11:00.714022 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:00.713673 2576 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 14:11:01.448690 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:01.448644 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" event={"ID":"26e3710d-88c6-4a88-a226-d85392421ba8","Type":"ContainerStarted","Data":"4f901ff65d2b95c6e6057ef395a40230b50b64cb39d766c077ab4c7c2dd19387"} May 27 14:11:01.448885 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:01.448868 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:11:01.450658 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:01.450624 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" May 27 14:11:01.489741 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:01.489676 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rcgff" podStartSLOduration=1.407748344 podStartE2EDuration="4.489658999s" podCreationTimestamp="2026-05-27 14:10:57 +0000 UTC" firstStartedPulling="2026-05-27 14:10:57.631445425 +0000 UTC m=+339.984270539" lastFinishedPulling="2026-05-27 14:11:00.713356079 +0000 UTC m=+343.066181194" observedRunningTime="2026-05-27 14:11:01.487959802 +0000 UTC m=+343.840784939" watchObservedRunningTime="2026-05-27 14:11:01.489658999 +0000 UTC m=+343.842484136" May 27 14:11:06.185963 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:06.185906 2576 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-t8crp" May 27 14:11:06.186478 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:06.186467 2576 scope.go:117] "RemoveContainer" containerID="b7d780f956be624094bf90b1493d57160dfb18d9f3f50d6dd39b45d6c739f550" May 27 14:11:07.434860 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:07.434828 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qwjvt" May 27 14:11:07.471723 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:07.471686 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-t8crp" event={"ID":"542a89ff-4ca4-45db-ac83-6d9463732d5d","Type":"ContainerStarted","Data":"dbe937ee9ec78317d6a57c8bb1cfbd3446c36dcd8a41e8c1c76936dbbde6b55d"} May 27 14:11:07.471920 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:07.471901 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-t8crp" May 27 14:11:07.534276 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:07.534229 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-t8crp" podStartSLOduration=5.551204341 podStartE2EDuration="25.534214943s" podCreationTimestamp="2026-05-27 14:10:42 +0000 UTC" firstStartedPulling="2026-05-27 14:10:46.538134812 +0000 UTC m=+328.890959926" lastFinishedPulling="2026-05-27 14:11:06.521145414 +0000 UTC m=+348.873970528" observedRunningTime="2026-05-27 14:11:07.530335612 +0000 UTC m=+349.883160741" watchObservedRunningTime="2026-05-27 14:11:07.534214943 +0000 UTC m=+349.887040078" May 27 14:11:18.477305 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:18.477272 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-t8crp" May 27 14:11:28.441992 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:28.441964 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-lnk76" May 27 14:11:38.238817 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:38.238777 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wggqb"] May 27 14:11:38.257479 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:38.257451 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wggqb"] May 27 14:11:38.257638 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:38.257586 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wggqb" May 27 14:11:38.263510 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:38.263291 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 27 14:11:38.263510 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:38.263441 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-n67z4\"" May 27 14:11:38.264776 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:38.264752 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 27 14:11:38.379949 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:38.379918 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7wc9\" (UniqueName: \"kubernetes.io/projected/6d084214-92fe-4ee1-8bcb-4342d31536b7-kube-api-access-h7wc9\") pod \"kuadrant-operator-catalog-wggqb\" (UID: \"6d084214-92fe-4ee1-8bcb-4342d31536b7\") " pod="kuadrant-system/kuadrant-operator-catalog-wggqb" May 27 14:11:38.481069 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:38.481035 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h7wc9\" (UniqueName: \"kubernetes.io/projected/6d084214-92fe-4ee1-8bcb-4342d31536b7-kube-api-access-h7wc9\") pod \"kuadrant-operator-catalog-wggqb\" (UID: \"6d084214-92fe-4ee1-8bcb-4342d31536b7\") " pod="kuadrant-system/kuadrant-operator-catalog-wggqb" May 27 14:11:38.489666 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:38.489597 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7wc9\" (UniqueName: \"kubernetes.io/projected/6d084214-92fe-4ee1-8bcb-4342d31536b7-kube-api-access-h7wc9\") pod \"kuadrant-operator-catalog-wggqb\" (UID: \"6d084214-92fe-4ee1-8bcb-4342d31536b7\") " pod="kuadrant-system/kuadrant-operator-catalog-wggqb" May 27 14:11:38.570312 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:38.570282 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wggqb" May 27 14:11:38.596958 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:38.596923 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wggqb"] May 27 14:11:38.705237 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:38.705211 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wggqb"] May 27 14:11:38.707512 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:11:38.707484 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d084214_92fe_4ee1_8bcb_4342d31536b7.slice/crio-af40ff1dacd45cb7547c170ad53c9f78ded8127a5dcc3505a0a5d148572cf663 WatchSource:0}: Error finding container af40ff1dacd45cb7547c170ad53c9f78ded8127a5dcc3505a0a5d148572cf663: Status 404 returned error can't find the container with id af40ff1dacd45cb7547c170ad53c9f78ded8127a5dcc3505a0a5d148572cf663 May 27 14:11:39.579874 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:39.579836 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wggqb" event={"ID":"6d084214-92fe-4ee1-8bcb-4342d31536b7","Type":"ContainerStarted","Data":"af40ff1dacd45cb7547c170ad53c9f78ded8127a5dcc3505a0a5d148572cf663"} May 27 14:11:41.589398 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:41.589363 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wggqb" event={"ID":"6d084214-92fe-4ee1-8bcb-4342d31536b7","Type":"ContainerStarted","Data":"d105cbe6547695b40fb7624420555a6a85b8ee0f952fb7b755f4dcec9efa4982"} May 27 14:11:41.589840 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:41.589433 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-wggqb" podUID="6d084214-92fe-4ee1-8bcb-4342d31536b7" containerName="registry-server" containerID="cri-o://d105cbe6547695b40fb7624420555a6a85b8ee0f952fb7b755f4dcec9efa4982" gracePeriod=2 May 27 14:11:41.606641 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:41.606597 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wggqb" podStartSLOduration=1.488308564 podStartE2EDuration="3.606583942s" podCreationTimestamp="2026-05-27 14:11:38 +0000 UTC" firstStartedPulling="2026-05-27 14:11:38.708740374 +0000 UTC m=+381.061565489" lastFinishedPulling="2026-05-27 14:11:40.827015753 +0000 UTC m=+383.179840867" observedRunningTime="2026-05-27 14:11:41.605842374 +0000 UTC m=+383.958667511" watchObservedRunningTime="2026-05-27 14:11:41.606583942 +0000 UTC m=+383.959409076" May 27 14:11:41.838480 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:41.838457 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wggqb" May 27 14:11:41.908104 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:41.908028 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7wc9\" (UniqueName: \"kubernetes.io/projected/6d084214-92fe-4ee1-8bcb-4342d31536b7-kube-api-access-h7wc9\") pod \"6d084214-92fe-4ee1-8bcb-4342d31536b7\" (UID: \"6d084214-92fe-4ee1-8bcb-4342d31536b7\") " May 27 14:11:41.910215 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:41.910187 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d084214-92fe-4ee1-8bcb-4342d31536b7-kube-api-access-h7wc9" (OuterVolumeSpecName: "kube-api-access-h7wc9") pod "6d084214-92fe-4ee1-8bcb-4342d31536b7" (UID: "6d084214-92fe-4ee1-8bcb-4342d31536b7"). InnerVolumeSpecName "kube-api-access-h7wc9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:11:42.008967 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:42.008932 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7wc9\" (UniqueName: \"kubernetes.io/projected/6d084214-92fe-4ee1-8bcb-4342d31536b7-kube-api-access-h7wc9\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:11:42.594186 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:42.594106 2576 generic.go:358] "Generic (PLEG): container finished" podID="6d084214-92fe-4ee1-8bcb-4342d31536b7" containerID="d105cbe6547695b40fb7624420555a6a85b8ee0f952fb7b755f4dcec9efa4982" exitCode=0 May 27 14:11:42.594186 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:42.594164 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wggqb" May 27 14:11:42.594658 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:42.594197 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wggqb" event={"ID":"6d084214-92fe-4ee1-8bcb-4342d31536b7","Type":"ContainerDied","Data":"d105cbe6547695b40fb7624420555a6a85b8ee0f952fb7b755f4dcec9efa4982"} May 27 14:11:42.594658 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:42.594238 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wggqb" event={"ID":"6d084214-92fe-4ee1-8bcb-4342d31536b7","Type":"ContainerDied","Data":"af40ff1dacd45cb7547c170ad53c9f78ded8127a5dcc3505a0a5d148572cf663"} May 27 14:11:42.594658 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:42.594254 2576 scope.go:117] "RemoveContainer" containerID="d105cbe6547695b40fb7624420555a6a85b8ee0f952fb7b755f4dcec9efa4982" May 27 14:11:42.602939 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:42.602923 2576 scope.go:117] "RemoveContainer" containerID="d105cbe6547695b40fb7624420555a6a85b8ee0f952fb7b755f4dcec9efa4982" May 27 14:11:42.603191 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:11:42.603174 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d105cbe6547695b40fb7624420555a6a85b8ee0f952fb7b755f4dcec9efa4982\": container with ID starting with d105cbe6547695b40fb7624420555a6a85b8ee0f952fb7b755f4dcec9efa4982 not found: ID does not exist" containerID="d105cbe6547695b40fb7624420555a6a85b8ee0f952fb7b755f4dcec9efa4982" May 27 14:11:42.603239 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:42.603199 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d105cbe6547695b40fb7624420555a6a85b8ee0f952fb7b755f4dcec9efa4982"} err="failed to get container status \"d105cbe6547695b40fb7624420555a6a85b8ee0f952fb7b755f4dcec9efa4982\": rpc error: code = NotFound desc = could not find container \"d105cbe6547695b40fb7624420555a6a85b8ee0f952fb7b755f4dcec9efa4982\": container with ID starting with d105cbe6547695b40fb7624420555a6a85b8ee0f952fb7b755f4dcec9efa4982 not found: ID does not exist" May 27 14:11:42.612961 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:42.612935 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wggqb"] May 27 14:11:42.615019 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:42.614994 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wggqb"] May 27 14:11:44.262961 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:44.262930 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d084214-92fe-4ee1-8bcb-4342d31536b7" path="/var/lib/kubelet/pods/6d084214-92fe-4ee1-8bcb-4342d31536b7/volumes" May 27 14:11:53.626640 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:53.626597 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl"] May 27 14:11:53.627121 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:53.627048 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d084214-92fe-4ee1-8bcb-4342d31536b7" containerName="registry-server" May 27 14:11:53.627121 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:53.627066 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d084214-92fe-4ee1-8bcb-4342d31536b7" containerName="registry-server" May 27 14:11:53.627240 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:53.627155 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="6d084214-92fe-4ee1-8bcb-4342d31536b7" containerName="registry-server" May 27 14:11:53.631265 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:53.631243 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl" May 27 14:11:53.634452 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:53.634431 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 27 14:11:53.635624 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:53.635605 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-sm62j\"" May 27 14:11:53.635726 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:53.635610 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 27 14:11:53.639853 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:53.639833 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl"] May 27 14:11:53.714692 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:53.714652 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3312ad1-00cf-4bb1-b123-93482014d122-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl\" (UID: \"a3312ad1-00cf-4bb1-b123-93482014d122\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl" May 27 14:11:53.714865 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:53.714711 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3312ad1-00cf-4bb1-b123-93482014d122-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl\" (UID: \"a3312ad1-00cf-4bb1-b123-93482014d122\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl" May 27 14:11:53.714865 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:53.714787 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49pf6\" (UniqueName: \"kubernetes.io/projected/a3312ad1-00cf-4bb1-b123-93482014d122-kube-api-access-49pf6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl\" (UID: \"a3312ad1-00cf-4bb1-b123-93482014d122\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl" May 27 14:11:53.816009 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:53.815948 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3312ad1-00cf-4bb1-b123-93482014d122-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl\" (UID: \"a3312ad1-00cf-4bb1-b123-93482014d122\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl" May 27 14:11:53.816009 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:53.816015 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-49pf6\" (UniqueName: \"kubernetes.io/projected/a3312ad1-00cf-4bb1-b123-93482014d122-kube-api-access-49pf6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl\" (UID: \"a3312ad1-00cf-4bb1-b123-93482014d122\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl" May 27 14:11:53.816231 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:53.816065 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3312ad1-00cf-4bb1-b123-93482014d122-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl\" (UID: \"a3312ad1-00cf-4bb1-b123-93482014d122\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl" May 27 14:11:53.816380 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:53.816352 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3312ad1-00cf-4bb1-b123-93482014d122-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl\" (UID: \"a3312ad1-00cf-4bb1-b123-93482014d122\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl" May 27 14:11:53.816428 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:53.816404 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3312ad1-00cf-4bb1-b123-93482014d122-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl\" (UID: \"a3312ad1-00cf-4bb1-b123-93482014d122\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl" May 27 14:11:53.825825 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:53.825803 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49pf6\" (UniqueName: \"kubernetes.io/projected/a3312ad1-00cf-4bb1-b123-93482014d122-kube-api-access-49pf6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl\" (UID: \"a3312ad1-00cf-4bb1-b123-93482014d122\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl" May 27 14:11:53.942293 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:53.942197 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl" May 27 14:11:54.071531 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.071508 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl"] May 27 14:11:54.074051 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:11:54.074023 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3312ad1_00cf_4bb1_b123_93482014d122.slice/crio-63dabe824b3f82182376d56a8c7bf31590150256bb2a4befff025c08ab6a47af WatchSource:0}: Error finding container 63dabe824b3f82182376d56a8c7bf31590150256bb2a4befff025c08ab6a47af: Status 404 returned error can't find the container with id 63dabe824b3f82182376d56a8c7bf31590150256bb2a4befff025c08ab6a47af May 27 14:11:54.220666 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.220605 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2"] May 27 14:11:54.223857 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.223824 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2" May 27 14:11:54.234204 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.234174 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2"] May 27 14:11:54.320637 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.320603 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17f9309c-11b7-45f6-9d53-574e1e4ae176-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2\" (UID: \"17f9309c-11b7-45f6-9d53-574e1e4ae176\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2" May 27 14:11:54.320817 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.320664 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17f9309c-11b7-45f6-9d53-574e1e4ae176-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2\" (UID: \"17f9309c-11b7-45f6-9d53-574e1e4ae176\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2" May 27 14:11:54.320817 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.320716 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6ldh\" (UniqueName: \"kubernetes.io/projected/17f9309c-11b7-45f6-9d53-574e1e4ae176-kube-api-access-q6ldh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2\" (UID: \"17f9309c-11b7-45f6-9d53-574e1e4ae176\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2" May 27 14:11:54.421739 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.421708 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17f9309c-11b7-45f6-9d53-574e1e4ae176-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2\" (UID: \"17f9309c-11b7-45f6-9d53-574e1e4ae176\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2" May 27 14:11:54.421920 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.421768 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17f9309c-11b7-45f6-9d53-574e1e4ae176-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2\" (UID: \"17f9309c-11b7-45f6-9d53-574e1e4ae176\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2" May 27 14:11:54.421920 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.421804 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q6ldh\" (UniqueName: \"kubernetes.io/projected/17f9309c-11b7-45f6-9d53-574e1e4ae176-kube-api-access-q6ldh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2\" (UID: \"17f9309c-11b7-45f6-9d53-574e1e4ae176\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2" May 27 14:11:54.422169 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.422146 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17f9309c-11b7-45f6-9d53-574e1e4ae176-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2\" (UID: \"17f9309c-11b7-45f6-9d53-574e1e4ae176\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2" May 27 14:11:54.422233 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.422189 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17f9309c-11b7-45f6-9d53-574e1e4ae176-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2\" (UID: \"17f9309c-11b7-45f6-9d53-574e1e4ae176\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2" May 27 14:11:54.432091 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.432064 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6ldh\" (UniqueName: \"kubernetes.io/projected/17f9309c-11b7-45f6-9d53-574e1e4ae176-kube-api-access-q6ldh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2\" (UID: \"17f9309c-11b7-45f6-9d53-574e1e4ae176\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2" May 27 14:11:54.541601 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.541562 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2" May 27 14:11:54.624067 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.624039 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r"] May 27 14:11:54.628674 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.628650 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r" May 27 14:11:54.637932 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.637906 2576 generic.go:358] "Generic (PLEG): container finished" podID="a3312ad1-00cf-4bb1-b123-93482014d122" containerID="962791c4d3358d84e2fe5a49d0c5dde0b633a9b6446fcc2e4e7b78494790c947" exitCode=0 May 27 14:11:54.638038 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.637954 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl" event={"ID":"a3312ad1-00cf-4bb1-b123-93482014d122","Type":"ContainerDied","Data":"962791c4d3358d84e2fe5a49d0c5dde0b633a9b6446fcc2e4e7b78494790c947"} May 27 14:11:54.638038 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.638005 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl" event={"ID":"a3312ad1-00cf-4bb1-b123-93482014d122","Type":"ContainerStarted","Data":"63dabe824b3f82182376d56a8c7bf31590150256bb2a4befff025c08ab6a47af"} May 27 14:11:54.643683 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.643661 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r"] May 27 14:11:54.689516 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.689488 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2"] May 27 14:11:54.695387 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:11:54.695363 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f9309c_11b7_45f6_9d53_574e1e4ae176.slice/crio-c6b1555a324859d9949276099e66faa7a7054e588d731a5433a77cb8f55069fa WatchSource:0}: Error finding container c6b1555a324859d9949276099e66faa7a7054e588d731a5433a77cb8f55069fa: Status 404 returned error can't find the container with id c6b1555a324859d9949276099e66faa7a7054e588d731a5433a77cb8f55069fa May 27 14:11:54.724141 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.724106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/307bf0f4-813d-4c29-a605-328e037b87c8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r\" (UID: \"307bf0f4-813d-4c29-a605-328e037b87c8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r" May 27 14:11:54.724236 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.724183 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hdw9\" (UniqueName: \"kubernetes.io/projected/307bf0f4-813d-4c29-a605-328e037b87c8-kube-api-access-5hdw9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r\" (UID: \"307bf0f4-813d-4c29-a605-328e037b87c8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r" May 27 14:11:54.724311 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.724237 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/307bf0f4-813d-4c29-a605-328e037b87c8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r\" (UID: \"307bf0f4-813d-4c29-a605-328e037b87c8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r" May 27 14:11:54.825556 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.825482 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/307bf0f4-813d-4c29-a605-328e037b87c8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r\" (UID: \"307bf0f4-813d-4c29-a605-328e037b87c8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r" May 27 14:11:54.825556 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.825549 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/307bf0f4-813d-4c29-a605-328e037b87c8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r\" (UID: \"307bf0f4-813d-4c29-a605-328e037b87c8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r" May 27 14:11:54.825717 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.825585 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5hdw9\" (UniqueName: \"kubernetes.io/projected/307bf0f4-813d-4c29-a605-328e037b87c8-kube-api-access-5hdw9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r\" (UID: \"307bf0f4-813d-4c29-a605-328e037b87c8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r" May 27 14:11:54.825919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.825896 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/307bf0f4-813d-4c29-a605-328e037b87c8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r\" (UID: \"307bf0f4-813d-4c29-a605-328e037b87c8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r" May 27 14:11:54.825955 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.825913 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/307bf0f4-813d-4c29-a605-328e037b87c8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r\" (UID: \"307bf0f4-813d-4c29-a605-328e037b87c8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r" May 27 14:11:54.834926 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.834902 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hdw9\" (UniqueName: \"kubernetes.io/projected/307bf0f4-813d-4c29-a605-328e037b87c8-kube-api-access-5hdw9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r\" (UID: \"307bf0f4-813d-4c29-a605-328e037b87c8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r" May 27 14:11:54.940080 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:54.940041 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r" May 27 14:11:55.025534 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.025388 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c"] May 27 14:11:55.030227 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.030206 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c" May 27 14:11:55.042162 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.042134 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c"] May 27 14:11:55.093106 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.093073 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r"] May 27 14:11:55.094844 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:11:55.094803 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod307bf0f4_813d_4c29_a605_328e037b87c8.slice/crio-d20caf7c6dc5967f07d8a1b12dd4816329ec59a18f6743342f9131417cc263dd WatchSource:0}: Error finding container d20caf7c6dc5967f07d8a1b12dd4816329ec59a18f6743342f9131417cc263dd: Status 404 returned error can't find the container with id d20caf7c6dc5967f07d8a1b12dd4816329ec59a18f6743342f9131417cc263dd May 27 14:11:55.128268 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.128240 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcda6e85-11d3-4e52-a137-c381fc03cc20-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c\" (UID: \"bcda6e85-11d3-4e52-a137-c381fc03cc20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c" May 27 14:11:55.128387 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.128284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbjsl\" (UniqueName: \"kubernetes.io/projected/bcda6e85-11d3-4e52-a137-c381fc03cc20-kube-api-access-fbjsl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c\" (UID: \"bcda6e85-11d3-4e52-a137-c381fc03cc20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c" May 27 14:11:55.128387 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.128315 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcda6e85-11d3-4e52-a137-c381fc03cc20-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c\" (UID: \"bcda6e85-11d3-4e52-a137-c381fc03cc20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c" May 27 14:11:55.229574 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.229542 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcda6e85-11d3-4e52-a137-c381fc03cc20-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c\" (UID: \"bcda6e85-11d3-4e52-a137-c381fc03cc20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c" May 27 14:11:55.229723 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.229584 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fbjsl\" (UniqueName: \"kubernetes.io/projected/bcda6e85-11d3-4e52-a137-c381fc03cc20-kube-api-access-fbjsl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c\" (UID: \"bcda6e85-11d3-4e52-a137-c381fc03cc20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c" May 27 14:11:55.229723 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.229607 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcda6e85-11d3-4e52-a137-c381fc03cc20-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c\" (UID: \"bcda6e85-11d3-4e52-a137-c381fc03cc20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c" May 27 14:11:55.229901 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.229880 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcda6e85-11d3-4e52-a137-c381fc03cc20-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c\" (UID: \"bcda6e85-11d3-4e52-a137-c381fc03cc20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c" May 27 14:11:55.229950 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.229906 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcda6e85-11d3-4e52-a137-c381fc03cc20-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c\" (UID: \"bcda6e85-11d3-4e52-a137-c381fc03cc20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c" May 27 14:11:55.239000 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.238981 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbjsl\" (UniqueName: \"kubernetes.io/projected/bcda6e85-11d3-4e52-a137-c381fc03cc20-kube-api-access-fbjsl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c\" (UID: \"bcda6e85-11d3-4e52-a137-c381fc03cc20\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c" May 27 14:11:55.341742 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.341663 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c" May 27 14:11:55.478583 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.478560 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c"] May 27 14:11:55.480976 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:11:55.480956 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcda6e85_11d3_4e52_a137_c381fc03cc20.slice/crio-b09ebefd41c716cbd6f4a24bc541d858d1e6ecb598027e6683c1c5790ed35694 WatchSource:0}: Error finding container b09ebefd41c716cbd6f4a24bc541d858d1e6ecb598027e6683c1c5790ed35694: Status 404 returned error can't find the container with id b09ebefd41c716cbd6f4a24bc541d858d1e6ecb598027e6683c1c5790ed35694 May 27 14:11:55.645142 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.644189 2576 generic.go:358] "Generic (PLEG): container finished" podID="a3312ad1-00cf-4bb1-b123-93482014d122" containerID="fb8f9cafd597673505765ace7ad8a57994166f3815d9f7ef9e479ebe899715e0" exitCode=0 May 27 14:11:55.645142 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.644341 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl" event={"ID":"a3312ad1-00cf-4bb1-b123-93482014d122","Type":"ContainerDied","Data":"fb8f9cafd597673505765ace7ad8a57994166f3815d9f7ef9e479ebe899715e0"} May 27 14:11:55.647133 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.647108 2576 generic.go:358] "Generic (PLEG): container finished" podID="bcda6e85-11d3-4e52-a137-c381fc03cc20" containerID="dc55ae9bc8bbf6304a8c8261d7356741351b411715f141d4e4e2765cd3368db6" exitCode=0 May 27 14:11:55.647248 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.647135 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c" event={"ID":"bcda6e85-11d3-4e52-a137-c381fc03cc20","Type":"ContainerDied","Data":"dc55ae9bc8bbf6304a8c8261d7356741351b411715f141d4e4e2765cd3368db6"} May 27 14:11:55.647248 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.647162 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c" event={"ID":"bcda6e85-11d3-4e52-a137-c381fc03cc20","Type":"ContainerStarted","Data":"b09ebefd41c716cbd6f4a24bc541d858d1e6ecb598027e6683c1c5790ed35694"} May 27 14:11:55.648710 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.648681 2576 generic.go:358] "Generic (PLEG): container finished" podID="307bf0f4-813d-4c29-a605-328e037b87c8" containerID="47da2f23e97ebd25a45e264e944cc9438dfeaf4e3c6ed358d7efc8a4d0b7fd4e" exitCode=0 May 27 14:11:55.648804 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.648768 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r" event={"ID":"307bf0f4-813d-4c29-a605-328e037b87c8","Type":"ContainerDied","Data":"47da2f23e97ebd25a45e264e944cc9438dfeaf4e3c6ed358d7efc8a4d0b7fd4e"} May 27 14:11:55.648804 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.648796 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r" event={"ID":"307bf0f4-813d-4c29-a605-328e037b87c8","Type":"ContainerStarted","Data":"d20caf7c6dc5967f07d8a1b12dd4816329ec59a18f6743342f9131417cc263dd"} May 27 14:11:55.650310 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.650208 2576 generic.go:358] "Generic (PLEG): container finished" podID="17f9309c-11b7-45f6-9d53-574e1e4ae176" containerID="dd23a8a5e8add69d6f457b609dd2cb6b3e3d489efef4a799d873fd509f6d921b" exitCode=0 May 27 14:11:55.650310 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.650266 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2" event={"ID":"17f9309c-11b7-45f6-9d53-574e1e4ae176","Type":"ContainerDied","Data":"dd23a8a5e8add69d6f457b609dd2cb6b3e3d489efef4a799d873fd509f6d921b"} May 27 14:11:55.650310 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:55.650287 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2" event={"ID":"17f9309c-11b7-45f6-9d53-574e1e4ae176","Type":"ContainerStarted","Data":"c6b1555a324859d9949276099e66faa7a7054e588d731a5433a77cb8f55069fa"} May 27 14:11:56.655099 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:56.655069 2576 generic.go:358] "Generic (PLEG): container finished" podID="a3312ad1-00cf-4bb1-b123-93482014d122" containerID="f2f3efb8a8e3153036ebd02e8daa3f29410a414d5aeee96538cac5ae3422e72d" exitCode=0 May 27 14:11:56.655498 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:56.655142 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl" event={"ID":"a3312ad1-00cf-4bb1-b123-93482014d122","Type":"ContainerDied","Data":"f2f3efb8a8e3153036ebd02e8daa3f29410a414d5aeee96538cac5ae3422e72d"} May 27 14:11:57.659871 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:57.659835 2576 generic.go:358] "Generic (PLEG): container finished" podID="bcda6e85-11d3-4e52-a137-c381fc03cc20" containerID="caf4f106fe5d467da8a62145840989e9b7617c001fce8cd1e4321a848ae43a33" exitCode=0 May 27 14:11:57.660252 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:57.659901 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c" event={"ID":"bcda6e85-11d3-4e52-a137-c381fc03cc20","Type":"ContainerDied","Data":"caf4f106fe5d467da8a62145840989e9b7617c001fce8cd1e4321a848ae43a33"} May 27 14:11:57.661618 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:57.661585 2576 generic.go:358] "Generic (PLEG): container finished" podID="307bf0f4-813d-4c29-a605-328e037b87c8" containerID="f69aea42aea849111b20037fea7080a5006d7678365f7634038e4fe5028d4a6f" exitCode=0 May 27 14:11:57.661685 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:57.661658 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r" event={"ID":"307bf0f4-813d-4c29-a605-328e037b87c8","Type":"ContainerDied","Data":"f69aea42aea849111b20037fea7080a5006d7678365f7634038e4fe5028d4a6f"} May 27 14:11:57.663402 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:57.663204 2576 generic.go:358] "Generic (PLEG): container finished" podID="17f9309c-11b7-45f6-9d53-574e1e4ae176" containerID="753a890bb4f5ced66dbfc24bcf9578b214d37f16eac52093b8b47810c54df33e" exitCode=0 May 27 14:11:57.663402 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:57.663280 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2" event={"ID":"17f9309c-11b7-45f6-9d53-574e1e4ae176","Type":"ContainerDied","Data":"753a890bb4f5ced66dbfc24bcf9578b214d37f16eac52093b8b47810c54df33e"} May 27 14:11:57.833124 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:57.833096 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl" May 27 14:11:57.961851 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:57.961826 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3312ad1-00cf-4bb1-b123-93482014d122-util\") pod \"a3312ad1-00cf-4bb1-b123-93482014d122\" (UID: \"a3312ad1-00cf-4bb1-b123-93482014d122\") " May 27 14:11:57.961958 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:57.961863 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49pf6\" (UniqueName: \"kubernetes.io/projected/a3312ad1-00cf-4bb1-b123-93482014d122-kube-api-access-49pf6\") pod \"a3312ad1-00cf-4bb1-b123-93482014d122\" (UID: \"a3312ad1-00cf-4bb1-b123-93482014d122\") " May 27 14:11:57.961958 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:57.961893 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3312ad1-00cf-4bb1-b123-93482014d122-bundle\") pod \"a3312ad1-00cf-4bb1-b123-93482014d122\" (UID: \"a3312ad1-00cf-4bb1-b123-93482014d122\") " May 27 14:11:57.962404 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:57.962377 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3312ad1-00cf-4bb1-b123-93482014d122-bundle" (OuterVolumeSpecName: "bundle") pod "a3312ad1-00cf-4bb1-b123-93482014d122" (UID: "a3312ad1-00cf-4bb1-b123-93482014d122"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:11:57.963769 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:57.963746 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3312ad1-00cf-4bb1-b123-93482014d122-kube-api-access-49pf6" (OuterVolumeSpecName: "kube-api-access-49pf6") pod "a3312ad1-00cf-4bb1-b123-93482014d122" (UID: "a3312ad1-00cf-4bb1-b123-93482014d122"). InnerVolumeSpecName "kube-api-access-49pf6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:11:57.967686 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:57.967652 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3312ad1-00cf-4bb1-b123-93482014d122-util" (OuterVolumeSpecName: "util") pod "a3312ad1-00cf-4bb1-b123-93482014d122" (UID: "a3312ad1-00cf-4bb1-b123-93482014d122"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:11:58.063522 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:58.063489 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3312ad1-00cf-4bb1-b123-93482014d122-bundle\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:11:58.063522 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:58.063519 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3312ad1-00cf-4bb1-b123-93482014d122-util\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:11:58.063522 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:58.063529 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49pf6\" (UniqueName: \"kubernetes.io/projected/a3312ad1-00cf-4bb1-b123-93482014d122-kube-api-access-49pf6\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:11:58.669053 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:58.668969 2576 generic.go:358] "Generic (PLEG): container finished" podID="17f9309c-11b7-45f6-9d53-574e1e4ae176" containerID="018bfdf01707ebcf9c4f211c541cc9697929614496f5d9ecc8196ecfdbe96327" exitCode=0 May 27 14:11:58.669053 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:58.669005 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2" event={"ID":"17f9309c-11b7-45f6-9d53-574e1e4ae176","Type":"ContainerDied","Data":"018bfdf01707ebcf9c4f211c541cc9697929614496f5d9ecc8196ecfdbe96327"} May 27 14:11:58.670677 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:58.670658 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl" May 27 14:11:58.670781 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:58.670646 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl" event={"ID":"a3312ad1-00cf-4bb1-b123-93482014d122","Type":"ContainerDied","Data":"63dabe824b3f82182376d56a8c7bf31590150256bb2a4befff025c08ab6a47af"} May 27 14:11:58.670781 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:58.670771 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63dabe824b3f82182376d56a8c7bf31590150256bb2a4befff025c08ab6a47af" May 27 14:11:58.672637 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:58.672611 2576 generic.go:358] "Generic (PLEG): container finished" podID="bcda6e85-11d3-4e52-a137-c381fc03cc20" containerID="7292034842a7027463de049f33ea9bd5c0d5efe1face21ee29eca07202f7f376" exitCode=0 May 27 14:11:58.672749 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:58.672689 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c" event={"ID":"bcda6e85-11d3-4e52-a137-c381fc03cc20","Type":"ContainerDied","Data":"7292034842a7027463de049f33ea9bd5c0d5efe1face21ee29eca07202f7f376"} May 27 14:11:58.674594 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:58.674573 2576 generic.go:358] "Generic (PLEG): container finished" podID="307bf0f4-813d-4c29-a605-328e037b87c8" containerID="31475a184007976ca2a39d538f6f9e7b263b8d25406691a24417a02403734ce6" exitCode=0 May 27 14:11:58.674594 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:58.674599 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r" event={"ID":"307bf0f4-813d-4c29-a605-328e037b87c8","Type":"ContainerDied","Data":"31475a184007976ca2a39d538f6f9e7b263b8d25406691a24417a02403734ce6"} May 27 14:11:59.823061 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:59.823038 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r" May 27 14:11:59.863202 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:59.863179 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2" May 27 14:11:59.866311 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:59.866293 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c" May 27 14:11:59.979610 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:59.979541 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/307bf0f4-813d-4c29-a605-328e037b87c8-util\") pod \"307bf0f4-813d-4c29-a605-328e037b87c8\" (UID: \"307bf0f4-813d-4c29-a605-328e037b87c8\") " May 27 14:11:59.979610 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:59.979578 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbjsl\" (UniqueName: \"kubernetes.io/projected/bcda6e85-11d3-4e52-a137-c381fc03cc20-kube-api-access-fbjsl\") pod \"bcda6e85-11d3-4e52-a137-c381fc03cc20\" (UID: \"bcda6e85-11d3-4e52-a137-c381fc03cc20\") " May 27 14:11:59.979825 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:59.979644 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/307bf0f4-813d-4c29-a605-328e037b87c8-bundle\") pod \"307bf0f4-813d-4c29-a605-328e037b87c8\" (UID: \"307bf0f4-813d-4c29-a605-328e037b87c8\") " May 27 14:11:59.979825 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:59.979679 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcda6e85-11d3-4e52-a137-c381fc03cc20-util\") pod \"bcda6e85-11d3-4e52-a137-c381fc03cc20\" (UID: \"bcda6e85-11d3-4e52-a137-c381fc03cc20\") " May 27 14:11:59.979825 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:59.979710 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hdw9\" (UniqueName: \"kubernetes.io/projected/307bf0f4-813d-4c29-a605-328e037b87c8-kube-api-access-5hdw9\") pod \"307bf0f4-813d-4c29-a605-328e037b87c8\" (UID: \"307bf0f4-813d-4c29-a605-328e037b87c8\") " May 27 14:11:59.979825 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:59.979743 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcda6e85-11d3-4e52-a137-c381fc03cc20-bundle\") pod \"bcda6e85-11d3-4e52-a137-c381fc03cc20\" (UID: \"bcda6e85-11d3-4e52-a137-c381fc03cc20\") " May 27 14:11:59.979825 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:59.979773 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17f9309c-11b7-45f6-9d53-574e1e4ae176-util\") pod \"17f9309c-11b7-45f6-9d53-574e1e4ae176\" (UID: \"17f9309c-11b7-45f6-9d53-574e1e4ae176\") " May 27 14:11:59.979825 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:59.979807 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17f9309c-11b7-45f6-9d53-574e1e4ae176-bundle\") pod \"17f9309c-11b7-45f6-9d53-574e1e4ae176\" (UID: \"17f9309c-11b7-45f6-9d53-574e1e4ae176\") " May 27 14:11:59.980125 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:59.979835 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6ldh\" (UniqueName: \"kubernetes.io/projected/17f9309c-11b7-45f6-9d53-574e1e4ae176-kube-api-access-q6ldh\") pod \"17f9309c-11b7-45f6-9d53-574e1e4ae176\" (UID: \"17f9309c-11b7-45f6-9d53-574e1e4ae176\") " May 27 14:11:59.980472 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:59.980379 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/307bf0f4-813d-4c29-a605-328e037b87c8-bundle" (OuterVolumeSpecName: "bundle") pod "307bf0f4-813d-4c29-a605-328e037b87c8" (UID: "307bf0f4-813d-4c29-a605-328e037b87c8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:11:59.980472 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:59.980380 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcda6e85-11d3-4e52-a137-c381fc03cc20-bundle" (OuterVolumeSpecName: "bundle") pod "bcda6e85-11d3-4e52-a137-c381fc03cc20" (UID: "bcda6e85-11d3-4e52-a137-c381fc03cc20"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:11:59.980954 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:59.980898 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17f9309c-11b7-45f6-9d53-574e1e4ae176-bundle" (OuterVolumeSpecName: "bundle") pod "17f9309c-11b7-45f6-9d53-574e1e4ae176" (UID: "17f9309c-11b7-45f6-9d53-574e1e4ae176"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:11:59.982244 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:59.982218 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcda6e85-11d3-4e52-a137-c381fc03cc20-kube-api-access-fbjsl" (OuterVolumeSpecName: "kube-api-access-fbjsl") pod "bcda6e85-11d3-4e52-a137-c381fc03cc20" (UID: "bcda6e85-11d3-4e52-a137-c381fc03cc20"). InnerVolumeSpecName "kube-api-access-fbjsl". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:11:59.982505 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:59.982485 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17f9309c-11b7-45f6-9d53-574e1e4ae176-kube-api-access-q6ldh" (OuterVolumeSpecName: "kube-api-access-q6ldh") pod "17f9309c-11b7-45f6-9d53-574e1e4ae176" (UID: "17f9309c-11b7-45f6-9d53-574e1e4ae176"). InnerVolumeSpecName "kube-api-access-q6ldh". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:11:59.982576 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:59.982559 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/307bf0f4-813d-4c29-a605-328e037b87c8-kube-api-access-5hdw9" (OuterVolumeSpecName: "kube-api-access-5hdw9") pod "307bf0f4-813d-4c29-a605-328e037b87c8" (UID: "307bf0f4-813d-4c29-a605-328e037b87c8"). InnerVolumeSpecName "kube-api-access-5hdw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:11:59.985771 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:59.985736 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcda6e85-11d3-4e52-a137-c381fc03cc20-util" (OuterVolumeSpecName: "util") pod "bcda6e85-11d3-4e52-a137-c381fc03cc20" (UID: "bcda6e85-11d3-4e52-a137-c381fc03cc20"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:11:59.986332 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:59.986299 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/307bf0f4-813d-4c29-a605-328e037b87c8-util" (OuterVolumeSpecName: "util") pod "307bf0f4-813d-4c29-a605-328e037b87c8" (UID: "307bf0f4-813d-4c29-a605-328e037b87c8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:11:59.987635 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:11:59.987605 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17f9309c-11b7-45f6-9d53-574e1e4ae176-util" (OuterVolumeSpecName: "util") pod "17f9309c-11b7-45f6-9d53-574e1e4ae176" (UID: "17f9309c-11b7-45f6-9d53-574e1e4ae176"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 14:12:00.080940 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:00.080906 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/307bf0f4-813d-4c29-a605-328e037b87c8-bundle\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:12:00.080940 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:00.080933 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcda6e85-11d3-4e52-a137-c381fc03cc20-util\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:12:00.080940 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:00.080944 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hdw9\" (UniqueName: \"kubernetes.io/projected/307bf0f4-813d-4c29-a605-328e037b87c8-kube-api-access-5hdw9\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:12:00.081174 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:00.080954 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcda6e85-11d3-4e52-a137-c381fc03cc20-bundle\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:12:00.081174 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:00.080964 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17f9309c-11b7-45f6-9d53-574e1e4ae176-util\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:12:00.081174 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:00.080972 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17f9309c-11b7-45f6-9d53-574e1e4ae176-bundle\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:12:00.081174 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:00.080979 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6ldh\" (UniqueName: \"kubernetes.io/projected/17f9309c-11b7-45f6-9d53-574e1e4ae176-kube-api-access-q6ldh\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:12:00.081174 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:00.080987 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/307bf0f4-813d-4c29-a605-328e037b87c8-util\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:12:00.081174 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:00.080996 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbjsl\" (UniqueName: \"kubernetes.io/projected/bcda6e85-11d3-4e52-a137-c381fc03cc20-kube-api-access-fbjsl\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:12:00.683195 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:00.683104 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c" event={"ID":"bcda6e85-11d3-4e52-a137-c381fc03cc20","Type":"ContainerDied","Data":"b09ebefd41c716cbd6f4a24bc541d858d1e6ecb598027e6683c1c5790ed35694"} May 27 14:12:00.683195 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:00.683139 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b09ebefd41c716cbd6f4a24bc541d858d1e6ecb598027e6683c1c5790ed35694" May 27 14:12:00.683195 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:00.683168 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c" May 27 14:12:00.684923 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:00.684901 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r" event={"ID":"307bf0f4-813d-4c29-a605-328e037b87c8","Type":"ContainerDied","Data":"d20caf7c6dc5967f07d8a1b12dd4816329ec59a18f6743342f9131417cc263dd"} May 27 14:12:00.685061 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:00.684927 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d20caf7c6dc5967f07d8a1b12dd4816329ec59a18f6743342f9131417cc263dd" May 27 14:12:00.685061 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:00.684941 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r" May 27 14:12:00.686888 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:00.686847 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2" event={"ID":"17f9309c-11b7-45f6-9d53-574e1e4ae176","Type":"ContainerDied","Data":"c6b1555a324859d9949276099e66faa7a7054e588d731a5433a77cb8f55069fa"} May 27 14:12:00.686888 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:00.686863 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2" May 27 14:12:00.686888 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:00.686873 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6b1555a324859d9949276099e66faa7a7054e588d731a5433a77cb8f55069fa" May 27 14:12:13.458002 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.457959 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-glfs2"] May 27 14:12:13.458427 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458372 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3312ad1-00cf-4bb1-b123-93482014d122" containerName="pull" May 27 14:12:13.458427 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458387 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3312ad1-00cf-4bb1-b123-93482014d122" containerName="pull" May 27 14:12:13.458427 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458396 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcda6e85-11d3-4e52-a137-c381fc03cc20" containerName="util" May 27 14:12:13.458427 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458401 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcda6e85-11d3-4e52-a137-c381fc03cc20" containerName="util" May 27 14:12:13.458427 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458407 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3312ad1-00cf-4bb1-b123-93482014d122" containerName="extract" May 27 14:12:13.458427 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458412 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3312ad1-00cf-4bb1-b123-93482014d122" containerName="extract" May 27 14:12:13.458427 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458418 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f9309c-11b7-45f6-9d53-574e1e4ae176" containerName="extract" May 27 14:12:13.458427 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458429 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f9309c-11b7-45f6-9d53-574e1e4ae176" containerName="extract" May 27 14:12:13.458687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458441 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcda6e85-11d3-4e52-a137-c381fc03cc20" containerName="pull" May 27 14:12:13.458687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458452 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcda6e85-11d3-4e52-a137-c381fc03cc20" containerName="pull" May 27 14:12:13.458687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458465 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3312ad1-00cf-4bb1-b123-93482014d122" containerName="util" May 27 14:12:13.458687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458469 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3312ad1-00cf-4bb1-b123-93482014d122" containerName="util" May 27 14:12:13.458687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458475 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f9309c-11b7-45f6-9d53-574e1e4ae176" containerName="util" May 27 14:12:13.458687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458479 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f9309c-11b7-45f6-9d53-574e1e4ae176" containerName="util" May 27 14:12:13.458687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458489 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="307bf0f4-813d-4c29-a605-328e037b87c8" containerName="util" May 27 14:12:13.458687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458494 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="307bf0f4-813d-4c29-a605-328e037b87c8" containerName="util" May 27 14:12:13.458687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458500 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="307bf0f4-813d-4c29-a605-328e037b87c8" containerName="extract" May 27 14:12:13.458687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458504 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="307bf0f4-813d-4c29-a605-328e037b87c8" containerName="extract" May 27 14:12:13.458687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458509 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="307bf0f4-813d-4c29-a605-328e037b87c8" containerName="pull" May 27 14:12:13.458687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458514 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="307bf0f4-813d-4c29-a605-328e037b87c8" containerName="pull" May 27 14:12:13.458687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458518 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f9309c-11b7-45f6-9d53-574e1e4ae176" containerName="pull" May 27 14:12:13.458687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458523 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f9309c-11b7-45f6-9d53-574e1e4ae176" containerName="pull" May 27 14:12:13.458687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458527 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcda6e85-11d3-4e52-a137-c381fc03cc20" containerName="extract" May 27 14:12:13.458687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458532 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcda6e85-11d3-4e52-a137-c381fc03cc20" containerName="extract" May 27 14:12:13.458687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458580 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="a3312ad1-00cf-4bb1-b123-93482014d122" containerName="extract" May 27 14:12:13.458687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458586 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="307bf0f4-813d-4c29-a605-328e037b87c8" containerName="extract" May 27 14:12:13.458687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458593 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="bcda6e85-11d3-4e52-a137-c381fc03cc20" containerName="extract" May 27 14:12:13.458687 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.458600 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="17f9309c-11b7-45f6-9d53-574e1e4ae176" containerName="extract" May 27 14:12:13.464795 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.464775 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-glfs2" May 27 14:12:13.468343 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.468298 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 27 14:12:13.468482 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.468461 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 27 14:12:13.469598 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.469577 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-lg5lg\"" May 27 14:12:13.469709 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.469621 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 27 14:12:13.473364 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.473345 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-glfs2"] May 27 14:12:13.493429 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.493401 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk86l\" (UniqueName: \"kubernetes.io/projected/6dcff93b-bb18-4f61-bd9e-b9facc0abba8-kube-api-access-rk86l\") pod \"dns-operator-controller-manager-648d5c98bc-glfs2\" (UID: \"6dcff93b-bb18-4f61-bd9e-b9facc0abba8\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-glfs2" May 27 14:12:13.594630 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.594594 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rk86l\" (UniqueName: \"kubernetes.io/projected/6dcff93b-bb18-4f61-bd9e-b9facc0abba8-kube-api-access-rk86l\") pod \"dns-operator-controller-manager-648d5c98bc-glfs2\" (UID: \"6dcff93b-bb18-4f61-bd9e-b9facc0abba8\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-glfs2" May 27 14:12:13.604883 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.604855 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk86l\" (UniqueName: \"kubernetes.io/projected/6dcff93b-bb18-4f61-bd9e-b9facc0abba8-kube-api-access-rk86l\") pod \"dns-operator-controller-manager-648d5c98bc-glfs2\" (UID: \"6dcff93b-bb18-4f61-bd9e-b9facc0abba8\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-glfs2" May 27 14:12:13.775449 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.775401 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-glfs2" May 27 14:12:13.917183 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:13.917116 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-glfs2"] May 27 14:12:13.920046 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:12:13.920016 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dcff93b_bb18_4f61_bd9e_b9facc0abba8.slice/crio-1d7631b3caa03e8afa46cabede33e10389310fd275c1a0752e665d618cc1d74a WatchSource:0}: Error finding container 1d7631b3caa03e8afa46cabede33e10389310fd275c1a0752e665d618cc1d74a: Status 404 returned error can't find the container with id 1d7631b3caa03e8afa46cabede33e10389310fd275c1a0752e665d618cc1d74a May 27 14:12:14.736995 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:14.736961 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-glfs2" event={"ID":"6dcff93b-bb18-4f61-bd9e-b9facc0abba8","Type":"ContainerStarted","Data":"1d7631b3caa03e8afa46cabede33e10389310fd275c1a0752e665d618cc1d74a"} May 27 14:12:16.746230 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:16.746201 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-glfs2" event={"ID":"6dcff93b-bb18-4f61-bd9e-b9facc0abba8","Type":"ContainerStarted","Data":"9b8db4613e99ae983fbc16d254a26bdf8ecad4f1d5b893e715cb553677582d7c"} May 27 14:12:16.746621 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:16.746312 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-glfs2" May 27 14:12:16.781119 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:16.781067 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-glfs2" podStartSLOduration=1.359089849 podStartE2EDuration="3.78105332s" podCreationTimestamp="2026-05-27 14:12:13 +0000 UTC" firstStartedPulling="2026-05-27 14:12:13.922354227 +0000 UTC m=+416.275179341" lastFinishedPulling="2026-05-27 14:12:16.344317684 +0000 UTC m=+418.697142812" observedRunningTime="2026-05-27 14:12:16.779189476 +0000 UTC m=+419.132014626" watchObservedRunningTime="2026-05-27 14:12:16.78105332 +0000 UTC m=+419.133878456" May 27 14:12:16.868772 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:16.868739 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-vkh86"] May 27 14:12:16.872102 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:16.872086 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-vkh86" May 27 14:12:16.875170 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:16.875149 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-m2zqp\"" May 27 14:12:16.886720 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:16.886696 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-vkh86"] May 27 14:12:16.924366 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:16.924311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6zl4\" (UniqueName: \"kubernetes.io/projected/2add920e-a5a9-4344-897c-6a42be597714-kube-api-access-h6zl4\") pod \"authorino-operator-657f44b778-vkh86\" (UID: \"2add920e-a5a9-4344-897c-6a42be597714\") " pod="kuadrant-system/authorino-operator-657f44b778-vkh86" May 27 14:12:17.025263 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:17.025179 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h6zl4\" (UniqueName: \"kubernetes.io/projected/2add920e-a5a9-4344-897c-6a42be597714-kube-api-access-h6zl4\") pod \"authorino-operator-657f44b778-vkh86\" (UID: \"2add920e-a5a9-4344-897c-6a42be597714\") " pod="kuadrant-system/authorino-operator-657f44b778-vkh86" May 27 14:12:17.036282 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:17.036254 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6zl4\" (UniqueName: \"kubernetes.io/projected/2add920e-a5a9-4344-897c-6a42be597714-kube-api-access-h6zl4\") pod \"authorino-operator-657f44b778-vkh86\" (UID: \"2add920e-a5a9-4344-897c-6a42be597714\") " pod="kuadrant-system/authorino-operator-657f44b778-vkh86" May 27 14:12:17.182360 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:17.182300 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-vkh86" May 27 14:12:17.335057 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:17.335026 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-vkh86"] May 27 14:12:17.336567 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:12:17.336540 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2add920e_a5a9_4344_897c_6a42be597714.slice/crio-045c696ebc4691ae807ec65f2cc72e3a0c5ef01caf9d579114d9de3960e6e410 WatchSource:0}: Error finding container 045c696ebc4691ae807ec65f2cc72e3a0c5ef01caf9d579114d9de3960e6e410: Status 404 returned error can't find the container with id 045c696ebc4691ae807ec65f2cc72e3a0c5ef01caf9d579114d9de3960e6e410 May 27 14:12:17.751157 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:17.751121 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-vkh86" event={"ID":"2add920e-a5a9-4344-897c-6a42be597714","Type":"ContainerStarted","Data":"045c696ebc4691ae807ec65f2cc72e3a0c5ef01caf9d579114d9de3960e6e410"} May 27 14:12:20.763625 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:20.763594 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-vkh86" event={"ID":"2add920e-a5a9-4344-897c-6a42be597714","Type":"ContainerStarted","Data":"de2c3b102cd20684a9e07189b90eb41595aef5b8596198eec8cffc6243ecea21"} May 27 14:12:20.764006 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:20.763650 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-vkh86" May 27 14:12:27.753495 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:27.753465 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-glfs2" May 27 14:12:27.778501 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:27.778444 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-vkh86" podStartSLOduration=9.292710315 podStartE2EDuration="11.778430574s" podCreationTimestamp="2026-05-27 14:12:16 +0000 UTC" firstStartedPulling="2026-05-27 14:12:17.339038637 +0000 UTC m=+419.691863754" lastFinishedPulling="2026-05-27 14:12:19.824758883 +0000 UTC m=+422.177584013" observedRunningTime="2026-05-27 14:12:20.794580866 +0000 UTC m=+423.147406002" watchObservedRunningTime="2026-05-27 14:12:27.778430574 +0000 UTC m=+430.131255717" May 27 14:12:31.769375 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:31.769318 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-vkh86" May 27 14:12:31.933001 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:31.932970 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n67h8"] May 27 14:12:31.937217 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:31.937198 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n67h8" May 27 14:12:31.940873 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:31.940853 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-zm96j\"" May 27 14:12:31.956582 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:31.956561 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n67h8"] May 27 14:12:32.050311 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:32.050221 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpdnb\" (UniqueName: \"kubernetes.io/projected/0a814e11-ef1b-4a6e-918a-fea820172838-kube-api-access-vpdnb\") pod \"limitador-operator-controller-manager-85c4996f8c-n67h8\" (UID: \"0a814e11-ef1b-4a6e-918a-fea820172838\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n67h8" May 27 14:12:32.151142 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:32.151104 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vpdnb\" (UniqueName: \"kubernetes.io/projected/0a814e11-ef1b-4a6e-918a-fea820172838-kube-api-access-vpdnb\") pod \"limitador-operator-controller-manager-85c4996f8c-n67h8\" (UID: \"0a814e11-ef1b-4a6e-918a-fea820172838\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n67h8" May 27 14:12:32.162188 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:32.162166 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpdnb\" (UniqueName: \"kubernetes.io/projected/0a814e11-ef1b-4a6e-918a-fea820172838-kube-api-access-vpdnb\") pod \"limitador-operator-controller-manager-85c4996f8c-n67h8\" (UID: \"0a814e11-ef1b-4a6e-918a-fea820172838\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n67h8" May 27 14:12:32.247279 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:32.247237 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n67h8" May 27 14:12:32.378679 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:32.378652 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n67h8"] May 27 14:12:32.379724 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:12:32.379698 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a814e11_ef1b_4a6e_918a_fea820172838.slice/crio-6c4584b2a2e39d935b97af2ba37df1b377608440c69162481350434c75463c38 WatchSource:0}: Error finding container 6c4584b2a2e39d935b97af2ba37df1b377608440c69162481350434c75463c38: Status 404 returned error can't find the container with id 6c4584b2a2e39d935b97af2ba37df1b377608440c69162481350434c75463c38 May 27 14:12:32.810679 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:32.810643 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n67h8" event={"ID":"0a814e11-ef1b-4a6e-918a-fea820172838","Type":"ContainerStarted","Data":"6c4584b2a2e39d935b97af2ba37df1b377608440c69162481350434c75463c38"} May 27 14:12:33.818244 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:33.818200 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n67h8" event={"ID":"0a814e11-ef1b-4a6e-918a-fea820172838","Type":"ContainerStarted","Data":"5fc8feeb8d1b8c3d304a79c749d40a0f0f5602a7296334c2b4749aa29154a3b0"} May 27 14:12:33.818642 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:33.818257 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n67h8" May 27 14:12:33.841798 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:33.841703 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n67h8" podStartSLOduration=1.631660796 podStartE2EDuration="2.841687746s" podCreationTimestamp="2026-05-27 14:12:31 +0000 UTC" firstStartedPulling="2026-05-27 14:12:32.38162174 +0000 UTC m=+434.734446854" lastFinishedPulling="2026-05-27 14:12:33.591648676 +0000 UTC m=+435.944473804" observedRunningTime="2026-05-27 14:12:33.840316055 +0000 UTC m=+436.193141193" watchObservedRunningTime="2026-05-27 14:12:33.841687746 +0000 UTC m=+436.194512882" May 27 14:12:44.825146 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:12:44.825059 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-n67h8" May 27 14:13:08.389904 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:08.389868 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-lb4zg"] May 27 14:13:08.396644 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:08.396619 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-lb4zg" May 27 14:13:08.400741 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:08.400714 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ctqt8\"" May 27 14:13:08.403230 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:08.403196 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-lb4zg"] May 27 14:13:08.451973 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:08.451945 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6hzh\" (UniqueName: \"kubernetes.io/projected/48ca8d97-0c66-4c8c-bfee-262db80827a0-kube-api-access-n6hzh\") pod \"authorino-7498df8756-lb4zg\" (UID: \"48ca8d97-0c66-4c8c-bfee-262db80827a0\") " pod="kuadrant-system/authorino-7498df8756-lb4zg" May 27 14:13:08.552968 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:08.552934 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6hzh\" (UniqueName: \"kubernetes.io/projected/48ca8d97-0c66-4c8c-bfee-262db80827a0-kube-api-access-n6hzh\") pod \"authorino-7498df8756-lb4zg\" (UID: \"48ca8d97-0c66-4c8c-bfee-262db80827a0\") " pod="kuadrant-system/authorino-7498df8756-lb4zg" May 27 14:13:08.561599 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:08.561575 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6hzh\" (UniqueName: \"kubernetes.io/projected/48ca8d97-0c66-4c8c-bfee-262db80827a0-kube-api-access-n6hzh\") pod \"authorino-7498df8756-lb4zg\" (UID: \"48ca8d97-0c66-4c8c-bfee-262db80827a0\") " pod="kuadrant-system/authorino-7498df8756-lb4zg" May 27 14:13:08.707591 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:08.707507 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-lb4zg" May 27 14:13:08.872023 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:08.871999 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-lb4zg"] May 27 14:13:08.874251 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:13:08.874226 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48ca8d97_0c66_4c8c_bfee_262db80827a0.slice/crio-efe6b4943858a0f79b77c50973be8b10dbac7deb9a8e1edc6b46ab1ec420a465 WatchSource:0}: Error finding container efe6b4943858a0f79b77c50973be8b10dbac7deb9a8e1edc6b46ab1ec420a465: Status 404 returned error can't find the container with id efe6b4943858a0f79b77c50973be8b10dbac7deb9a8e1edc6b46ab1ec420a465 May 27 14:13:08.948752 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:08.948714 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-lb4zg" event={"ID":"48ca8d97-0c66-4c8c-bfee-262db80827a0","Type":"ContainerStarted","Data":"efe6b4943858a0f79b77c50973be8b10dbac7deb9a8e1edc6b46ab1ec420a465"} May 27 14:13:11.965829 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:11.965792 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-lb4zg" event={"ID":"48ca8d97-0c66-4c8c-bfee-262db80827a0","Type":"ContainerStarted","Data":"c15430b9fa11b48a8255780865bf8d27c1202a75f560a7eb569fab3febef5643"} May 27 14:13:11.986270 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:11.986207 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-lb4zg" podStartSLOduration=0.998996045 podStartE2EDuration="3.986193252s" podCreationTimestamp="2026-05-27 14:13:08 +0000 UTC" firstStartedPulling="2026-05-27 14:13:08.875885602 +0000 UTC m=+471.228710716" lastFinishedPulling="2026-05-27 14:13:11.863082804 +0000 UTC m=+474.215907923" observedRunningTime="2026-05-27 14:13:11.983120149 +0000 UTC m=+474.335945285" watchObservedRunningTime="2026-05-27 14:13:11.986193252 +0000 UTC m=+474.339018388" May 27 14:13:16.227503 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.227464 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-75dfdd649d-qz9rs"] May 27 14:13:16.230932 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.230913 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:16.242855 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.242831 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75dfdd649d-qz9rs"] May 27 14:13:16.328904 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.328867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fda943e4-3e9e-4ade-a250-d88e5e9f66a1-console-serving-cert\") pod \"console-75dfdd649d-qz9rs\" (UID: \"fda943e4-3e9e-4ade-a250-d88e5e9f66a1\") " pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:16.329076 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.328924 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fda943e4-3e9e-4ade-a250-d88e5e9f66a1-console-config\") pod \"console-75dfdd649d-qz9rs\" (UID: \"fda943e4-3e9e-4ade-a250-d88e5e9f66a1\") " pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:16.329076 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.328948 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fda943e4-3e9e-4ade-a250-d88e5e9f66a1-oauth-serving-cert\") pod \"console-75dfdd649d-qz9rs\" (UID: \"fda943e4-3e9e-4ade-a250-d88e5e9f66a1\") " pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:16.329076 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.328989 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4wpl\" (UniqueName: \"kubernetes.io/projected/fda943e4-3e9e-4ade-a250-d88e5e9f66a1-kube-api-access-h4wpl\") pod \"console-75dfdd649d-qz9rs\" (UID: \"fda943e4-3e9e-4ade-a250-d88e5e9f66a1\") " pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:16.329076 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.329052 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fda943e4-3e9e-4ade-a250-d88e5e9f66a1-service-ca\") pod \"console-75dfdd649d-qz9rs\" (UID: \"fda943e4-3e9e-4ade-a250-d88e5e9f66a1\") " pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:16.329255 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.329110 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fda943e4-3e9e-4ade-a250-d88e5e9f66a1-console-oauth-config\") pod \"console-75dfdd649d-qz9rs\" (UID: \"fda943e4-3e9e-4ade-a250-d88e5e9f66a1\") " pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:16.329255 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.329132 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fda943e4-3e9e-4ade-a250-d88e5e9f66a1-trusted-ca-bundle\") pod \"console-75dfdd649d-qz9rs\" (UID: \"fda943e4-3e9e-4ade-a250-d88e5e9f66a1\") " pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:16.429873 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.429841 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fda943e4-3e9e-4ade-a250-d88e5e9f66a1-service-ca\") pod \"console-75dfdd649d-qz9rs\" (UID: \"fda943e4-3e9e-4ade-a250-d88e5e9f66a1\") " pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:16.430009 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.429883 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fda943e4-3e9e-4ade-a250-d88e5e9f66a1-console-oauth-config\") pod \"console-75dfdd649d-qz9rs\" (UID: \"fda943e4-3e9e-4ade-a250-d88e5e9f66a1\") " pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:16.430009 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.429900 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fda943e4-3e9e-4ade-a250-d88e5e9f66a1-trusted-ca-bundle\") pod \"console-75dfdd649d-qz9rs\" (UID: \"fda943e4-3e9e-4ade-a250-d88e5e9f66a1\") " pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:16.430009 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.429933 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fda943e4-3e9e-4ade-a250-d88e5e9f66a1-console-serving-cert\") pod \"console-75dfdd649d-qz9rs\" (UID: \"fda943e4-3e9e-4ade-a250-d88e5e9f66a1\") " pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:16.430009 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.429949 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fda943e4-3e9e-4ade-a250-d88e5e9f66a1-console-config\") pod \"console-75dfdd649d-qz9rs\" (UID: \"fda943e4-3e9e-4ade-a250-d88e5e9f66a1\") " pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:16.430009 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.429966 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fda943e4-3e9e-4ade-a250-d88e5e9f66a1-oauth-serving-cert\") pod \"console-75dfdd649d-qz9rs\" (UID: \"fda943e4-3e9e-4ade-a250-d88e5e9f66a1\") " pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:16.430009 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.430008 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h4wpl\" (UniqueName: \"kubernetes.io/projected/fda943e4-3e9e-4ade-a250-d88e5e9f66a1-kube-api-access-h4wpl\") pod \"console-75dfdd649d-qz9rs\" (UID: \"fda943e4-3e9e-4ade-a250-d88e5e9f66a1\") " pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:16.430782 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.430755 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fda943e4-3e9e-4ade-a250-d88e5e9f66a1-service-ca\") pod \"console-75dfdd649d-qz9rs\" (UID: \"fda943e4-3e9e-4ade-a250-d88e5e9f66a1\") " pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:16.430903 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.430766 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fda943e4-3e9e-4ade-a250-d88e5e9f66a1-oauth-serving-cert\") pod \"console-75dfdd649d-qz9rs\" (UID: \"fda943e4-3e9e-4ade-a250-d88e5e9f66a1\") " pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:16.430903 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.430831 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fda943e4-3e9e-4ade-a250-d88e5e9f66a1-console-config\") pod \"console-75dfdd649d-qz9rs\" (UID: \"fda943e4-3e9e-4ade-a250-d88e5e9f66a1\") " pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:16.430903 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.430866 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fda943e4-3e9e-4ade-a250-d88e5e9f66a1-trusted-ca-bundle\") pod \"console-75dfdd649d-qz9rs\" (UID: \"fda943e4-3e9e-4ade-a250-d88e5e9f66a1\") " pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:16.432385 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.432357 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fda943e4-3e9e-4ade-a250-d88e5e9f66a1-console-oauth-config\") pod \"console-75dfdd649d-qz9rs\" (UID: \"fda943e4-3e9e-4ade-a250-d88e5e9f66a1\") " pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:16.432540 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.432521 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fda943e4-3e9e-4ade-a250-d88e5e9f66a1-console-serving-cert\") pod \"console-75dfdd649d-qz9rs\" (UID: \"fda943e4-3e9e-4ade-a250-d88e5e9f66a1\") " pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:16.439280 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.439260 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4wpl\" (UniqueName: \"kubernetes.io/projected/fda943e4-3e9e-4ade-a250-d88e5e9f66a1-kube-api-access-h4wpl\") pod \"console-75dfdd649d-qz9rs\" (UID: \"fda943e4-3e9e-4ade-a250-d88e5e9f66a1\") " pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:16.540279 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.540239 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:16.672355 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.672303 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75dfdd649d-qz9rs"] May 27 14:13:16.673967 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:13:16.673941 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfda943e4_3e9e_4ade_a250_d88e5e9f66a1.slice/crio-77d6e614aaac7c3f0965745cf573dbd22255e06ea41557c1c58f5bcb068b1fa4 WatchSource:0}: Error finding container 77d6e614aaac7c3f0965745cf573dbd22255e06ea41557c1c58f5bcb068b1fa4: Status 404 returned error can't find the container with id 77d6e614aaac7c3f0965745cf573dbd22255e06ea41557c1c58f5bcb068b1fa4 May 27 14:13:16.987460 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.987371 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75dfdd649d-qz9rs" event={"ID":"fda943e4-3e9e-4ade-a250-d88e5e9f66a1","Type":"ContainerStarted","Data":"71e88ac61c4f92d942f1bfe16f8cea84347b4f8323d48155268a45902dd44908"} May 27 14:13:16.987460 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:16.987405 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75dfdd649d-qz9rs" event={"ID":"fda943e4-3e9e-4ade-a250-d88e5e9f66a1","Type":"ContainerStarted","Data":"77d6e614aaac7c3f0965745cf573dbd22255e06ea41557c1c58f5bcb068b1fa4"} May 27 14:13:17.008874 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:17.008827 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-75dfdd649d-qz9rs" podStartSLOduration=1.00881258 podStartE2EDuration="1.00881258s" podCreationTimestamp="2026-05-27 14:13:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 14:13:17.006898782 +0000 UTC m=+479.359723930" watchObservedRunningTime="2026-05-27 14:13:17.00881258 +0000 UTC m=+479.361637716" May 27 14:13:26.540575 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:26.540538 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:26.540926 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:26.540593 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:26.545461 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:26.545433 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:27.028045 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:27.028010 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75dfdd649d-qz9rs" May 27 14:13:27.078679 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:27.078651 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c985fd5f9-495dg"] May 27 14:13:42.336151 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:42.336089 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-lb4zg"] May 27 14:13:42.336681 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:42.336346 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-lb4zg" podUID="48ca8d97-0c66-4c8c-bfee-262db80827a0" containerName="authorino" containerID="cri-o://c15430b9fa11b48a8255780865bf8d27c1202a75f560a7eb569fab3febef5643" gracePeriod=30 May 27 14:13:42.573628 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:42.573605 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-lb4zg" May 27 14:13:42.752244 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:42.752216 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6hzh\" (UniqueName: \"kubernetes.io/projected/48ca8d97-0c66-4c8c-bfee-262db80827a0-kube-api-access-n6hzh\") pod \"48ca8d97-0c66-4c8c-bfee-262db80827a0\" (UID: \"48ca8d97-0c66-4c8c-bfee-262db80827a0\") " May 27 14:13:42.754150 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:42.754123 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48ca8d97-0c66-4c8c-bfee-262db80827a0-kube-api-access-n6hzh" (OuterVolumeSpecName: "kube-api-access-n6hzh") pod "48ca8d97-0c66-4c8c-bfee-262db80827a0" (UID: "48ca8d97-0c66-4c8c-bfee-262db80827a0"). InnerVolumeSpecName "kube-api-access-n6hzh". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:13:42.853292 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:42.853259 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6hzh\" (UniqueName: \"kubernetes.io/projected/48ca8d97-0c66-4c8c-bfee-262db80827a0-kube-api-access-n6hzh\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:13:43.083379 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:43.083287 2576 generic.go:358] "Generic (PLEG): container finished" podID="48ca8d97-0c66-4c8c-bfee-262db80827a0" containerID="c15430b9fa11b48a8255780865bf8d27c1202a75f560a7eb569fab3febef5643" exitCode=0 May 27 14:13:43.083515 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:43.083379 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-lb4zg" May 27 14:13:43.083515 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:43.083379 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-lb4zg" event={"ID":"48ca8d97-0c66-4c8c-bfee-262db80827a0","Type":"ContainerDied","Data":"c15430b9fa11b48a8255780865bf8d27c1202a75f560a7eb569fab3febef5643"} May 27 14:13:43.083515 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:43.083420 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-lb4zg" event={"ID":"48ca8d97-0c66-4c8c-bfee-262db80827a0","Type":"ContainerDied","Data":"efe6b4943858a0f79b77c50973be8b10dbac7deb9a8e1edc6b46ab1ec420a465"} May 27 14:13:43.083515 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:43.083435 2576 scope.go:117] "RemoveContainer" containerID="c15430b9fa11b48a8255780865bf8d27c1202a75f560a7eb569fab3febef5643" May 27 14:13:43.091903 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:43.091889 2576 scope.go:117] "RemoveContainer" containerID="c15430b9fa11b48a8255780865bf8d27c1202a75f560a7eb569fab3febef5643" May 27 14:13:43.092130 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:13:43.092111 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c15430b9fa11b48a8255780865bf8d27c1202a75f560a7eb569fab3febef5643\": container with ID starting with c15430b9fa11b48a8255780865bf8d27c1202a75f560a7eb569fab3febef5643 not found: ID does not exist" containerID="c15430b9fa11b48a8255780865bf8d27c1202a75f560a7eb569fab3febef5643" May 27 14:13:43.092193 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:43.092142 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c15430b9fa11b48a8255780865bf8d27c1202a75f560a7eb569fab3febef5643"} err="failed to get container status \"c15430b9fa11b48a8255780865bf8d27c1202a75f560a7eb569fab3febef5643\": rpc error: code = NotFound desc = could not find container \"c15430b9fa11b48a8255780865bf8d27c1202a75f560a7eb569fab3febef5643\": container with ID starting with c15430b9fa11b48a8255780865bf8d27c1202a75f560a7eb569fab3febef5643 not found: ID does not exist" May 27 14:13:43.106090 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:43.106070 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-lb4zg"] May 27 14:13:43.111135 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:43.111116 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-lb4zg"] May 27 14:13:44.262705 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:44.262671 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48ca8d97-0c66-4c8c-bfee-262db80827a0" path="/var/lib/kubelet/pods/48ca8d97-0c66-4c8c-bfee-262db80827a0/volumes" May 27 14:13:45.463258 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:45.463222 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76656bbbfb-52kls"] May 27 14:13:45.463643 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:45.463591 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48ca8d97-0c66-4c8c-bfee-262db80827a0" containerName="authorino" May 27 14:13:45.463643 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:45.463602 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="48ca8d97-0c66-4c8c-bfee-262db80827a0" containerName="authorino" May 27 14:13:45.463719 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:45.463662 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="48ca8d97-0c66-4c8c-bfee-262db80827a0" containerName="authorino" May 27 14:13:45.500198 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:45.500167 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76656bbbfb-52kls"] May 27 14:13:45.500358 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:45.500283 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76656bbbfb-52kls" May 27 14:13:45.503961 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:45.503934 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 27 14:13:45.504118 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:45.504100 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vcm7m\"" May 27 14:13:45.678901 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:45.678871 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nglc5\" (UniqueName: \"kubernetes.io/projected/f490d770-d6e5-4f2f-a8c0-3be69ccfaf23-kube-api-access-nglc5\") pod \"maas-controller-76656bbbfb-52kls\" (UID: \"f490d770-d6e5-4f2f-a8c0-3be69ccfaf23\") " pod="opendatahub/maas-controller-76656bbbfb-52kls" May 27 14:13:45.780096 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:45.780064 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nglc5\" (UniqueName: \"kubernetes.io/projected/f490d770-d6e5-4f2f-a8c0-3be69ccfaf23-kube-api-access-nglc5\") pod \"maas-controller-76656bbbfb-52kls\" (UID: \"f490d770-d6e5-4f2f-a8c0-3be69ccfaf23\") " pod="opendatahub/maas-controller-76656bbbfb-52kls" May 27 14:13:45.789509 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:45.789482 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nglc5\" (UniqueName: \"kubernetes.io/projected/f490d770-d6e5-4f2f-a8c0-3be69ccfaf23-kube-api-access-nglc5\") pod \"maas-controller-76656bbbfb-52kls\" (UID: \"f490d770-d6e5-4f2f-a8c0-3be69ccfaf23\") " pod="opendatahub/maas-controller-76656bbbfb-52kls" May 27 14:13:45.810246 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:45.810222 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76656bbbfb-52kls" May 27 14:13:45.959851 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:45.959821 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76656bbbfb-52kls"] May 27 14:13:45.960818 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:13:45.960791 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf490d770_d6e5_4f2f_a8c0_3be69ccfaf23.slice/crio-ebe429cc2f2dd1ddd90301902d26872b6475892ae603e982f9cb4f5db316c388 WatchSource:0}: Error finding container ebe429cc2f2dd1ddd90301902d26872b6475892ae603e982f9cb4f5db316c388: Status 404 returned error can't find the container with id ebe429cc2f2dd1ddd90301902d26872b6475892ae603e982f9cb4f5db316c388 May 27 14:13:46.098008 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:46.097929 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76656bbbfb-52kls" event={"ID":"f490d770-d6e5-4f2f-a8c0-3be69ccfaf23","Type":"ContainerStarted","Data":"ebe429cc2f2dd1ddd90301902d26872b6475892ae603e982f9cb4f5db316c388"} May 27 14:13:49.113581 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:49.113532 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76656bbbfb-52kls" event={"ID":"f490d770-d6e5-4f2f-a8c0-3be69ccfaf23","Type":"ContainerStarted","Data":"ae84595f389d72d6cea677564300d112595fb0694cf4811349c2510cfbaf3e5f"} May 27 14:13:49.113996 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:49.113592 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76656bbbfb-52kls" May 27 14:13:49.131951 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:49.131906 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-76656bbbfb-52kls" podStartSLOduration=1.660697854 podStartE2EDuration="4.131893546s" podCreationTimestamp="2026-05-27 14:13:45 +0000 UTC" firstStartedPulling="2026-05-27 14:13:45.962167089 +0000 UTC m=+508.314992204" lastFinishedPulling="2026-05-27 14:13:48.433362783 +0000 UTC m=+510.786187896" observedRunningTime="2026-05-27 14:13:49.130510618 +0000 UTC m=+511.483335753" watchObservedRunningTime="2026-05-27 14:13:49.131893546 +0000 UTC m=+511.484718681" May 27 14:13:52.099794 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:52.099734 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7c985fd5f9-495dg" podUID="ba023335-6961-4379-a547-bb9624782a00" containerName="console" containerID="cri-o://dc67fb0654606c366483729c3a0d7b8421064027ee474515d3538532ca01c66c" gracePeriod=15 May 27 14:13:52.341165 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:52.341145 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c985fd5f9-495dg_ba023335-6961-4379-a547-bb9624782a00/console/0.log" May 27 14:13:52.341274 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:52.341206 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:13:52.438568 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:52.438476 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba023335-6961-4379-a547-bb9624782a00-console-oauth-config\") pod \"ba023335-6961-4379-a547-bb9624782a00\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " May 27 14:13:52.438568 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:52.438528 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba023335-6961-4379-a547-bb9624782a00-oauth-serving-cert\") pod \"ba023335-6961-4379-a547-bb9624782a00\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " May 27 14:13:52.438568 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:52.438547 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba023335-6961-4379-a547-bb9624782a00-trusted-ca-bundle\") pod \"ba023335-6961-4379-a547-bb9624782a00\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " May 27 14:13:52.438804 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:52.438577 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6579\" (UniqueName: \"kubernetes.io/projected/ba023335-6961-4379-a547-bb9624782a00-kube-api-access-d6579\") pod \"ba023335-6961-4379-a547-bb9624782a00\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " May 27 14:13:52.438804 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:52.438695 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba023335-6961-4379-a547-bb9624782a00-console-config\") pod \"ba023335-6961-4379-a547-bb9624782a00\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " May 27 14:13:52.438804 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:52.438732 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba023335-6961-4379-a547-bb9624782a00-console-serving-cert\") pod \"ba023335-6961-4379-a547-bb9624782a00\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " May 27 14:13:52.438960 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:52.438812 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba023335-6961-4379-a547-bb9624782a00-service-ca\") pod \"ba023335-6961-4379-a547-bb9624782a00\" (UID: \"ba023335-6961-4379-a547-bb9624782a00\") " May 27 14:13:52.438960 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:52.438935 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba023335-6961-4379-a547-bb9624782a00-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ba023335-6961-4379-a547-bb9624782a00" (UID: "ba023335-6961-4379-a547-bb9624782a00"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 14:13:52.439197 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:52.439157 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba023335-6961-4379-a547-bb9624782a00-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ba023335-6961-4379-a547-bb9624782a00" (UID: "ba023335-6961-4379-a547-bb9624782a00"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 14:13:52.439197 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:52.439174 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba023335-6961-4379-a547-bb9624782a00-console-config" (OuterVolumeSpecName: "console-config") pod "ba023335-6961-4379-a547-bb9624782a00" (UID: "ba023335-6961-4379-a547-bb9624782a00"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 14:13:52.439197 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:52.439184 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba023335-6961-4379-a547-bb9624782a00-oauth-serving-cert\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:13:52.439420 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:52.439262 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba023335-6961-4379-a547-bb9624782a00-service-ca" (OuterVolumeSpecName: "service-ca") pod "ba023335-6961-4379-a547-bb9624782a00" (UID: "ba023335-6961-4379-a547-bb9624782a00"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 14:13:52.440811 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:52.440781 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba023335-6961-4379-a547-bb9624782a00-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ba023335-6961-4379-a547-bb9624782a00" (UID: "ba023335-6961-4379-a547-bb9624782a00"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 14:13:52.440911 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:52.440842 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba023335-6961-4379-a547-bb9624782a00-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ba023335-6961-4379-a547-bb9624782a00" (UID: "ba023335-6961-4379-a547-bb9624782a00"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 14:13:52.440911 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:52.440858 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba023335-6961-4379-a547-bb9624782a00-kube-api-access-d6579" (OuterVolumeSpecName: "kube-api-access-d6579") pod "ba023335-6961-4379-a547-bb9624782a00" (UID: "ba023335-6961-4379-a547-bb9624782a00"). InnerVolumeSpecName "kube-api-access-d6579". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:13:52.540370 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:52.540341 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba023335-6961-4379-a547-bb9624782a00-trusted-ca-bundle\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:13:52.540370 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:52.540366 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6579\" (UniqueName: \"kubernetes.io/projected/ba023335-6961-4379-a547-bb9624782a00-kube-api-access-d6579\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:13:52.540562 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:52.540379 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba023335-6961-4379-a547-bb9624782a00-console-config\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:13:52.540562 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:52.540390 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba023335-6961-4379-a547-bb9624782a00-console-serving-cert\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:13:52.540562 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:52.540399 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba023335-6961-4379-a547-bb9624782a00-service-ca\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:13:52.540562 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:52.540408 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba023335-6961-4379-a547-bb9624782a00-console-oauth-config\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:13:53.130956 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:53.130929 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c985fd5f9-495dg_ba023335-6961-4379-a547-bb9624782a00/console/0.log" May 27 14:13:53.131358 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:53.130971 2576 generic.go:358] "Generic (PLEG): container finished" podID="ba023335-6961-4379-a547-bb9624782a00" containerID="dc67fb0654606c366483729c3a0d7b8421064027ee474515d3538532ca01c66c" exitCode=2 May 27 14:13:53.131358 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:53.131041 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c985fd5f9-495dg" May 27 14:13:53.131358 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:53.131039 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c985fd5f9-495dg" event={"ID":"ba023335-6961-4379-a547-bb9624782a00","Type":"ContainerDied","Data":"dc67fb0654606c366483729c3a0d7b8421064027ee474515d3538532ca01c66c"} May 27 14:13:53.131358 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:53.131149 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c985fd5f9-495dg" event={"ID":"ba023335-6961-4379-a547-bb9624782a00","Type":"ContainerDied","Data":"ef4096e77e77b8a86530c83bbddca27c0db368d6bde3c7d485e6e9ad923dd1e7"} May 27 14:13:53.131358 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:53.131167 2576 scope.go:117] "RemoveContainer" containerID="dc67fb0654606c366483729c3a0d7b8421064027ee474515d3538532ca01c66c" May 27 14:13:53.140252 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:53.140232 2576 scope.go:117] "RemoveContainer" containerID="dc67fb0654606c366483729c3a0d7b8421064027ee474515d3538532ca01c66c" May 27 14:13:53.140519 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:13:53.140503 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc67fb0654606c366483729c3a0d7b8421064027ee474515d3538532ca01c66c\": container with ID starting with dc67fb0654606c366483729c3a0d7b8421064027ee474515d3538532ca01c66c not found: ID does not exist" containerID="dc67fb0654606c366483729c3a0d7b8421064027ee474515d3538532ca01c66c" May 27 14:13:53.140579 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:53.140529 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc67fb0654606c366483729c3a0d7b8421064027ee474515d3538532ca01c66c"} err="failed to get container status \"dc67fb0654606c366483729c3a0d7b8421064027ee474515d3538532ca01c66c\": rpc error: code = NotFound desc = could not find container \"dc67fb0654606c366483729c3a0d7b8421064027ee474515d3538532ca01c66c\": container with ID starting with dc67fb0654606c366483729c3a0d7b8421064027ee474515d3538532ca01c66c not found: ID does not exist" May 27 14:13:53.155520 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:53.155494 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c985fd5f9-495dg"] May 27 14:13:53.159228 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:53.159202 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c985fd5f9-495dg"] May 27 14:13:54.262698 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:13:54.262667 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba023335-6961-4379-a547-bb9624782a00" path="/var/lib/kubelet/pods/ba023335-6961-4379-a547-bb9624782a00/volumes" May 27 14:14:00.123594 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:00.123556 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76656bbbfb-52kls" May 27 14:14:01.380919 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:01.380882 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76656bbbfb-52kls"] May 27 14:14:01.381341 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:01.381080 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-76656bbbfb-52kls" podUID="f490d770-d6e5-4f2f-a8c0-3be69ccfaf23" containerName="manager" containerID="cri-o://ae84595f389d72d6cea677564300d112595fb0694cf4811349c2510cfbaf3e5f" gracePeriod=30 May 27 14:14:01.620954 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:01.620931 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76656bbbfb-52kls" May 27 14:14:01.720744 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:01.720653 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nglc5\" (UniqueName: \"kubernetes.io/projected/f490d770-d6e5-4f2f-a8c0-3be69ccfaf23-kube-api-access-nglc5\") pod \"f490d770-d6e5-4f2f-a8c0-3be69ccfaf23\" (UID: \"f490d770-d6e5-4f2f-a8c0-3be69ccfaf23\") " May 27 14:14:01.722976 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:01.722949 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f490d770-d6e5-4f2f-a8c0-3be69ccfaf23-kube-api-access-nglc5" (OuterVolumeSpecName: "kube-api-access-nglc5") pod "f490d770-d6e5-4f2f-a8c0-3be69ccfaf23" (UID: "f490d770-d6e5-4f2f-a8c0-3be69ccfaf23"). InnerVolumeSpecName "kube-api-access-nglc5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 14:14:01.821696 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:01.821668 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nglc5\" (UniqueName: \"kubernetes.io/projected/f490d770-d6e5-4f2f-a8c0-3be69ccfaf23-kube-api-access-nglc5\") on node \"ip-10-0-141-132.ec2.internal\" DevicePath \"\"" May 27 14:14:02.167308 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:02.167271 2576 generic.go:358] "Generic (PLEG): container finished" podID="f490d770-d6e5-4f2f-a8c0-3be69ccfaf23" containerID="ae84595f389d72d6cea677564300d112595fb0694cf4811349c2510cfbaf3e5f" exitCode=0 May 27 14:14:02.167485 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:02.167362 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76656bbbfb-52kls" May 27 14:14:02.167485 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:02.167356 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76656bbbfb-52kls" event={"ID":"f490d770-d6e5-4f2f-a8c0-3be69ccfaf23","Type":"ContainerDied","Data":"ae84595f389d72d6cea677564300d112595fb0694cf4811349c2510cfbaf3e5f"} May 27 14:14:02.167485 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:02.167464 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76656bbbfb-52kls" event={"ID":"f490d770-d6e5-4f2f-a8c0-3be69ccfaf23","Type":"ContainerDied","Data":"ebe429cc2f2dd1ddd90301902d26872b6475892ae603e982f9cb4f5db316c388"} May 27 14:14:02.167485 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:02.167479 2576 scope.go:117] "RemoveContainer" containerID="ae84595f389d72d6cea677564300d112595fb0694cf4811349c2510cfbaf3e5f" May 27 14:14:02.176190 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:02.176170 2576 scope.go:117] "RemoveContainer" containerID="ae84595f389d72d6cea677564300d112595fb0694cf4811349c2510cfbaf3e5f" May 27 14:14:02.176468 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:14:02.176448 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae84595f389d72d6cea677564300d112595fb0694cf4811349c2510cfbaf3e5f\": container with ID starting with ae84595f389d72d6cea677564300d112595fb0694cf4811349c2510cfbaf3e5f not found: ID does not exist" containerID="ae84595f389d72d6cea677564300d112595fb0694cf4811349c2510cfbaf3e5f" May 27 14:14:02.176526 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:02.176476 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae84595f389d72d6cea677564300d112595fb0694cf4811349c2510cfbaf3e5f"} err="failed to get container status \"ae84595f389d72d6cea677564300d112595fb0694cf4811349c2510cfbaf3e5f\": rpc error: code = NotFound desc = could not find container \"ae84595f389d72d6cea677564300d112595fb0694cf4811349c2510cfbaf3e5f\": container with ID starting with ae84595f389d72d6cea677564300d112595fb0694cf4811349c2510cfbaf3e5f not found: ID does not exist" May 27 14:14:02.190625 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:02.190595 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76656bbbfb-52kls"] May 27 14:14:02.195383 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:02.195359 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76656bbbfb-52kls"] May 27 14:14:02.263283 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:02.263254 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f490d770-d6e5-4f2f-a8c0-3be69ccfaf23" path="/var/lib/kubelet/pods/f490d770-d6e5-4f2f-a8c0-3be69ccfaf23/volumes" May 27 14:14:21.573670 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:21.573632 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-575b79674d-m7j7q"] May 27 14:14:21.574156 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:21.573981 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f490d770-d6e5-4f2f-a8c0-3be69ccfaf23" containerName="manager" May 27 14:14:21.574156 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:21.573999 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f490d770-d6e5-4f2f-a8c0-3be69ccfaf23" containerName="manager" May 27 14:14:21.574156 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:21.574029 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba023335-6961-4379-a547-bb9624782a00" containerName="console" May 27 14:14:21.574156 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:21.574039 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba023335-6961-4379-a547-bb9624782a00" containerName="console" May 27 14:14:21.574156 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:21.574153 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="f490d770-d6e5-4f2f-a8c0-3be69ccfaf23" containerName="manager" May 27 14:14:21.574390 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:21.574169 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="ba023335-6961-4379-a547-bb9624782a00" containerName="console" May 27 14:14:21.576708 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:21.576688 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-575b79674d-m7j7q" May 27 14:14:21.581748 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:21.581718 2576 status_manager.go:895] "Failed to get status for pod" podUID="42c0b4c5-cbcd-4f5d-be56-19aaacd60a1b" pod="opendatahub/maas-api-575b79674d-m7j7q" err="pods \"maas-api-575b79674d-m7j7q\" is forbidden: User \"system:node:ip-10-0-141-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-132.ec2.internal' and this object" May 27 14:14:21.582079 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:14:21.582050 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-api-serving-cert\" is forbidden: User \"system:node:ip-10-0-141-132.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-132.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" type="*v1.Secret" May 27 14:14:21.645496 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:21.645463 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-575b79674d-m7j7q"] May 27 14:14:21.689420 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:21.689385 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42c0b4c5-cbcd-4f5d-be56-19aaacd60a1b-maas-api-tls\") pod \"maas-api-575b79674d-m7j7q\" (UID: \"42c0b4c5-cbcd-4f5d-be56-19aaacd60a1b\") " pod="opendatahub/maas-api-575b79674d-m7j7q" May 27 14:14:21.689579 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:21.689444 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckkgx\" (UniqueName: \"kubernetes.io/projected/42c0b4c5-cbcd-4f5d-be56-19aaacd60a1b-kube-api-access-ckkgx\") pod \"maas-api-575b79674d-m7j7q\" (UID: \"42c0b4c5-cbcd-4f5d-be56-19aaacd60a1b\") " pod="opendatahub/maas-api-575b79674d-m7j7q" May 27 14:14:21.790494 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:21.790459 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ckkgx\" (UniqueName: \"kubernetes.io/projected/42c0b4c5-cbcd-4f5d-be56-19aaacd60a1b-kube-api-access-ckkgx\") pod \"maas-api-575b79674d-m7j7q\" (UID: \"42c0b4c5-cbcd-4f5d-be56-19aaacd60a1b\") " pod="opendatahub/maas-api-575b79674d-m7j7q" May 27 14:14:21.790660 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:21.790537 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42c0b4c5-cbcd-4f5d-be56-19aaacd60a1b-maas-api-tls\") pod \"maas-api-575b79674d-m7j7q\" (UID: \"42c0b4c5-cbcd-4f5d-be56-19aaacd60a1b\") " pod="opendatahub/maas-api-575b79674d-m7j7q" May 27 14:14:21.800055 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:21.800028 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckkgx\" (UniqueName: \"kubernetes.io/projected/42c0b4c5-cbcd-4f5d-be56-19aaacd60a1b-kube-api-access-ckkgx\") pod \"maas-api-575b79674d-m7j7q\" (UID: \"42c0b4c5-cbcd-4f5d-be56-19aaacd60a1b\") " pod="opendatahub/maas-api-575b79674d-m7j7q" May 27 14:14:22.790985 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:14:22.790952 2576 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: failed to sync secret cache: timed out waiting for the condition May 27 14:14:22.791349 ip-10-0-141-132 kubenswrapper[2576]: E0527 14:14:22.791039 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c0b4c5-cbcd-4f5d-be56-19aaacd60a1b-maas-api-tls podName:42c0b4c5-cbcd-4f5d-be56-19aaacd60a1b nodeName:}" failed. No retries permitted until 2026-05-27 14:14:23.291018801 +0000 UTC m=+545.643843915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/42c0b4c5-cbcd-4f5d-be56-19aaacd60a1b-maas-api-tls") pod "maas-api-575b79674d-m7j7q" (UID: "42c0b4c5-cbcd-4f5d-be56-19aaacd60a1b") : failed to sync secret cache: timed out waiting for the condition May 27 14:14:22.847617 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:22.847589 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 27 14:14:23.303093 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:23.303057 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42c0b4c5-cbcd-4f5d-be56-19aaacd60a1b-maas-api-tls\") pod \"maas-api-575b79674d-m7j7q\" (UID: \"42c0b4c5-cbcd-4f5d-be56-19aaacd60a1b\") " pod="opendatahub/maas-api-575b79674d-m7j7q" May 27 14:14:23.305511 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:23.305489 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42c0b4c5-cbcd-4f5d-be56-19aaacd60a1b-maas-api-tls\") pod \"maas-api-575b79674d-m7j7q\" (UID: \"42c0b4c5-cbcd-4f5d-be56-19aaacd60a1b\") " pod="opendatahub/maas-api-575b79674d-m7j7q" May 27 14:14:23.386721 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:23.386686 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-575b79674d-m7j7q" May 27 14:14:23.521194 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:23.521166 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-575b79674d-m7j7q"] May 27 14:14:23.522628 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:14:23.522600 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42c0b4c5_cbcd_4f5d_be56_19aaacd60a1b.slice/crio-4469bded7c49795e989f23f758573945eed5452d36d80f3aa26e1c5ec482be83 WatchSource:0}: Error finding container 4469bded7c49795e989f23f758573945eed5452d36d80f3aa26e1c5ec482be83: Status 404 returned error can't find the container with id 4469bded7c49795e989f23f758573945eed5452d36d80f3aa26e1c5ec482be83 May 27 14:14:24.253995 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:24.253951 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-575b79674d-m7j7q" event={"ID":"42c0b4c5-cbcd-4f5d-be56-19aaacd60a1b","Type":"ContainerStarted","Data":"4469bded7c49795e989f23f758573945eed5452d36d80f3aa26e1c5ec482be83"} May 27 14:14:25.259005 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:25.258967 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-575b79674d-m7j7q" event={"ID":"42c0b4c5-cbcd-4f5d-be56-19aaacd60a1b","Type":"ContainerStarted","Data":"ab3ffa9efb40ae0ddc976985bc87585d45bd67217bca53bdba3b1a77bb21e14d"} May 27 14:14:25.259005 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:25.259005 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-575b79674d-m7j7q" May 27 14:14:25.279421 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:25.279372 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-575b79674d-m7j7q" podStartSLOduration=2.733645454 podStartE2EDuration="4.279357555s" podCreationTimestamp="2026-05-27 14:14:21 +0000 UTC" firstStartedPulling="2026-05-27 14:14:23.523779848 +0000 UTC m=+545.876604963" lastFinishedPulling="2026-05-27 14:14:25.069491945 +0000 UTC m=+547.422317064" observedRunningTime="2026-05-27 14:14:25.277813988 +0000 UTC m=+547.630639125" watchObservedRunningTime="2026-05-27 14:14:25.279357555 +0000 UTC m=+547.632182690" May 27 14:14:31.268005 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:31.267977 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-575b79674d-m7j7q" May 27 14:14:47.040280 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.040250 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b"] May 27 14:14:47.043712 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.043696 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" May 27 14:14:47.048185 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.048166 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 27 14:14:47.048246 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.048188 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-phs6z\"" May 27 14:14:47.048246 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.048228 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 27 14:14:47.048246 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.048239 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 27 14:14:47.056814 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.056792 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b"] May 27 14:14:47.106596 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.106562 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5944ffb4-7e27-4259-8456-7c042f004f6c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b\" (UID: \"5944ffb4-7e27-4259-8456-7c042f004f6c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" May 27 14:14:47.106596 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.106597 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5944ffb4-7e27-4259-8456-7c042f004f6c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b\" (UID: \"5944ffb4-7e27-4259-8456-7c042f004f6c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" May 27 14:14:47.106800 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.106687 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5944ffb4-7e27-4259-8456-7c042f004f6c-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b\" (UID: \"5944ffb4-7e27-4259-8456-7c042f004f6c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" May 27 14:14:47.106800 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.106724 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gt2l\" (UniqueName: \"kubernetes.io/projected/5944ffb4-7e27-4259-8456-7c042f004f6c-kube-api-access-7gt2l\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b\" (UID: \"5944ffb4-7e27-4259-8456-7c042f004f6c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" May 27 14:14:47.106800 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.106749 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5944ffb4-7e27-4259-8456-7c042f004f6c-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b\" (UID: \"5944ffb4-7e27-4259-8456-7c042f004f6c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" May 27 14:14:47.106800 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.106773 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5944ffb4-7e27-4259-8456-7c042f004f6c-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b\" (UID: \"5944ffb4-7e27-4259-8456-7c042f004f6c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" May 27 14:14:47.207524 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.207434 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5944ffb4-7e27-4259-8456-7c042f004f6c-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b\" (UID: \"5944ffb4-7e27-4259-8456-7c042f004f6c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" May 27 14:14:47.207706 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.207556 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7gt2l\" (UniqueName: \"kubernetes.io/projected/5944ffb4-7e27-4259-8456-7c042f004f6c-kube-api-access-7gt2l\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b\" (UID: \"5944ffb4-7e27-4259-8456-7c042f004f6c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" May 27 14:14:47.207706 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.207596 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5944ffb4-7e27-4259-8456-7c042f004f6c-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b\" (UID: \"5944ffb4-7e27-4259-8456-7c042f004f6c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" May 27 14:14:47.207706 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.207637 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5944ffb4-7e27-4259-8456-7c042f004f6c-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b\" (UID: \"5944ffb4-7e27-4259-8456-7c042f004f6c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" May 27 14:14:47.207706 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.207701 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5944ffb4-7e27-4259-8456-7c042f004f6c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b\" (UID: \"5944ffb4-7e27-4259-8456-7c042f004f6c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" May 27 14:14:47.207937 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.207726 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5944ffb4-7e27-4259-8456-7c042f004f6c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b\" (UID: \"5944ffb4-7e27-4259-8456-7c042f004f6c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" May 27 14:14:47.208086 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.208063 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5944ffb4-7e27-4259-8456-7c042f004f6c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b\" (UID: \"5944ffb4-7e27-4259-8456-7c042f004f6c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" May 27 14:14:47.208154 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.208097 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5944ffb4-7e27-4259-8456-7c042f004f6c-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b\" (UID: \"5944ffb4-7e27-4259-8456-7c042f004f6c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" May 27 14:14:47.208229 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.208205 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5944ffb4-7e27-4259-8456-7c042f004f6c-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b\" (UID: \"5944ffb4-7e27-4259-8456-7c042f004f6c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" May 27 14:14:47.210156 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.210137 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5944ffb4-7e27-4259-8456-7c042f004f6c-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b\" (UID: \"5944ffb4-7e27-4259-8456-7c042f004f6c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" May 27 14:14:47.210277 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.210261 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5944ffb4-7e27-4259-8456-7c042f004f6c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b\" (UID: \"5944ffb4-7e27-4259-8456-7c042f004f6c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" May 27 14:14:47.220498 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.220481 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gt2l\" (UniqueName: \"kubernetes.io/projected/5944ffb4-7e27-4259-8456-7c042f004f6c-kube-api-access-7gt2l\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b\" (UID: \"5944ffb4-7e27-4259-8456-7c042f004f6c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" May 27 14:14:47.354141 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.354058 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" May 27 14:14:47.505961 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:47.505935 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b"] May 27 14:14:47.506826 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:14:47.506802 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5944ffb4_7e27_4259_8456_7c042f004f6c.slice/crio-1dad4a11a1416e9a4cc8e5b775d8ec4ec48b6e9b5a51b32f8f5de74f74025d23 WatchSource:0}: Error finding container 1dad4a11a1416e9a4cc8e5b775d8ec4ec48b6e9b5a51b32f8f5de74f74025d23: Status 404 returned error can't find the container with id 1dad4a11a1416e9a4cc8e5b775d8ec4ec48b6e9b5a51b32f8f5de74f74025d23 May 27 14:14:48.339241 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:48.339197 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" event={"ID":"5944ffb4-7e27-4259-8456-7c042f004f6c","Type":"ContainerStarted","Data":"1dad4a11a1416e9a4cc8e5b775d8ec4ec48b6e9b5a51b32f8f5de74f74025d23"} May 27 14:14:55.379938 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:14:55.379890 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" event={"ID":"5944ffb4-7e27-4259-8456-7c042f004f6c","Type":"ContainerStarted","Data":"ee01ac2fd0d972354576eadfb85abe354d6558f28032141283315eca0c9a7d1c"} May 27 14:15:01.404649 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:01.404614 2576 generic.go:358] "Generic (PLEG): container finished" podID="5944ffb4-7e27-4259-8456-7c042f004f6c" containerID="ee01ac2fd0d972354576eadfb85abe354d6558f28032141283315eca0c9a7d1c" exitCode=0 May 27 14:15:01.405024 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:01.404655 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" event={"ID":"5944ffb4-7e27-4259-8456-7c042f004f6c","Type":"ContainerDied","Data":"ee01ac2fd0d972354576eadfb85abe354d6558f28032141283315eca0c9a7d1c"} May 27 14:15:03.414241 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:03.414152 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" event={"ID":"5944ffb4-7e27-4259-8456-7c042f004f6c","Type":"ContainerStarted","Data":"dcef6cc3b7aa5f397ea83fd8dc9e12b5e22540817fdd59f07c5d44c58f56f69c"} May 27 14:15:03.414651 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:03.414384 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" May 27 14:15:03.441484 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:03.441436 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" podStartSLOduration=0.906036772 podStartE2EDuration="16.441422475s" podCreationTimestamp="2026-05-27 14:14:47 +0000 UTC" firstStartedPulling="2026-05-27 14:14:47.508660765 +0000 UTC m=+569.861485879" lastFinishedPulling="2026-05-27 14:15:03.044046463 +0000 UTC m=+585.396871582" observedRunningTime="2026-05-27 14:15:03.439208716 +0000 UTC m=+585.792033854" watchObservedRunningTime="2026-05-27 14:15:03.441422475 +0000 UTC m=+585.794247611" May 27 14:15:12.628818 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:12.628780 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm"] May 27 14:15:12.632337 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:12.632305 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" May 27 14:15:12.635474 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:12.635454 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 27 14:15:12.642219 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:12.642195 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm"] May 27 14:15:12.729899 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:12.729858 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab8eb8a2-86bc-4680-aba4-d77d9e2f449e-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm\" (UID: \"ab8eb8a2-86bc-4680-aba4-d77d9e2f449e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" May 27 14:15:12.730043 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:12.729904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab8eb8a2-86bc-4680-aba4-d77d9e2f449e-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm\" (UID: \"ab8eb8a2-86bc-4680-aba4-d77d9e2f449e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" May 27 14:15:12.730043 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:12.729927 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkb5c\" (UniqueName: \"kubernetes.io/projected/ab8eb8a2-86bc-4680-aba4-d77d9e2f449e-kube-api-access-hkb5c\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm\" (UID: \"ab8eb8a2-86bc-4680-aba4-d77d9e2f449e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" May 27 14:15:12.730043 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:12.729949 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab8eb8a2-86bc-4680-aba4-d77d9e2f449e-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm\" (UID: \"ab8eb8a2-86bc-4680-aba4-d77d9e2f449e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" May 27 14:15:12.730043 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:12.729979 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab8eb8a2-86bc-4680-aba4-d77d9e2f449e-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm\" (UID: \"ab8eb8a2-86bc-4680-aba4-d77d9e2f449e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" May 27 14:15:12.730180 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:12.730052 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab8eb8a2-86bc-4680-aba4-d77d9e2f449e-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm\" (UID: \"ab8eb8a2-86bc-4680-aba4-d77d9e2f449e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" May 27 14:15:12.831496 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:12.831461 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab8eb8a2-86bc-4680-aba4-d77d9e2f449e-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm\" (UID: \"ab8eb8a2-86bc-4680-aba4-d77d9e2f449e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" May 27 14:15:12.831651 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:12.831510 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab8eb8a2-86bc-4680-aba4-d77d9e2f449e-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm\" (UID: \"ab8eb8a2-86bc-4680-aba4-d77d9e2f449e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" May 27 14:15:12.831651 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:12.831541 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab8eb8a2-86bc-4680-aba4-d77d9e2f449e-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm\" (UID: \"ab8eb8a2-86bc-4680-aba4-d77d9e2f449e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" May 27 14:15:12.831651 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:12.831561 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkb5c\" (UniqueName: \"kubernetes.io/projected/ab8eb8a2-86bc-4680-aba4-d77d9e2f449e-kube-api-access-hkb5c\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm\" (UID: \"ab8eb8a2-86bc-4680-aba4-d77d9e2f449e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" May 27 14:15:12.831651 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:12.831586 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab8eb8a2-86bc-4680-aba4-d77d9e2f449e-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm\" (UID: \"ab8eb8a2-86bc-4680-aba4-d77d9e2f449e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" May 27 14:15:12.831651 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:12.831632 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab8eb8a2-86bc-4680-aba4-d77d9e2f449e-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm\" (UID: \"ab8eb8a2-86bc-4680-aba4-d77d9e2f449e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" May 27 14:15:12.831899 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:12.831872 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab8eb8a2-86bc-4680-aba4-d77d9e2f449e-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm\" (UID: \"ab8eb8a2-86bc-4680-aba4-d77d9e2f449e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" May 27 14:15:12.832014 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:12.831978 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab8eb8a2-86bc-4680-aba4-d77d9e2f449e-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm\" (UID: \"ab8eb8a2-86bc-4680-aba4-d77d9e2f449e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" May 27 14:15:12.832014 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:12.832004 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab8eb8a2-86bc-4680-aba4-d77d9e2f449e-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm\" (UID: \"ab8eb8a2-86bc-4680-aba4-d77d9e2f449e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" May 27 14:15:12.833844 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:12.833822 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab8eb8a2-86bc-4680-aba4-d77d9e2f449e-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm\" (UID: \"ab8eb8a2-86bc-4680-aba4-d77d9e2f449e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" May 27 14:15:12.834248 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:12.834230 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab8eb8a2-86bc-4680-aba4-d77d9e2f449e-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm\" (UID: \"ab8eb8a2-86bc-4680-aba4-d77d9e2f449e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" May 27 14:15:12.840029 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:12.840007 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkb5c\" (UniqueName: \"kubernetes.io/projected/ab8eb8a2-86bc-4680-aba4-d77d9e2f449e-kube-api-access-hkb5c\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm\" (UID: \"ab8eb8a2-86bc-4680-aba4-d77d9e2f449e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" May 27 14:15:12.943906 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:12.943809 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" May 27 14:15:13.081911 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:13.081884 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm"] May 27 14:15:13.083522 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:15:13.083494 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab8eb8a2_86bc_4680_aba4_d77d9e2f449e.slice/crio-9d4dd4344018dc24d8db0995432c3173e154a12323eccc0016e7034b55dfba30 WatchSource:0}: Error finding container 9d4dd4344018dc24d8db0995432c3173e154a12323eccc0016e7034b55dfba30: Status 404 returned error can't find the container with id 9d4dd4344018dc24d8db0995432c3173e154a12323eccc0016e7034b55dfba30 May 27 14:15:13.452411 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:13.452378 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" event={"ID":"ab8eb8a2-86bc-4680-aba4-d77d9e2f449e","Type":"ContainerStarted","Data":"616d8c3631efd82884c2b65ce682df9dcf07e8bf54d6ac4df09d059e6de6f7ae"} May 27 14:15:13.452411 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:13.452415 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" event={"ID":"ab8eb8a2-86bc-4680-aba4-d77d9e2f449e","Type":"ContainerStarted","Data":"9d4dd4344018dc24d8db0995432c3173e154a12323eccc0016e7034b55dfba30"} May 27 14:15:14.431069 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:14.431035 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b" May 27 14:15:18.216254 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:18.216225 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wd4m8_61335746-8301-4cff-bbe5-8da818657d5d/ovn-acl-logging/0.log" May 27 14:15:18.217111 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:18.217093 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wd4m8_61335746-8301-4cff-bbe5-8da818657d5d/ovn-acl-logging/0.log" May 27 14:15:19.478378 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:19.478344 2576 generic.go:358] "Generic (PLEG): container finished" podID="ab8eb8a2-86bc-4680-aba4-d77d9e2f449e" containerID="616d8c3631efd82884c2b65ce682df9dcf07e8bf54d6ac4df09d059e6de6f7ae" exitCode=0 May 27 14:15:19.478796 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:19.478412 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" event={"ID":"ab8eb8a2-86bc-4680-aba4-d77d9e2f449e","Type":"ContainerDied","Data":"616d8c3631efd82884c2b65ce682df9dcf07e8bf54d6ac4df09d059e6de6f7ae"} May 27 14:15:21.488054 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:21.488006 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" event={"ID":"ab8eb8a2-86bc-4680-aba4-d77d9e2f449e","Type":"ContainerStarted","Data":"a3835e907bd818b8ee1d628c0fe4339c8ae9d3d7ff4964b302302eabc14a4c5a"} May 27 14:15:21.488442 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:21.488228 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" May 27 14:15:21.509361 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:21.509300 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" podStartSLOduration=8.315458518 podStartE2EDuration="9.509285526s" podCreationTimestamp="2026-05-27 14:15:12 +0000 UTC" firstStartedPulling="2026-05-27 14:15:19.479009814 +0000 UTC m=+601.831834928" lastFinishedPulling="2026-05-27 14:15:20.672836821 +0000 UTC m=+603.025661936" observedRunningTime="2026-05-27 14:15:21.50736972 +0000 UTC m=+603.860194855" watchObservedRunningTime="2026-05-27 14:15:21.509285526 +0000 UTC m=+603.862110661" May 27 14:15:32.505196 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:15:32.505163 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm" May 27 14:17:54.017600 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:17:54.017564 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-67598ddd74-gwmqz"] May 27 14:17:54.021050 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:17:54.021029 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67598ddd74-gwmqz" May 27 14:17:54.024121 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:17:54.024102 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 27 14:17:54.024246 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:17:54.024129 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vcm7m\"" May 27 14:17:54.031129 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:17:54.031108 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67598ddd74-gwmqz"] May 27 14:17:54.047452 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:17:54.047421 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gpcc\" (UniqueName: \"kubernetes.io/projected/54911a6d-7969-4638-85d7-b572d7326e7a-kube-api-access-7gpcc\") pod \"maas-controller-67598ddd74-gwmqz\" (UID: \"54911a6d-7969-4638-85d7-b572d7326e7a\") " pod="opendatahub/maas-controller-67598ddd74-gwmqz" May 27 14:17:54.148466 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:17:54.148433 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7gpcc\" (UniqueName: \"kubernetes.io/projected/54911a6d-7969-4638-85d7-b572d7326e7a-kube-api-access-7gpcc\") pod \"maas-controller-67598ddd74-gwmqz\" (UID: \"54911a6d-7969-4638-85d7-b572d7326e7a\") " pod="opendatahub/maas-controller-67598ddd74-gwmqz" May 27 14:17:54.157828 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:17:54.157798 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gpcc\" (UniqueName: \"kubernetes.io/projected/54911a6d-7969-4638-85d7-b572d7326e7a-kube-api-access-7gpcc\") pod \"maas-controller-67598ddd74-gwmqz\" (UID: \"54911a6d-7969-4638-85d7-b572d7326e7a\") " pod="opendatahub/maas-controller-67598ddd74-gwmqz" May 27 14:17:54.331790 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:17:54.331703 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67598ddd74-gwmqz" May 27 14:17:54.463879 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:17:54.463854 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67598ddd74-gwmqz"] May 27 14:17:54.465458 ip-10-0-141-132 kubenswrapper[2576]: W0527 14:17:54.465432 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54911a6d_7969_4638_85d7_b572d7326e7a.slice/crio-38d5a533ac87cd0b7213e54c582e282331de9f26fd4ddab13f3f37a9ddccf891 WatchSource:0}: Error finding container 38d5a533ac87cd0b7213e54c582e282331de9f26fd4ddab13f3f37a9ddccf891: Status 404 returned error can't find the container with id 38d5a533ac87cd0b7213e54c582e282331de9f26fd4ddab13f3f37a9ddccf891 May 27 14:17:54.466647 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:17:54.466632 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 14:17:55.077950 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:17:55.077915 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67598ddd74-gwmqz" event={"ID":"54911a6d-7969-4638-85d7-b572d7326e7a","Type":"ContainerStarted","Data":"fd819440a2fe6b96e2eab70a9336bf353977c702d2ae11ee017073469a234a24"} May 27 14:17:55.078385 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:17:55.077956 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67598ddd74-gwmqz" event={"ID":"54911a6d-7969-4638-85d7-b572d7326e7a","Type":"ContainerStarted","Data":"38d5a533ac87cd0b7213e54c582e282331de9f26fd4ddab13f3f37a9ddccf891"} May 27 14:17:55.078385 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:17:55.078063 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-67598ddd74-gwmqz" May 27 14:17:55.097432 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:17:55.097386 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-67598ddd74-gwmqz" podStartSLOduration=1.684412268 podStartE2EDuration="2.097373602s" podCreationTimestamp="2026-05-27 14:17:53 +0000 UTC" firstStartedPulling="2026-05-27 14:17:54.466750237 +0000 UTC m=+756.819575352" lastFinishedPulling="2026-05-27 14:17:54.879711572 +0000 UTC m=+757.232536686" observedRunningTime="2026-05-27 14:17:55.094795705 +0000 UTC m=+757.447620842" watchObservedRunningTime="2026-05-27 14:17:55.097373602 +0000 UTC m=+757.450198763" May 27 14:18:06.087225 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:18:06.087198 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-67598ddd74-gwmqz" May 27 14:20:18.252147 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:20:18.252120 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wd4m8_61335746-8301-4cff-bbe5-8da818657d5d/ovn-acl-logging/0.log" May 27 14:20:18.254885 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:20:18.254864 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wd4m8_61335746-8301-4cff-bbe5-8da818657d5d/ovn-acl-logging/0.log" May 27 14:25:18.290156 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:25:18.290127 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wd4m8_61335746-8301-4cff-bbe5-8da818657d5d/ovn-acl-logging/0.log" May 27 14:25:18.290743 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:25:18.290570 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wd4m8_61335746-8301-4cff-bbe5-8da818657d5d/ovn-acl-logging/0.log" May 27 14:30:18.319453 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:30:18.319422 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wd4m8_61335746-8301-4cff-bbe5-8da818657d5d/ovn-acl-logging/0.log" May 27 14:30:18.325966 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:30:18.325945 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wd4m8_61335746-8301-4cff-bbe5-8da818657d5d/ovn-acl-logging/0.log" May 27 14:35:18.351405 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:35:18.351375 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wd4m8_61335746-8301-4cff-bbe5-8da818657d5d/ovn-acl-logging/0.log" May 27 14:35:18.358502 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:35:18.358479 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wd4m8_61335746-8301-4cff-bbe5-8da818657d5d/ovn-acl-logging/0.log" May 27 14:39:11.684434 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:11.684401 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-lnk76_9b8909ba-f07b-4796-83d2-6fb24226780a/manager/0.log" May 27 14:39:11.810165 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:11.810131 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-575b79674d-m7j7q_42c0b4c5-cbcd-4f5d-be56-19aaacd60a1b/maas-api/0.log" May 27 14:39:12.149723 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:12.149688 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-67598ddd74-gwmqz_54911a6d-7969-4638-85d7-b572d7326e7a/manager/0.log" May 27 14:39:12.276105 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:12.276080 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-t8crp_542a89ff-4ca4-45db-ac83-6d9463732d5d/manager/2.log" May 27 14:39:12.401222 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:12.401131 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f4c796d7c-7pzfh_284a1001-72b8-4cd9-b65a-80716497cffc/manager/0.log" May 27 14:39:13.518658 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:13.518628 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2_17f9309c-11b7-45f6-9d53-574e1e4ae176/util/0.log" May 27 14:39:13.525567 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:13.525525 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2_17f9309c-11b7-45f6-9d53-574e1e4ae176/pull/0.log" May 27 14:39:13.532846 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:13.532826 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2_17f9309c-11b7-45f6-9d53-574e1e4ae176/extract/0.log" May 27 14:39:13.644910 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:13.644883 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl_a3312ad1-00cf-4bb1-b123-93482014d122/extract/0.log" May 27 14:39:13.651824 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:13.651796 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl_a3312ad1-00cf-4bb1-b123-93482014d122/util/0.log" May 27 14:39:13.658784 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:13.658764 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl_a3312ad1-00cf-4bb1-b123-93482014d122/pull/0.log" May 27 14:39:13.765952 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:13.765918 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r_307bf0f4-813d-4c29-a605-328e037b87c8/util/0.log" May 27 14:39:13.773096 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:13.773030 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r_307bf0f4-813d-4c29-a605-328e037b87c8/pull/0.log" May 27 14:39:13.779642 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:13.779618 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r_307bf0f4-813d-4c29-a605-328e037b87c8/extract/0.log" May 27 14:39:13.893697 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:13.893668 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c_bcda6e85-11d3-4e52-a137-c381fc03cc20/extract/0.log" May 27 14:39:13.901216 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:13.901194 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c_bcda6e85-11d3-4e52-a137-c381fc03cc20/util/0.log" May 27 14:39:13.908657 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:13.908637 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c_bcda6e85-11d3-4e52-a137-c381fc03cc20/pull/0.log" May 27 14:39:14.149555 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:14.149478 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-vkh86_2add920e-a5a9-4344-897c-6a42be597714/manager/0.log" May 27 14:39:14.266203 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:14.266172 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-glfs2_6dcff93b-bb18-4f61-bd9e-b9facc0abba8/manager/0.log" May 27 14:39:14.852093 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:14.852059 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-n67h8_0a814e11-ef1b-4a6e-918a-fea820172838/manager/0.log" May 27 14:39:15.330866 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:15.330842 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-rcgff_26e3710d-88c6-4a88-a226-d85392421ba8/discovery/0.log" May 27 14:39:15.435294 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:15.435264 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f84cc5569-224hw_3343c1aa-3a4a-45ea-80b2-ec85164b503a/kube-auth-proxy/0.log" May 27 14:39:16.214090 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:16.214061 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b_5944ffb4-7e27-4259-8456-7c042f004f6c/storage-initializer/0.log" May 27 14:39:16.222413 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:16.222387 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-lfc2b_5944ffb4-7e27-4259-8456-7c042f004f6c/main/0.log" May 27 14:39:16.333766 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:16.333731 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm_ab8eb8a2-86bc-4680-aba4-d77d9e2f449e/storage-initializer/0.log" May 27 14:39:16.342097 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:16.342073 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-gt7dm_ab8eb8a2-86bc-4680-aba4-d77d9e2f449e/main/0.log" May 27 14:39:24.227336 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:24.227306 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4nn5w_289d47a1-b316-4f03-a8d7-617598d6bef1/global-pull-secret-syncer/0.log" May 27 14:39:24.464948 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:24.464919 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tqc6p_425ee3b1-4732-4289-b393-23327664c19e/konnectivity-agent/0.log" May 27 14:39:24.515060 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:24.515032 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-132.ec2.internal_131ccd4b35d759f500cc09a15f66941e/haproxy/0.log" May 27 14:39:27.896455 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:27.896425 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2_17f9309c-11b7-45f6-9d53-574e1e4ae176/extract/0.log" May 27 14:39:27.925683 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:27.925661 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2_17f9309c-11b7-45f6-9d53-574e1e4ae176/util/0.log" May 27 14:39:27.952868 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:27.952847 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qd2c2_17f9309c-11b7-45f6-9d53-574e1e4ae176/pull/0.log" May 27 14:39:27.985794 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:27.985763 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl_a3312ad1-00cf-4bb1-b123-93482014d122/extract/0.log" May 27 14:39:28.018343 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:28.018289 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl_a3312ad1-00cf-4bb1-b123-93482014d122/util/0.log" May 27 14:39:28.050167 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:28.050141 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clmkl_a3312ad1-00cf-4bb1-b123-93482014d122/pull/0.log" May 27 14:39:28.079531 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:28.079503 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r_307bf0f4-813d-4c29-a605-328e037b87c8/extract/0.log" May 27 14:39:28.104996 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:28.104969 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r_307bf0f4-813d-4c29-a605-328e037b87c8/util/0.log" May 27 14:39:28.138447 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:28.138420 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f229r_307bf0f4-813d-4c29-a605-328e037b87c8/pull/0.log" May 27 14:39:28.164285 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:28.164206 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c_bcda6e85-11d3-4e52-a137-c381fc03cc20/extract/0.log" May 27 14:39:28.194299 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:28.194266 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c_bcda6e85-11d3-4e52-a137-c381fc03cc20/util/0.log" May 27 14:39:28.221112 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:28.221090 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fdr6c_bcda6e85-11d3-4e52-a137-c381fc03cc20/pull/0.log" May 27 14:39:28.462436 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:28.462336 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-vkh86_2add920e-a5a9-4344-897c-6a42be597714/manager/0.log" May 27 14:39:28.500182 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:28.500150 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-glfs2_6dcff93b-bb18-4f61-bd9e-b9facc0abba8/manager/0.log" May 27 14:39:28.747030 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:28.747002 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-n67h8_0a814e11-ef1b-4a6e-918a-fea820172838/manager/0.log" May 27 14:39:30.832490 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:30.832460 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6tmpr_acaf7477-4d53-4853-a4c2-c09d1b07c9fe/node-exporter/0.log" May 27 14:39:30.872185 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:30.872154 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6tmpr_acaf7477-4d53-4853-a4c2-c09d1b07c9fe/kube-rbac-proxy/0.log" May 27 14:39:30.912090 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:30.912068 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6tmpr_acaf7477-4d53-4853-a4c2-c09d1b07c9fe/init-textfile/0.log" May 27 14:39:32.559767 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:32.559730 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz"] May 27 14:39:32.563199 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:32.563182 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz" May 27 14:39:32.566482 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:32.566431 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9cxcf\"/\"kube-root-ca.crt\"" May 27 14:39:32.567766 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:32.567747 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9cxcf\"/\"default-dockercfg-wfl27\"" May 27 14:39:32.567867 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:32.567753 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9cxcf\"/\"openshift-service-ca.crt\"" May 27 14:39:32.573879 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:32.573849 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz"] May 27 14:39:32.701158 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:32.701120 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8d7a8db4-dc5f-4e2f-bd2f-5a52250af458-proc\") pod \"perf-node-gather-daemonset-25jwz\" (UID: \"8d7a8db4-dc5f-4e2f-bd2f-5a52250af458\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz" May 27 14:39:32.701158 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:32.701158 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d7a8db4-dc5f-4e2f-bd2f-5a52250af458-sys\") pod \"perf-node-gather-daemonset-25jwz\" (UID: \"8d7a8db4-dc5f-4e2f-bd2f-5a52250af458\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz" May 27 14:39:32.701397 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:32.701195 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8d7a8db4-dc5f-4e2f-bd2f-5a52250af458-podres\") pod \"perf-node-gather-daemonset-25jwz\" (UID: \"8d7a8db4-dc5f-4e2f-bd2f-5a52250af458\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz" May 27 14:39:32.701397 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:32.701261 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d7a8db4-dc5f-4e2f-bd2f-5a52250af458-lib-modules\") pod \"perf-node-gather-daemonset-25jwz\" (UID: \"8d7a8db4-dc5f-4e2f-bd2f-5a52250af458\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz" May 27 14:39:32.701397 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:32.701375 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zxbq\" (UniqueName: \"kubernetes.io/projected/8d7a8db4-dc5f-4e2f-bd2f-5a52250af458-kube-api-access-2zxbq\") pod \"perf-node-gather-daemonset-25jwz\" (UID: \"8d7a8db4-dc5f-4e2f-bd2f-5a52250af458\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz" May 27 14:39:32.801963 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:32.801933 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2zxbq\" (UniqueName: \"kubernetes.io/projected/8d7a8db4-dc5f-4e2f-bd2f-5a52250af458-kube-api-access-2zxbq\") pod \"perf-node-gather-daemonset-25jwz\" (UID: \"8d7a8db4-dc5f-4e2f-bd2f-5a52250af458\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz" May 27 14:39:32.802149 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:32.801979 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8d7a8db4-dc5f-4e2f-bd2f-5a52250af458-proc\") pod \"perf-node-gather-daemonset-25jwz\" (UID: \"8d7a8db4-dc5f-4e2f-bd2f-5a52250af458\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz" May 27 14:39:32.802149 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:32.802005 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d7a8db4-dc5f-4e2f-bd2f-5a52250af458-sys\") pod \"perf-node-gather-daemonset-25jwz\" (UID: \"8d7a8db4-dc5f-4e2f-bd2f-5a52250af458\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz" May 27 14:39:32.802149 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:32.802041 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8d7a8db4-dc5f-4e2f-bd2f-5a52250af458-podres\") pod \"perf-node-gather-daemonset-25jwz\" (UID: \"8d7a8db4-dc5f-4e2f-bd2f-5a52250af458\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz" May 27 14:39:32.802149 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:32.802075 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8d7a8db4-dc5f-4e2f-bd2f-5a52250af458-proc\") pod \"perf-node-gather-daemonset-25jwz\" (UID: \"8d7a8db4-dc5f-4e2f-bd2f-5a52250af458\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz" May 27 14:39:32.802149 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:32.802075 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d7a8db4-dc5f-4e2f-bd2f-5a52250af458-lib-modules\") pod \"perf-node-gather-daemonset-25jwz\" (UID: \"8d7a8db4-dc5f-4e2f-bd2f-5a52250af458\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz" May 27 14:39:32.802149 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:32.802107 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d7a8db4-dc5f-4e2f-bd2f-5a52250af458-sys\") pod \"perf-node-gather-daemonset-25jwz\" (UID: \"8d7a8db4-dc5f-4e2f-bd2f-5a52250af458\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz" May 27 14:39:32.802406 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:32.802186 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d7a8db4-dc5f-4e2f-bd2f-5a52250af458-lib-modules\") pod \"perf-node-gather-daemonset-25jwz\" (UID: \"8d7a8db4-dc5f-4e2f-bd2f-5a52250af458\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz" May 27 14:39:32.802406 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:32.802207 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8d7a8db4-dc5f-4e2f-bd2f-5a52250af458-podres\") pod \"perf-node-gather-daemonset-25jwz\" (UID: \"8d7a8db4-dc5f-4e2f-bd2f-5a52250af458\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz" May 27 14:39:32.810503 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:32.810443 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zxbq\" (UniqueName: \"kubernetes.io/projected/8d7a8db4-dc5f-4e2f-bd2f-5a52250af458-kube-api-access-2zxbq\") pod \"perf-node-gather-daemonset-25jwz\" (UID: \"8d7a8db4-dc5f-4e2f-bd2f-5a52250af458\") " pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz" May 27 14:39:32.873375 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:32.873355 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz" May 27 14:39:33.009129 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:33.009088 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz"] May 27 14:39:33.016495 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:33.016468 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 14:39:33.061044 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:33.060983 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz" event={"ID":"8d7a8db4-dc5f-4e2f-bd2f-5a52250af458","Type":"ContainerStarted","Data":"0e02d4e90013cab5e9d084a192a44b4965b9a91c1af81ef55c0b6ef7c87db0c8"} May 27 14:39:33.752149 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:33.752115 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75dfdd649d-qz9rs_fda943e4-3e9e-4ade-a250-d88e5e9f66a1/console/0.log" May 27 14:39:33.792350 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:33.792305 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-4gvg6_26c67875-8892-4213-ac40-1cbd327af5d2/download-server/0.log" May 27 14:39:34.067444 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:34.067358 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz" event={"ID":"8d7a8db4-dc5f-4e2f-bd2f-5a52250af458","Type":"ContainerStarted","Data":"c1028789f878a5739145c935dc19d25301fb3e1a6ffa52da45b8839d063faf1e"} May 27 14:39:34.067586 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:34.067482 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz" May 27 14:39:34.087822 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:34.087776 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz" podStartSLOduration=2.087762849 podStartE2EDuration="2.087762849s" podCreationTimestamp="2026-05-27 14:39:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 14:39:34.085293809 +0000 UTC m=+2056.438118948" watchObservedRunningTime="2026-05-27 14:39:34.087762849 +0000 UTC m=+2056.440587984" May 27 14:39:35.215038 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:35.215007 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h4llj_59575ced-2733-424b-91f8-04efa7a3d4f3/dns/0.log" May 27 14:39:35.236264 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:35.236241 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h4llj_59575ced-2733-424b-91f8-04efa7a3d4f3/kube-rbac-proxy/0.log" May 27 14:39:35.307209 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:35.307182 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cgjjd_948632b3-b439-4e9b-ab4c-8f29cce2643a/dns-node-resolver/0.log" May 27 14:39:35.896274 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:35.896238 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-f7d4789c6-b8lwr_51fef4bf-a781-4a70-abb7-69f09f1b2e02/registry/0.log" May 27 14:39:35.922806 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:35.922770 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d6zwm_0f1c91f4-dd6f-49db-9f83-6fcc448f06f3/node-ca/0.log" May 27 14:39:37.012904 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:37.012874 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-rcgff_26e3710d-88c6-4a88-a226-d85392421ba8/discovery/0.log" May 27 14:39:37.049332 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:37.049304 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f84cc5569-224hw_3343c1aa-3a4a-45ea-80b2-ec85164b503a/kube-auth-proxy/0.log" May 27 14:39:37.855905 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:37.855822 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m4795_60daec24-40fb-4ec9-bd38-48b06bfee016/serve-healthcheck-canary/0.log" May 27 14:39:38.408490 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:38.408464 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-74t66_e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710/kube-rbac-proxy/0.log" May 27 14:39:38.431101 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:38.431071 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-74t66_e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710/exporter/0.log" May 27 14:39:38.453010 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:38.452985 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-74t66_e06f8c1f-e3b0-4a1c-80f7-cc7ac3c1d710/extractor/0.log" May 27 14:39:40.080996 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:40.080971 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9cxcf/perf-node-gather-daemonset-25jwz" May 27 14:39:40.628082 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:40.628053 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-lnk76_9b8909ba-f07b-4796-83d2-6fb24226780a/manager/0.log" May 27 14:39:40.674695 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:40.674663 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-575b79674d-m7j7q_42c0b4c5-cbcd-4f5d-be56-19aaacd60a1b/maas-api/0.log" May 27 14:39:40.826781 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:40.826754 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-67598ddd74-gwmqz_54911a6d-7969-4638-85d7-b572d7326e7a/manager/0.log" May 27 14:39:40.850704 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:40.850677 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-t8crp_542a89ff-4ca4-45db-ac83-6d9463732d5d/manager/1.log" May 27 14:39:40.872737 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:40.872710 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-t8crp_542a89ff-4ca4-45db-ac83-6d9463732d5d/manager/2.log" May 27 14:39:40.930292 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:40.930204 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f4c796d7c-7pzfh_284a1001-72b8-4cd9-b65a-80716497cffc/manager/0.log" May 27 14:39:42.437630 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:42.437545 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-xc6sp_8f9f3a79-59c0-4fe2-a210-2d3fe8c3c8fd/openshift-lws-operator/0.log" May 27 14:39:47.367968 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:47.367940 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-bc884_359794b7-1c6c-41e8-8bea-f8bdfe0860db/migrator/0.log" May 27 14:39:47.388641 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:47.388615 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-bc884_359794b7-1c6c-41e8-8bea-f8bdfe0860db/graceful-termination/0.log" May 27 14:39:48.815438 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:48.815408 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qd9xc_7dce939e-5149-403d-a0b3-5b40c239a8c4/kube-multus-additional-cni-plugins/0.log" May 27 14:39:48.837874 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:48.837847 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qd9xc_7dce939e-5149-403d-a0b3-5b40c239a8c4/egress-router-binary-copy/0.log" May 27 14:39:48.861684 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:48.861658 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qd9xc_7dce939e-5149-403d-a0b3-5b40c239a8c4/cni-plugins/0.log" May 27 14:39:48.883130 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:48.883102 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qd9xc_7dce939e-5149-403d-a0b3-5b40c239a8c4/bond-cni-plugin/0.log" May 27 14:39:48.902989 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:48.902963 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qd9xc_7dce939e-5149-403d-a0b3-5b40c239a8c4/routeoverride-cni/0.log" May 27 14:39:48.924086 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:48.924061 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qd9xc_7dce939e-5149-403d-a0b3-5b40c239a8c4/whereabouts-cni-bincopy/0.log" May 27 14:39:48.945060 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:48.945039 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qd9xc_7dce939e-5149-403d-a0b3-5b40c239a8c4/whereabouts-cni/0.log" May 27 14:39:49.336582 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:49.336550 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rkmqt_6bb48ff2-6eb2-427e-85d8-8e127bf280e1/kube-multus/0.log" May 27 14:39:49.360685 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:49.360650 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-58m9b_f1a2947c-37ec-4483-b026-f7d0e5a6365d/network-metrics-daemon/0.log" May 27 14:39:49.380268 ip-10-0-141-132 kubenswrapper[2576]: I0527 14:39:49.380244 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-58m9b_f1a2947c-37ec-4483-b026-f7d0e5a6365d/kube-rbac-proxy/0.log"